-- Logs begin at Wed 2022-09-21 15:42:00 UTC, end at Wed 2022-09-21 17:13:47 UTC. -- Sep 21 16:13:39.457408 dv-cinder-858621-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 21 16:13:39.466491 dv-cinder-858621-1-iscsi devstack@n-api.service[105487]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 21 16:13:39.468585 dv-cinder-858621-1-iscsi devstack@n-api.service[105487]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 21 16:13:39 2022] *** Sep 21 16:13:39.468585 dv-cinder-858621-1-iscsi devstack@n-api.service[105487]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 21 16:13:39.468585 dv-cinder-858621-1-iscsi devstack@n-api.service[105487]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 21 16:13:39.468585 dv-cinder-858621-1-iscsi devstack@n-api.service[105487]: nodename: dv-cinder-858621-1-iscsi Sep 21 16:13:39.468585 dv-cinder-858621-1-iscsi devstack@n-api.service[105487]: machine: x86_64 Sep 21 16:13:39.468585 dv-cinder-858621-1-iscsi devstack@n-api.service[105487]: clock source: unix Sep 21 16:13:39.468585 dv-cinder-858621-1-iscsi devstack@n-api.service[105487]: pcre jit disabled Sep 21 16:13:39.468585 dv-cinder-858621-1-iscsi devstack@n-api.service[105487]: detected number of CPU cores: 4 Sep 21 16:13:39.468585 dv-cinder-858621-1-iscsi devstack@n-api.service[105487]: current working directory: / Sep 21 16:13:39.468585 dv-cinder-858621-1-iscsi devstack@n-api.service[105487]: detected binary path: /usr/bin/uwsgi-core Sep 21 16:13:39.468585 dv-cinder-858621-1-iscsi devstack@n-api.service[105487]: your processes number limit is 47680 Sep 21 16:13:39.468585 dv-cinder-858621-1-iscsi devstack@n-api.service[105487]: your memory page size is 4096 bytes Sep 21 16:13:39.468585 dv-cinder-858621-1-iscsi devstack@n-api.service[105487]: detected max file descriptor number: 2048 Sep 21 16:13:39.469438 dv-cinder-858621-1-iscsi devstack@n-api.service[105487]: lock engine: pthread robust mutexes Sep 21 16:13:39.469438 dv-cinder-858621-1-iscsi devstack@n-api.service[105487]: thunder lock: enabled Sep 21 16:13:39.469438 dv-cinder-858621-1-iscsi devstack@n-api.service[105487]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 21 16:13:39.469438 dv-cinder-858621-1-iscsi devstack@n-api.service[105487]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 21 16:13:39.510818 dv-cinder-858621-1-iscsi devstack@n-api.service[105487]: Python main interpreter initialized at 0x5577d1e199c0 Sep 21 16:13:39.510818 dv-cinder-858621-1-iscsi devstack@n-api.service[105487]: python threads support enabled Sep 21 16:13:39.510818 dv-cinder-858621-1-iscsi devstack@n-api.service[105487]: your server socket listen backlog is limited to 100 connections Sep 21 16:13:39.510818 dv-cinder-858621-1-iscsi devstack@n-api.service[105487]: your mercy for graceful operations on workers is 90 seconds Sep 21 16:13:39.511235 dv-cinder-858621-1-iscsi devstack@n-api.service[105487]: mapped 403077 bytes (393 KB) for 2 cores Sep 21 16:13:39.511235 dv-cinder-858621-1-iscsi devstack@n-api.service[105487]: *** Operational MODE: preforking *** Sep 21 16:13:39.511526 dv-cinder-858621-1-iscsi devstack@n-api.service[105487]: *** uWSGI is running in multiple interpreter mode *** Sep 21 16:13:39.511526 dv-cinder-858621-1-iscsi devstack@n-api.service[105487]: spawned uWSGI master process (pid: 105487) Sep 21 16:13:39.511738 dv-cinder-858621-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 21 16:13:39.512415 dv-cinder-858621-1-iscsi devstack@n-api.service[105487]: spawned uWSGI worker 1 (pid: 105500, cores: 1) Sep 21 16:13:39.512662 dv-cinder-858621-1-iscsi devstack@n-api.service[105487]: spawned uWSGI worker 2 (pid: 105501, cores: 1) Sep 21 16:13:39.512823 dv-cinder-858621-1-iscsi devstack@n-api.service[105487]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 21 16:13:40.184137 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 21 16:13:40.201692 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 21 16:13:41.275642 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 21 16:13:41.275642 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: from cryptography.utils import int_from_bytes Sep 21 16:13:41.276382 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 21 16:13:41.276382 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: from cryptography.utils import int_from_bytes Sep 21 16:13:41.521495 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 21 16:13:41.521495 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: from cryptography.utils import int_from_bytes Sep 21 16:13:41.522176 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 21 16:13:41.522176 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: from cryptography.utils import int_from_bytes Sep 21 16:13:43.776635 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 21 16:13:43.777181 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 21 16:13:43.777337 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 21 16:13:43.777698 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 21 16:13:43.777954 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 21 16:13:43.778364 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.778697 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.779015 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.779337 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.779669 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.779982 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.780301 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.780618 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.780944 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.781210 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.781527 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.781851 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-858621-1-iscsi {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.782201 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.782509 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.782819 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.783138 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.783443 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.783767 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.784104 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.784604 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.785058 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.785370 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.785688 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.786025 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.786373 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.786675 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.786998 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.787307 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.787631 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.787943 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.788345 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-858621-1-iscsi {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.788702 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.788978 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.789293 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.789706 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.790021 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.790355 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.790676 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.791000 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.791310 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.791639 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.791958 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.792277 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.792597 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.792899 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.793207 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.793517 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.793835 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.794161 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.794472 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.794723 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.795031 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.795358 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.795808 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.795986 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.796239 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.796491 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.796812 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.797131 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.797440 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.797751 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.798068 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.798387 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.798697 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.799004 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.799314 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.799619 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.800088 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.800313 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.800651 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.800946 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.801267 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.801671 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.801924 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.802259 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.802599 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.802917 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.803228 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.803548 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.803871 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.804179 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.804488 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.804794 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.805114 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.805447 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.805765 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.806083 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.806333 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.806640 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.806960 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.807281 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.807573 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.807881 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.808183 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.808490 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.808798 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.809173 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.809414 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.810345 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.810345 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.810345 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.810772 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.810914 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.811223 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.811815 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.812134 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.812444 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.812859 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.813171 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.813481 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.813802 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.814129 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.814438 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.814762 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.815069 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.815922 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.816221 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.816530 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.816838 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.817178 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.817461 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.817768 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.818103 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.818412 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.818718 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.819021 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.819326 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.819628 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.819933 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.820236 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.820540 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.820838 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.821157 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.821477 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.821787 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.822126 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.822435 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.822754 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.823095 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.823428 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.823774 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.824097 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.824431 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.824764 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.825085 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.825400 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.825716 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.826067 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.826383 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.826696 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.827009 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.827331 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.827651 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.827981 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.828300 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.828617 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.828936 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.829249 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.829567 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.829896 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.830242 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.830556 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.830900 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.831804 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.832126 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.832452 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.832777 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.833091 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.833404 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.833716 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.834080 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.834400 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.834714 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.835034 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.835349 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.835673 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.835986 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.836300 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.836612 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.836924 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.837234 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.837573 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.837889 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.838250 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.838570 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.838883 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.839200 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.839513 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.839825 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.840137 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.840445 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.840749 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.841055 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.841364 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.841669 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.842368 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.842857 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.843174 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.843519 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.843830 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.844145 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.844462 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.844777 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.845088 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.845404 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.845723 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.846030 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.846382 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.846718 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.847029 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.847357 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.847665 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.847975 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.848294 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.848608 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.848923 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.849240 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.849554 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.849879 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.850224 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.850539 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.850875 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.851214 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.851521 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.851849 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.852177 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.852504 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.852810 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.853123 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.853433 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.853740 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.854060 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.854379 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.854685 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.854990 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.855298 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.855600 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.855904 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.856228 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.856541 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.856795 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 21 16:13:43.857221 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.857304 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 21 16:13:43.857428 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.857428 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.857596 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 21 16:13:43.857750 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.857937 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 21 16:13:43.858093 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.858233 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 21 16:13:43.858425 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.858620 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.858763 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.858945 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.859084 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.859269 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.859409 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.859590 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.859724 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.859922 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.860045 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.860235 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.860358 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.860555 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.860671 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.860872 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.860985 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.861200 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.861290 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.861461 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.861605 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.861782 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.861917 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.862131 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-858621-1-iscsi {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.862803 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.862998 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.863123 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.863307 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.863448 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.863615 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.863760 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.863934 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.864083 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.864239 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.864390 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.864560 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.864707 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.864865 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.865048 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.865370 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.865470 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.865701 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.865799 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.865982 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.866109 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.866320 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.866404 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.866636 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.866759 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.866949 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.867034 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.867255 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.867337 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.867566 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.867650 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.867869 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.867958 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.868190 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.868294 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.868499 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.868590 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.868818 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.868901 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-858621-1-iscsi {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.869130 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.869223 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.869455 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.869540 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.869767 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.869851 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.870329 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.870434 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.870511 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.870588 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.870711 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.870805 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.871039 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.871125 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.871379 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.871472 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.871690 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.871784 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.872005 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.872089 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.872328 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.872420 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.872640 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.872733 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.872959 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.873088 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.873262 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.873353 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.873566 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.873659 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.873874 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.873957 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.874211 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.874299 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.874516 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.874617 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.874824 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.874919 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.875077 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.875168 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.875385 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.875477 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.875706 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.875797 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.876027 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.876112 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.876331 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.876417 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.876588 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.876718 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.876876 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.877006 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.877150 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.877237 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.877469 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.877563 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.877777 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.877944 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.878676 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.878763 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.878988 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.879073 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.879297 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.879399 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.879604 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.879700 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.879912 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.879996 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.880220 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.880313 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.880526 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.880610 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.880831 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.880922 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.881147 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.881242 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.881470 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.881565 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.881773 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.881857 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.882113 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.882216 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.882439 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.882523 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.882752 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.882837 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.883057 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.883197 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.883372 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.883463 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.883683 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.883767 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.884000 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.884092 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.884312 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.884407 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.884623 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.884707 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.884928 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.885012 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.885236 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.885320 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.885543 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.885639 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.885854 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.885944 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.886200 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.886300 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.886510 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.886611 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.886767 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.886897 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.887070 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.887175 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.887373 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.887481 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.887693 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.887779 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.888000 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.888098 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.888308 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.888583 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.888675 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.888901 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.888996 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.889207 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.889303 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.889514 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.889599 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.889819 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.889903 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.890150 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.890251 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.890460 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.890545 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.890766 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.890850 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.891069 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.891154 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.891375 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.891459 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.891680 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.891764 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.891984 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.892067 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.892301 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.892385 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.892614 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.892698 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.892918 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.893001 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.893229 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.893356 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.893561 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.893707 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.893868 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.893992 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.894199 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.894334 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.894506 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.894633 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.894809 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.894933 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.895114 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.895249 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.895433 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.895566 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.895743 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.895869 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.896058 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.896185 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.896367 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.896490 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.896676 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.896810 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.897038 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.897179 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.897302 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.897421 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.897593 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.897763 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.897887 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.898008 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.898217 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.898341 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.898524 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.898659 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.898825 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.898950 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.899128 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.899253 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.899431 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.899556 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.899733 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.899858 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.900036 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.900161 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.900339 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.900465 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.900636 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.900763 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.900954 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.901081 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.901273 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.901399 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.901580 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.901704 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.901884 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.902014 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.902278 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.902402 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.902523 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.902643 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:13:43.902807 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.902942 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.903119 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.903245 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.903431 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.903565 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.903735 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.903870 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.904044 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.904177 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.904349 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.904474 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.904664 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.904803 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.904973 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.905105 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.905275 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.905408 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.905578 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.905716 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.905889 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.906016 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.906223 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.906350 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.906529 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.906662 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.906839 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.906965 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.907141 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.907267 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.907458 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.907584 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.907763 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.907890 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.908068 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.908194 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.908371 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.908497 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.908682 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.908807 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.908992 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.909119 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.909324 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.909450 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.909648 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.909774 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.909961 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.910162 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.910295 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.910424 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.910581 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.910721 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.910890 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.911030 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.911195 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.911323 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.911498 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.911624 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.911808 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.911943 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.912130 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.912264 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.912446 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.912571 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.912755 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.912889 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.913064 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.913190 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.913394 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.913524 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.913674 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.913808 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.913979 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.914121 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.914313 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.914455 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.914618 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.914751 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.914921 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.915054 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.915222 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.915347 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.915526 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.915659 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.915831 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.915957 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.916154 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.916287 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.916466 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.916592 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.916773 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.916898 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.917080 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.917213 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.917382 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.917514 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.917701 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.917824 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.918015 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.918209 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.918339 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.918460 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.918648 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.918775 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.918956 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.919092 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.919262 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.919387 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.919565 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.919699 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.919875 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.920011 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.920181 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.920314 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.920489 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.920612 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.920806 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.920940 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.921113 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.921238 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.921426 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.921557 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.921733 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.921865 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.922037 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.922180 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.922377 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.922500 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.922689 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.922816 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.922995 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.923120 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.923308 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.923432 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.923603 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.923725 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.923912 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.924045 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.924233 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.924357 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.924542 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.924673 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.925385 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.925519 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.925696 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.925829 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.926008 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.926182 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.926342 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.926466 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.926658 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.926794 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.926969 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.927093 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.927282 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.927407 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.927595 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.927727 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.927906 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.928031 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.928212 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.928337 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.928525 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.928659 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.928834 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.928958 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.929140 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.929270 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.929466 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.929592 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.929777 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.929914 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.930102 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.930243 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.930421 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.930548 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.930722 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.930848 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.931034 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.931168 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.931372 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.931502 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.931767 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.931884 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.932079 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.932204 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.932392 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.932519 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.932703 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.932828 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.933014 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.933147 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.933323 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.933455 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.933620 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.933750 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.933915 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.934100 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.934241 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.934365 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.934559 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.934684 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.934873 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.935011 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.935178 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.935304 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.935505 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.935631 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.935810 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.935943 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.936138 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.936262 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.936700 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.936836 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.937023 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.937148 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.937330 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.937456 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.937636 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.937762 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.937941 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.938103 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.938288 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.938415 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.938593 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.938726 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.938915 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.939042 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.939331 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.939466 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.939642 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.939768 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.939948 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.940074 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.940422 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.941081 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.941205 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.941335 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.941520 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.941646 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.941846 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.941970 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.942194 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.942335 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.942525 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.942660 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.942838 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.942964 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.943154 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.943303 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.943465 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.943592 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.943791 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.943924 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.944116 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.944255 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.944427 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.944553 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.944745 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.944871 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.945054 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.945181 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.945370 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.945493 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.945681 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.945807 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.945994 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.946139 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.946333 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.946467 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.946647 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.946772 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.947004 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.947129 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.947356 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.947481 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.947677 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.947801 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.948003 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.948135 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.948309 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.948435 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.948615 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.948749 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.948927 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.949054 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.949234 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.949360 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.949542 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.949681 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.949866 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.949993 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.950199 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.950326 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.950513 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.950651 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.950825 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.950950 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.951136 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.951262 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.951442 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.951582 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.951749 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.951881 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.952065 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.952189 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.952369 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.952493 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.952675 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.952801 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.952988 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.953114 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.953305 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.953431 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.953618 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.953783 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.953907 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.954027 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.954252 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.954378 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.954562 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.954685 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.954871 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.954995 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.955177 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.955301 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.955479 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.955611 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.955793 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.955951 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.956143 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.956274 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.956462 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.956586 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.956787 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.956922 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.957112 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.957244 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.957419 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.957545 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.957725 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.957845 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.958076 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.958204 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.958383 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.958520 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.958688 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.958822 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.958991 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.959117 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.959296 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.959422 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.959606 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.959731 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.959911 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.960043 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.960222 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.960346 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.960528 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.960655 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.960833 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.960958 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.961139 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.961271 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.961476 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.961602 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.961729 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.961851 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.962026 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.962186 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.962350 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.962476 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.962679 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.962806 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.962985 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.963124 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.963297 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.963420 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.963606 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.963731 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.963913 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.964049 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.964217 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.964350 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.964541 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.964750 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.964945 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.965081 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.965204 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.965331 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.965455 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.965576 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.965696 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.965857 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.966009 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.966251 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.966374 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.966493 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.966693 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.967001 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.967127 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.967317 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.967440 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.967635 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.967773 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.967957 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.968080 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.968272 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.968397 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.968584 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.968718 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.968901 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.969035 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.969218 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.969350 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.969538 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.969663 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.969846 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.970126 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.970267 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.970460 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.970585 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.970774 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.970912 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.971086 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.971210 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.971391 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.971514 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.971727 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.971869 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.972036 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.972162 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.972347 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.972479 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.972653 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.972780 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.972956 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.973084 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.973259 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.973383 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.973565 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.973697 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.973926 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.974161 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.974364 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.974573 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.974794 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.974981 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.975171 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.975367 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.975567 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.975771 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.975960 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.976157 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.976355 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.976552 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.976756 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.976970 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.977175 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.977382 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.977572 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.977760 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.977969 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.978200 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.978405 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.978603 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.978802 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.979002 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.979002 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.979422 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.979577 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.979709 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.979709 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.979938 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.979938 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.980178 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.980308 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.980431 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.980552 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.980552 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.980788 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.980917 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.980917 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.981208 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.981424 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.981424 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.981669 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.981790 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.981919 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.982116 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.982242 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.982363 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.982486 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.982486 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.982737 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.982859 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.982980 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.983101 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.983222 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.983407 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.983530 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.983659 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.983781 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.983902 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.984063 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.984266 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.984392 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.984596 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.984905 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.985036 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.985212 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.985474 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.985609 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.985818 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.986067 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.986207 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.986494 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.986623 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.986755 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.986878 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.987061 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.987746 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.987915 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.988078 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.988223 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.988345 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.989113 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.989260 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.989396 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.989521 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.989643 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.989773 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.989906 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.990036 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.990204 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.990329 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.990484 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.990612 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.990725 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.990855 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.991034 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.991160 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.991297 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.991423 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.991554 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.991684 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.991807 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.991930 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.992051 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.992172 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.992294 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.992426 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.992557 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.992724 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.992852 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.993035 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.993170 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.993347 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.993474 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.993653 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.993786 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.993964 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.994170 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.994289 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.994433 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.994608 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.994734 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.994917 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.995052 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.995223 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.995363 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.995531 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.995684 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.995844 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.995978 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.996151 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.996285 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.996455 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.996624 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.996755 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.996890 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.997046 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.997173 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.997359 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.997494 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.997689 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.997820 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.997973 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.998116 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.998301 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.998425 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.998613 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.998740 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.998974 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.999099 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.999286 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.999425 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.999634 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.999757 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:43.999906 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.000034 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.000217 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.000344 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.000526 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.000667 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.000841 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.000967 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.001153 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.001288 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.001461 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.001585 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.001776 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.001900 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.002113 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.002254 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.002434 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.002612 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.002741 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.002972 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.003685 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.003888 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.004074 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.004274 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.004440 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.004626 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.004794 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.004930 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.005053 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.005174 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.005296 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.005466 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.005603 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.005774 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.005907 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.006103 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.006232 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.006433 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.006572 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.006746 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.006873 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.007060 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.007186 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.007373 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.007509 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.007684 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.007818 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.007995 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.008121 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.008312 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.008522 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.008655 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.008777 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.008908 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.009030 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.009207 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.009334 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.009521 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.009661 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.009827 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.009952 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.010152 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.010282 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.010458 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.010595 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.010769 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.010896 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.011075 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.011201 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.011392 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.011518 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.011701 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.011835 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.012021 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.012147 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.012331 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.012465 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.012652 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.012784 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.012966 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.013092 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.013276 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.013402 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.013587 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.013726 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.013897 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.014023 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.014239 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.014363 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.014574 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.014711 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.014890 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.015023 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.015197 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.015321 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.015642 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.015911 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.016042 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.016237 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.016361 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.016559 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.016691 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.016868 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.016991 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.017176 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.017300 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.017491 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.017622 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.017818 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.017941 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.018147 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.018289 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.018478 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.018605 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.018788 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.018918 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.019112 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.019236 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.019419 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.019543 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.019742 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.019872 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.020086 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.020212 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.020398 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.020524 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.020707 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.020833 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.021015 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.021146 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.021328 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.021461 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.021647 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.021785 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.021957 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.022118 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.022288 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.022416 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.022601 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.022727 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.022914 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.023048 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.023220 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.023347 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.023527 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.023652 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.023831 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.023966 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.024136 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.024262 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.024444 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.024570 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.024750 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.024884 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.025054 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.025187 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.025359 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.025486 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.025663 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.025797 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.025967 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.026121 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.026294 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.026420 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.026604 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.026836 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.026976 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.027099 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.027228 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.027415 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.027550 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.027740 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.027873 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.028060 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.028185 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.028365 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.028498 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.028672 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.028793 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.028985 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.029119 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.029317 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.029442 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.029584 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.029712 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.029909 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.030035 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.030246 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.030374 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.030561 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.030687 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.030874 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.031001 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.031186 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.031311 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.031491 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.031617 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.031797 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.031924 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.032124 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.032250 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.032429 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.032553 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.032749 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.032883 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.033064 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.033191 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.033376 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.033513 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.033690 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.033824 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.033996 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.034178 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.034370 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.034489 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.034675 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.034809 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.034980 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.035105 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.035288 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.035413 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.035595 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.035730 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.035894 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.036019 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.036211 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.036337 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.036538 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.036663 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.036849 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.036973 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.037161 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.037287 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.037474 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.037608 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.037787 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.037914 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.038121 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.038264 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.038443 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.038571 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.038756 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.038879 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.039068 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.039202 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.039387 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.039513 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.039692 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.039823 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.039998 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.040137 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.040312 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.040445 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.040620 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.040746 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.040926 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.041060 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.041233 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.041360 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.041544 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.041670 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.041850 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.041977 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.042176 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.042301 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.042475 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.042612 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.042800 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.042928 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.043106 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.043232 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.043431 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.043558 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.043688 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 21 16:13:44.043811 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.044035 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.044342 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.044648 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.044990 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.045295 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.045624 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.045934 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.046287 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.046608 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.046927 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.047244 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.047564 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.047883 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.048204 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.048520 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.048834 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.049148 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.049463 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.050355 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.050932 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.051267 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.051589 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.051905 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.052219 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.052543 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.052860 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.053176 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.053492 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.053807 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.054144 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.054476 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.054802 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.055133 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.055470 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.055791 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.056108 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.056424 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.056739 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.057100 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.057417 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.057733 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.058065 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.058383 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.058698 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.059015 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.059327 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.059642 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.059956 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.060269 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.060581 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.060892 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.061206 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.061791 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.062154 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.062483 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.062800 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.063116 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.063434 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.063971 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.064294 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.064635 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.064967 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.065321 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.066226 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.066553 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.066888 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.067202 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.067513 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.067832 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.068145 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.068455 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.068784 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.069100 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.069409 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.069737 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.070110 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.070667 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.071026 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.071352 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.071688 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.072019 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.072341 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.072659 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.072989 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.073301 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.073612 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.073933 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.074280 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.074592 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.074901 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.075225 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.075537 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.075846 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.076159 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.076469 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.076803 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.077115 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.077424 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.077734 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.078095 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.078389 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.078700 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.079008 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.079319 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.079635 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.079944 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.080258 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.080562 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.080876 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.081841 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.082191 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.082535 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.082877 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.083191 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.083507 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.083829 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.084142 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.084468 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.084788 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.085105 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.085464 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.085786 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.086421 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.086760 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.087086 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.087432 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.087767 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.088076 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.088387 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.088695 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.089022 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.089334 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.089653 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.089962 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.090304 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.090617 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.090928 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.091238 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.091551 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.091865 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.092178 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.092489 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.092807 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.093154 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.093472 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.093793 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.094181 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.094510 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.094834 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.095155 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.095478 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.095790 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.096104 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.096416 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.097292 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.097611 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.097950 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.098300 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.098610 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.099348 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.099673 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.099996 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.100319 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.100636 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.100964 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.101292 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.101610 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.101936 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.102282 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.102623 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.102970 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.103303 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.103633 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.103944 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.104254 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.104563 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.104874 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.105196 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.105510 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.105816 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.106150 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.106465 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.106771 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.107077 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.107382 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.107691 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.108002 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.108308 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.108614 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.108919 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.109223 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.109527 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.109831 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.110169 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.110477 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.110783 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.111088 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.111393 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.111695 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.112037 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.112405 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.112729 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.113053 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.113367 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.113690 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.114000 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.114354 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.114674 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.114994 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.115305 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.115643 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.115992 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.116270 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.116587 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.116902 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.117214 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.117528 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.117867 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.118227 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.118538 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.118869 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.119191 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.119520 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.119838 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.120150 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.120484 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.120796 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.121110 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.121425 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.121740 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.122089 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.122404 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.122726 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.123041 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.123365 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.123685 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.124017 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.124353 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.124667 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.124991 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.125320 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.125678 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.125999 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.126450 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.126786 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.127105 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.127438 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.127747 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:13:44.128024 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 21 16:13:44.196733 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO dbcounter [None req-1704bb6a-3f84-4e64-9b16-6e1f83da7d41 None None] Registered counter for database nova_api Sep 21 16:13:44.219854 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG oslo_db.sqlalchemy.engines [None req-1704bb6a-3f84-4e64-9b16-6e1f83da7d41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105501) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 16:13:44.227085 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writer thread running {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 16:13:44.282653 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO dbcounter [None req-a2bfe7f0-4bae-428e-a5fe-cfa5da8ca58c None None] Registered counter for database nova_api Sep 21 16:13:44.285707 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.context [None req-1704bb6a-3f84-4e64-9b16-6e1f83da7d41 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),02bd0416-446f-49db-ab6e-c32e12984242(cell1) {{(pid=105501) load_cells /opt/stack/nova/nova/context.py:464}} Sep 21 16:13:44.289624 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-1704bb6a-3f84-4e64-9b16-6e1f83da7d41 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:13:44.290119 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-1704bb6a-3f84-4e64-9b16-6e1f83da7d41 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:13:44.291697 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-1704bb6a-3f84-4e64-9b16-6e1f83da7d41 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:13:44.292422 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-1704bb6a-3f84-4e64-9b16-6e1f83da7d41 None None] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:13:44.292868 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-1704bb6a-3f84-4e64-9b16-6e1f83da7d41 None None] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:13:44.294889 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-1704bb6a-3f84-4e64-9b16-6e1f83da7d41 None None] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:13:44.296894 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO dbcounter [None req-1704bb6a-3f84-4e64-9b16-6e1f83da7d41 None None] Registered counter for database nova_cell0 Sep 21 16:13:44.301234 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO dbcounter [None req-1704bb6a-3f84-4e64-9b16-6e1f83da7d41 None None] Registered counter for database nova_cell1 Sep 21 16:13:44.303363 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG oslo_db.sqlalchemy.engines [None req-a2bfe7f0-4bae-428e-a5fe-cfa5da8ca58c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105500) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 16:13:44.310091 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG oslo_db.sqlalchemy.engines [None req-1704bb6a-3f84-4e64-9b16-6e1f83da7d41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105501) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 16:13:44.311649 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG oslo_db.sqlalchemy.engines [None req-1704bb6a-3f84-4e64-9b16-6e1f83da7d41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105501) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 16:13:44.312280 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG dbcounter [-] [105500] Writer thread running {{(pid=105500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 16:13:44.315268 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writer thread running {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 16:13:44.369786 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.context [None req-a2bfe7f0-4bae-428e-a5fe-cfa5da8ca58c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),02bd0416-446f-49db-ab6e-c32e12984242(cell1) {{(pid=105500) load_cells /opt/stack/nova/nova/context.py:464}} Sep 21 16:13:44.373677 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG oslo_concurrency.lockutils [None req-a2bfe7f0-4bae-428e-a5fe-cfa5da8ca58c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:13:44.374182 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG oslo_concurrency.lockutils [None req-a2bfe7f0-4bae-428e-a5fe-cfa5da8ca58c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:13:44.375741 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG oslo_concurrency.lockutils [None req-a2bfe7f0-4bae-428e-a5fe-cfa5da8ca58c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:13:44.376475 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG oslo_concurrency.lockutils [None req-a2bfe7f0-4bae-428e-a5fe-cfa5da8ca58c None None] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:13:44.376923 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG oslo_concurrency.lockutils [None req-a2bfe7f0-4bae-428e-a5fe-cfa5da8ca58c None None] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:13:44.379476 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG oslo_concurrency.lockutils [None req-a2bfe7f0-4bae-428e-a5fe-cfa5da8ca58c None None] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:13:44.381475 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO dbcounter [None req-a2bfe7f0-4bae-428e-a5fe-cfa5da8ca58c None None] Registered counter for database nova_cell0 Sep 21 16:13:44.385565 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO dbcounter [None req-a2bfe7f0-4bae-428e-a5fe-cfa5da8ca58c None None] Registered counter for database nova_cell1 Sep 21 16:13:44.394460 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG oslo_db.sqlalchemy.engines [None req-a2bfe7f0-4bae-428e-a5fe-cfa5da8ca58c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105500) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 16:13:44.396009 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG oslo_db.sqlalchemy.engines [None req-a2bfe7f0-4bae-428e-a5fe-cfa5da8ca58c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105500) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 16:13:44.404526 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG dbcounter [-] [105500] Writer thread running {{(pid=105500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 16:13:44.404869 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG dbcounter [-] [105500] Writer thread running {{(pid=105500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 16:13:44.457400 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writer thread running {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 16:13:44.468887 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO dbcounter [None req-1704bb6a-3f84-4e64-9b16-6e1f83da7d41 None None] Registered counter for database nova_cell0 Sep 21 16:13:44.480555 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG oslo_db.sqlalchemy.engines [None req-1704bb6a-3f84-4e64-9b16-6e1f83da7d41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105501) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 16:13:44.486311 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writer thread running {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 16:13:44.554858 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO dbcounter [None req-a2bfe7f0-4bae-428e-a5fe-cfa5da8ca58c None None] Registered counter for database nova_cell0 Sep 21 16:13:44.562882 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG oslo_db.sqlalchemy.engines [None req-a2bfe7f0-4bae-428e-a5fe-cfa5da8ca58c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105500) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 16:13:44.568718 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG dbcounter [-] [105500] Writer thread running {{(pid=105500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 16:13:44.838802 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: WARNING keystonemiddleware.auth_token [None req-1704bb6a-3f84-4e64-9b16-6e1f83da7d41 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 21 16:13:44.846035 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: WARNING keystonemiddleware.auth_token [None req-1704bb6a-3f84-4e64-9b16-6e1f83da7d41 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 21 16:13:44.893037 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: WARNING keystonemiddleware.auth_token [None req-a2bfe7f0-4bae-428e-a5fe-cfa5da8ca58c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 21 16:13:44.901164 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: WARNING keystonemiddleware.auth_token [None req-a2bfe7f0-4bae-428e-a5fe-cfa5da8ca58c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 21 16:13:45.189682 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: WARNING keystonemiddleware.auth_token [None req-1704bb6a-3f84-4e64-9b16-6e1f83da7d41 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 21 16:13:45.196350 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: WARNING keystonemiddleware.auth_token [None req-1704bb6a-3f84-4e64-9b16-6e1f83da7d41 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 21 16:13:45.201644 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5577d1e199c0 pid: 105501 (default app) Sep 21 16:13:45.203753 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-1704bb6a-3f84-4e64-9b16-6e1f83da7d41 None None] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:13:45.204942 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-1704bb6a-3f84-4e64-9b16-6e1f83da7d41 None None] 10.222.0.64 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001744 Sep 21 16:13:45.205357 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 788 bytes} [Wed Sep 21 16:13:45 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:13:45.241856 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: WARNING keystonemiddleware.auth_token [None req-a2bfe7f0-4bae-428e-a5fe-cfa5da8ca58c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 21 16:13:45.247906 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: WARNING keystonemiddleware.auth_token [None req-a2bfe7f0-4bae-428e-a5fe-cfa5da8ca58c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 21 16:13:45.253747 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5577d1e199c0 pid: 105500 (default app) Sep 21 16:15:13.560748 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-1704bb6a-3f84-4e64-9b16-6e1f83da7d41 None None] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:15:13.561993 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-1704bb6a-3f84-4e64-9b16-6e1f83da7d41 None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001927 Sep 21 16:15:13.562515 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 2/2] 10.222.0.64 () {54 vars in 931 bytes} [Wed Sep 21 16:15:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:15:13.580522 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG dbcounter [-] [105500] Writing DB stats nova_api:SELECT=3 {{(pid=105500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:13.581687 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG dbcounter [-] [105500] Writing DB stats nova_cell0:SELECT=3 {{(pid=105500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:13.582619 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG dbcounter [-] [105500] Writing DB stats nova_cell1:SELECT=3 {{(pid=105500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:13.583567 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG dbcounter [-] [105500] Writing DB stats nova_cell0:SELECT=3 {{(pid=105500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:14.839624 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-5df76d28-c7e1-4cda-ac62-b83d899cfaad admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:15:14.891096 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-5df76d28-c7e1-4cda-ac62-b83d899cfaad admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.316587 Sep 21 16:15:14.892066 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 1/3] 10.222.0.64 () {60 vars in 1292 bytes} [Wed Sep 21 16:15:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:15:17.958157 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-1704bb6a-3f84-4e64-9b16-6e1f83da7d41 None None] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:15:17.959666 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-1704bb6a-3f84-4e64-9b16-6e1f83da7d41 None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003985 Sep 21 16:15:17.961450 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 3/4] 10.222.0.64 () {54 vars in 931 bytes} [Wed Sep 21 16:15:17 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:15:18.464190 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-ed9f4742-b895-4d09-a7d3-43c0f4e2ef64 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "id": "c1", "disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256}} {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:15:18.520150 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-ed9f4742-b895-4d09-a7d3-43c0f4e2ef64 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.551723 Sep 21 16:15:18.522156 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 2/5] 10.222.0.64 () {64 vars in 1283 bytes} [Wed Sep 21 16:15:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 16:15:18.753842 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-dc9e661f-6d8a-4be9-8752-4140341f67ef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:15:18.762757 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writing DB stats nova_api:SELECT=3 {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:18.762757 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writing DB stats nova_cell1:SELECT=3 {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:18.762757 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writing DB stats nova_cell0:SELECT=3 {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:18.763293 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:18.831691 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-dc9e661f-6d8a-4be9-8752-4140341f67ef admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.300049 Sep 21 16:15:18.832293 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 4/6] 10.222.0.64 () {64 vars in 1336 bytes} [Wed Sep 21 16:15:18 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:15:21.875335 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-ed9f4742-b895-4d09-a7d3-43c0f4e2ef64 admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:15:21.877105 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-ed9f4742-b895-4d09-a7d3-43c0f4e2ef64 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002504 Sep 21 16:15:21.878297 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 3/7] 10.222.0.64 () {54 vars in 931 bytes} [Wed Sep 21 16:15:21 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:15:22.939340 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-dc39be6d-9a9b-4ad3-a966-d1e18f993746 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "ram": 512, "id": "d1", "name": "ds512M", "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:15:22.991726 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-dc39be6d-9a9b-4ad3-a966-d1e18f993746 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.102774 Sep 21 16:15:22.992754 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 5/8] 10.222.0.64 () {64 vars in 1283 bytes} [Wed Sep 21 16:15:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 16:15:23.009607 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-3c839081-7ee9-4450-938e-0daa8f464a40 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:15:23.074683 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-3c839081-7ee9-4450-938e-0daa8f464a40 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.070468 Sep 21 16:15:23.075797 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 4/9] 10.222.0.64 () {64 vars in 1336 bytes} [Wed Sep 21 16:15:23 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:15:25.927383 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-dc39be6d-9a9b-4ad3-a966-d1e18f993746 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:15:25.928421 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-dc39be6d-9a9b-4ad3-a966-d1e18f993746 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Sep 21 16:15:25.928835 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 6/10] 10.222.0.64 () {54 vars in 931 bytes} [Wed Sep 21 16:15:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:15:26.468714 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-9f7396a3-c1ea-4245-8cc6-b94657ae3d03 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "vcpus": 1, "swap": 0, "id": "d2", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 1024, "rxtx_factor": 1.0}} {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:15:26.495193 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-9f7396a3-c1ea-4245-8cc6-b94657ae3d03 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.557956 Sep 21 16:15:26.496966 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 5/11] 10.222.0.64 () {64 vars in 1283 bytes} [Wed Sep 21 16:15:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 16:15:26.509123 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-b20184f1-78fa-4059-821d-adb2e661ed23 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:15:26.544203 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-b20184f1-78fa-4059-821d-adb2e661ed23 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039284 Sep 21 16:15:26.545047 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 7/12] 10.222.0.64 () {64 vars in 1336 bytes} [Wed Sep 21 16:15:26 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:15:29.363652 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-9f7396a3-c1ea-4245-8cc6-b94657ae3d03 admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:15:29.364803 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-9f7396a3-c1ea-4245-8cc6-b94657ae3d03 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001674 Sep 21 16:15:29.365318 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 6/13] 10.222.0.64 () {54 vars in 931 bytes} [Wed Sep 21 16:15:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:15:30.113631 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-06b27e7f-f556-4cdd-be3e-55bc272daca7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "disk": 10, "ram": 2048, "vcpus": 2, "id": "d3", "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:15:30.134408 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-06b27e7f-f556-4cdd-be3e-55bc272daca7 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.761605 Sep 21 16:15:30.135914 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 8/14] 10.222.0.64 () {64 vars in 1283 bytes} [Wed Sep 21 16:15:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 16:15:30.150685 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-f30bfd85-0378-453f-ac65-8ad8c546f688 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:15:30.184650 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-f30bfd85-0378-453f-ac65-8ad8c546f688 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038191 Sep 21 16:15:30.185348 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 7/15] 10.222.0.64 () {64 vars in 1336 bytes} [Wed Sep 21 16:15:30 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:15:33.276943 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-06b27e7f-f556-4cdd-be3e-55bc272daca7 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:15:33.278362 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-06b27e7f-f556-4cdd-be3e-55bc272daca7 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001993 Sep 21 16:15:33.278780 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 9/16] 10.222.0.64 () {54 vars in 931 bytes} [Wed Sep 21 16:15:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:15:33.843305 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-052e5530-e552-43fb-96f2-625f0d64a8bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "name": "ds4G", "rxtx_factor": 1.0, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:15:33.877530 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-052e5530-e552-43fb-96f2-625f0d64a8bb admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.590853 Sep 21 16:15:33.878611 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 8/17] 10.222.0.64 () {64 vars in 1283 bytes} [Wed Sep 21 16:15:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 16:15:33.897167 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-40a034bf-6b04-4485-bf8d-23c1215f0d1a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:15:33.927497 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-40a034bf-6b04-4485-bf8d-23c1215f0d1a admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033945 Sep 21 16:15:33.928009 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 10/18] 10.222.0.64 () {64 vars in 1336 bytes} [Wed Sep 21 16:15:33 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:15:36.724271 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-052e5530-e552-43fb-96f2-625f0d64a8bb admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:15:36.725281 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-052e5530-e552-43fb-96f2-625f0d64a8bb admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 21 16:15:36.725752 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 9/19] 10.222.0.64 () {54 vars in 931 bytes} [Wed Sep 21 16:15:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:15:37.279478 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-30363b48-9d01-4196-9fa7-0cb4f943a78f admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:15:37.308244 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-30363b48-9d01-4196-9fa7-0cb4f943a78f admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.575892 Sep 21 16:15:37.308806 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 11/20] 10.222.0.64 () {60 vars in 1292 bytes} [Wed Sep 21 16:15:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:15:40.154984 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-052e5530-e552-43fb-96f2-625f0d64a8bb admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:15:40.156116 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-052e5530-e552-43fb-96f2-625f0d64a8bb admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002872 Sep 21 16:15:40.156625 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 10/21] 10.222.0.64 () {54 vars in 931 bytes} [Wed Sep 21 16:15:40 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:15:40.742367 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-5426546f-e3e8-42e7-9c3f-ce4084c51ec3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "ram": 512, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "name": "m1.tiny"}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:15:40.769012 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-5426546f-e3e8-42e7-9c3f-ce4084c51ec3 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.605509 Sep 21 16:15:40.769616 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 12/22] 10.222.0.64 () {64 vars in 1283 bytes} [Wed Sep 21 16:15:40 2022] POST /compute/v2.1/flavors => generated 402 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 16:15:40.785749 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-051f5cb3-c7fc-4406-bba2-92aeed5f713a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:15:40.823094 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-051f5cb3-c7fc-4406-bba2-92aeed5f713a admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042002 Sep 21 16:15:40.823810 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 11/23] 10.222.0.64 () {64 vars in 1333 bytes} [Wed Sep 21 16:15:40 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:15:43.561533 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-5426546f-e3e8-42e7-9c3f-ce4084c51ec3 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:15:43.562658 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-5426546f-e3e8-42e7-9c3f-ce4084c51ec3 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Sep 21 16:15:43.563076 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 13/24] 10.222.0.64 () {54 vars in 931 bytes} [Wed Sep 21 16:15:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:15:43.980093 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-b44b07df-a4c9-4e73-aa16-5430c5820f45 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "name": "m1.small", "disk": 20, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "id": "2"}} {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:15:43.986284 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG dbcounter [-] [105500] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:44.002488 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-b44b07df-a4c9-4e73-aa16-5430c5820f45 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.432684 Sep 21 16:15:44.003065 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 12/25] 10.222.0.64 () {64 vars in 1283 bytes} [Wed Sep 21 16:15:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 16:15:44.015768 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-f7fec0d7-e260-4412-aba5-ecee124d41ef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:15:44.043831 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-f7fec0d7-e260-4412-aba5-ecee124d41ef admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031944 Sep 21 16:15:44.044440 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 14/26] 10.222.0.64 () {64 vars in 1333 bytes} [Wed Sep 21 16:15:44 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:15:46.819764 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-b44b07df-a4c9-4e73-aa16-5430c5820f45 admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:15:46.827749 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-b44b07df-a4c9-4e73-aa16-5430c5820f45 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.008187 Sep 21 16:15:46.829139 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 13/27] 10.222.0.64 () {54 vars in 931 bytes} [Wed Sep 21 16:15:46 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:15:47.454471 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-e6ce9680-d722-4eb3-9604-7d7d163bc0ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "3", "os-flavor-access:is_public": true, "swap": 0, "ram": 4096, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "name": "m1.medium"}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:15:47.481900 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-e6ce9680-d722-4eb3-9604-7d7d163bc0ee admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.639635 Sep 21 16:15:47.482510 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 15/28] 10.222.0.64 () {64 vars in 1283 bytes} [Wed Sep 21 16:15:46 2022] POST /compute/v2.1/flavors => generated 406 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 16:15:47.495989 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-12d58b31-5bba-44c9-9df5-d374d189a198 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:15:47.523505 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-12d58b31-5bba-44c9-9df5-d374d189a198 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031380 Sep 21 16:15:47.524259 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 14/29] 10.222.0.64 () {64 vars in 1333 bytes} [Wed Sep 21 16:15:47 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:15:50.527190 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-e6ce9680-d722-4eb3-9604-7d7d163bc0ee admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:15:50.529357 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-e6ce9680-d722-4eb3-9604-7d7d163bc0ee admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002578 Sep 21 16:15:50.530523 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 16/30] 10.222.0.64 () {54 vars in 931 bytes} [Wed Sep 21 16:15:50 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:15:51.263910 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-9e8391d5-add7-4d4d-b999-6d8ad4e68900 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "ram": 8192, "disk": 80, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 4, "rxtx_factor": 1.0, "id": "4"}} {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:15:51.286202 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-9e8391d5-add7-4d4d-b999-6d8ad4e68900 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.748308 Sep 21 16:15:51.286938 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 15/31] 10.222.0.64 () {64 vars in 1283 bytes} [Wed Sep 21 16:15:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 16:15:51.300629 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-7697313c-faa4-4541-b9c2-3b794979b813 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:15:51.310194 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:15:51.337661 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-7697313c-faa4-4541-b9c2-3b794979b813 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040998 Sep 21 16:15:51.350303 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 17/32] 10.222.0.64 () {64 vars in 1333 bytes} [Wed Sep 21 16:15:51 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:15:54.286152 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-9e8391d5-add7-4d4d-b999-6d8ad4e68900 admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:15:54.288078 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-9e8391d5-add7-4d4d-b999-6d8ad4e68900 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002333 Sep 21 16:15:54.294562 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 16/33] 10.222.0.64 () {54 vars in 931 bytes} [Wed Sep 21 16:15:54 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:15:54.921492 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-672d5d12-10ab-425a-afb6-01ecaee2bc18 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "ram": 16384, "vcpus": 8, "name": "m1.xlarge", "disk": 160, "os-flavor-access:is_public": true}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:15:54.950382 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-672d5d12-10ab-425a-afb6-01ecaee2bc18 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.653650 Sep 21 16:15:54.950942 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 18/34] 10.222.0.64 () {64 vars in 1283 bytes} [Wed Sep 21 16:15:54 2022] POST /compute/v2.1/flavors => generated 408 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 21 16:15:54.964247 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-9682b9cd-18bb-4c87-86e9-18728b29f464 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:15:55.006119 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-9682b9cd-18bb-4c87-86e9-18728b29f464 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046667 Sep 21 16:15:55.022098 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 17/35] 10.222.0.64 () {64 vars in 1333 bytes} [Wed Sep 21 16:15:54 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:16:12.706309 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-672d5d12-10ab-425a-afb6-01ecaee2bc18 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:16:12.707324 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-672d5d12-10ab-425a-afb6-01ecaee2bc18 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Sep 21 16:16:12.707731 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 19/36] 10.222.0.64 () {54 vars in 931 bytes} [Wed Sep 21 16:16:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:16:12.719535 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG dbcounter [-] [105500] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=105500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:13.124897 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-13d8b011-32ba-4120-b4bd-6934f0c9a21a admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:16:13.146371 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-13d8b011-32ba-4120-b4bd-6934f0c9a21a admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.431368 Sep 21 16:16:13.146910 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 18/37] 10.222.0.64 () {60 vars in 1292 bytes} [Wed Sep 21 16:16:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:16:14.462731 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-672d5d12-10ab-425a-afb6-01ecaee2bc18 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:16:14.463742 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-672d5d12-10ab-425a-afb6-01ecaee2bc18 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Sep 21 16:16:14.464142 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 20/38] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Sep 21 16:16:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:16:15.011684 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-57214bf8-5d58-4391-bb09-99e0bb3ec577 admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:16:15.016997 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.wsgi [None req-57214bf8-5d58-4391-bb09-99e0bb3ec577 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 21 16:16:15.020278 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-57214bf8-5d58-4391-bb09-99e0bb3ec577 admin admin] Request method failure captured: Sep 21 16:16:15.020278 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 21 16:16:15.020278 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: Accept: application/json Sep 21 16:16:15.020278 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: Accept-Encoding: gzip, deflate Sep 21 16:16:15.020278 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: Connection: keep-alive Sep 21 16:16:15.020278 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: Content-Length: 0 Sep 21 16:16:15.020278 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: Host: 10.222.0.64 Sep 21 16:16:15.020278 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: Openstack-Api-Version: compute 2.92 Sep 21 16:16:15.020278 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: Openstack-System-Scope: None Sep 21 16:16:15.020278 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: User-Agent: python-novaclient Sep 21 16:16:15.020278 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Auth-Token: gAAAAABjKzjOJHn1RBVmrtdFcFaEXtKRf23TvKNxZKx5nU1a1spl29bejn90BfNSROJKYo4g_-U9pn7PpC4W4KyHWzNY0SDQKKVlxsOd_h2pGbdAq2bddF7EX0Xp20HRiGZXIeOODizjDcKMW9YJh_9oYovuyOpRkQ9Zz1H7RESQN_oMSBp3ll8 Sep 21 16:16:15.020278 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Domain-Id: None Sep 21 16:16:15.020278 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Domain-Name: None Sep 21 16:16:15.020278 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Identity-Status: Confirmed Sep 21 16:16:15.020278 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Is-Admin-Project: True Sep 21 16:16:15.020278 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Openstack-Nova-Api-Version: 2.92 Sep 21 16:16:15.020278 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Project-Domain-Id: default Sep 21 16:16:15.020278 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Project-Domain-Name: Default Sep 21 16:16:15.020278 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Project-Id: 92877a675fac490b8473d8157aef4217 Sep 21 16:16:15.020278 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Project-Name: admin Sep 21 16:16:15.020278 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Role: member,reader,admin Sep 21 16:16:15.020278 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Roles: member,reader,admin Sep 21 16:16:15.021930 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/92877a675fac490b8473d8157aef4217"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/92877a675fac490b8473d8157aef4217"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_92877a675fac490b8473d8157aef4217"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/92877a675fac490b8473d8157aef4217"}]}] Sep 21 16:16:15.021930 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Tenant: admin Sep 21 16:16:15.021930 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Tenant-Id: 92877a675fac490b8473d8157aef4217 Sep 21 16:16:15.021930 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Tenant-Name: admin Sep 21 16:16:15.021930 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-User: admin Sep 21 16:16:15.021930 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-User-Domain-Id: default Sep 21 16:16:15.021930 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-User-Domain-Name: Default Sep 21 16:16:15.021930 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-User-Id: b9a31b5d481f471a90714fa648bfed35 Sep 21 16:16:15.021930 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-User-Name: admin Sep 21 16:16:15.021930 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: method: > Sep 21 16:16:15.021930 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: exception: Flavor 42 could not be found. Sep 21 16:16:15.021930 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: action_args: {'id': '42'} Sep 21 16:16:15.021930 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:16:15.021930 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:16:15.022966 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 21 16:16:15.022966 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 21 16:16:15.022966 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 21 16:16:15.022966 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 21 16:16:15.022966 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 21 16:16:15.022966 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 21 16:16:15.022966 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 21 16:16:15.022966 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 21 16:16:15.022966 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 21 16:16:15.022966 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:16:15.022966 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 21 16:16:15.022966 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 21 16:16:15.022966 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 21 16:16:15.022966 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Sep 21 16:16:15.022966 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:16:15.022966 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Sep 21 16:16:15.022966 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:16:15.022966 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:16:15.022966 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:16:15.024092 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:16:15.024092 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:16:15.024092 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:16:15.024092 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:16:15.024092 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 21 16:16:15.024092 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:16:15.024092 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 21 16:16:15.024092 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Sep 21 16:16:15.024092 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:16:15.024092 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Sep 21 16:16:15.024092 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:16:15.024092 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:16:15.024092 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:16:15.024092 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:16:15.024092 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:16:15.024092 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 21 16:16:15.024092 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Sep 21 16:16:15.024092 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-57214bf8-5d58-4391-bb09-99e0bb3ec577 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:16:15.025112 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-57214bf8-5d58-4391-bb09-99e0bb3ec577 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.419542 Sep 21 16:16:15.025112 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 19/39] 10.222.0.64 () {60 vars in 1190 bytes} [Wed Sep 21 16:16:14 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 421 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 21 16:16:15.031759 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-ec97d38e-169b-4af3-a9bc-022f7a7005fe admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:16:15.035926 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:16:15.058263 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-ec97d38e-169b-4af3-a9bc-022f7a7005fe admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.030003 Sep 21 16:16:15.058775 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 21/40] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Sep 21 16:16:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:16:15.070025 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-a5f5e139-8468-44d2-a256-98b26ebe78af admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:16:15.092642 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-a5f5e139-8468-44d2-a256-98b26ebe78af admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027364 Sep 21 16:16:15.094549 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 20/41] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Sep 21 16:16:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:16:15.104554 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-578ce270-fe28-45db-b9cc-91dafc7af727 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:16:15.110611 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.wsgi [None req-578ce270-fe28-45db-b9cc-91dafc7af727 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 21 16:16:15.113907 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-578ce270-fe28-45db-b9cc-91dafc7af727 admin admin] Request method failure captured: Sep 21 16:16:15.113907 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 21 16:16:15.113907 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: Accept: application/json Sep 21 16:16:15.113907 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: Accept-Encoding: gzip, deflate Sep 21 16:16:15.113907 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: Connection: keep-alive Sep 21 16:16:15.113907 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: Content-Length: 0 Sep 21 16:16:15.113907 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: Host: 10.222.0.64 Sep 21 16:16:15.113907 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: Openstack-Api-Version: compute 2.92 Sep 21 16:16:15.113907 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: Openstack-System-Scope: None Sep 21 16:16:15.113907 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: User-Agent: python-novaclient Sep 21 16:16:15.113907 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Auth-Token: gAAAAABjKzjOJHn1RBVmrtdFcFaEXtKRf23TvKNxZKx5nU1a1spl29bejn90BfNSROJKYo4g_-U9pn7PpC4W4KyHWzNY0SDQKKVlxsOd_h2pGbdAq2bddF7EX0Xp20HRiGZXIeOODizjDcKMW9YJh_9oYovuyOpRkQ9Zz1H7RESQN_oMSBp3ll8 Sep 21 16:16:15.113907 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Domain-Id: None Sep 21 16:16:15.113907 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Domain-Name: None Sep 21 16:16:15.113907 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Identity-Status: Confirmed Sep 21 16:16:15.113907 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Is-Admin-Project: True Sep 21 16:16:15.113907 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Openstack-Nova-Api-Version: 2.92 Sep 21 16:16:15.113907 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Project-Domain-Id: default Sep 21 16:16:15.113907 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Project-Domain-Name: Default Sep 21 16:16:15.113907 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Project-Id: 92877a675fac490b8473d8157aef4217 Sep 21 16:16:15.113907 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Project-Name: admin Sep 21 16:16:15.113907 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Role: member,reader,admin Sep 21 16:16:15.113907 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Roles: member,reader,admin Sep 21 16:16:15.115479 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/92877a675fac490b8473d8157aef4217"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/92877a675fac490b8473d8157aef4217"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_92877a675fac490b8473d8157aef4217"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/92877a675fac490b8473d8157aef4217"}]}] Sep 21 16:16:15.115479 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Tenant: admin Sep 21 16:16:15.115479 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Tenant-Id: 92877a675fac490b8473d8157aef4217 Sep 21 16:16:15.115479 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Tenant-Name: admin Sep 21 16:16:15.115479 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-User: admin Sep 21 16:16:15.115479 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-User-Domain-Id: default Sep 21 16:16:15.115479 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-User-Domain-Name: Default Sep 21 16:16:15.115479 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-User-Id: b9a31b5d481f471a90714fa648bfed35 Sep 21 16:16:15.115479 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-User-Name: admin Sep 21 16:16:15.115479 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: method: > Sep 21 16:16:15.115479 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: exception: Flavor 42 could not be found. Sep 21 16:16:15.115479 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: action_args: {'id': '42'} Sep 21 16:16:15.115479 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:16:15.115479 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:16:15.116991 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 21 16:16:15.116991 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 21 16:16:15.116991 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 21 16:16:15.116991 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 21 16:16:15.116991 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 21 16:16:15.116991 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 21 16:16:15.116991 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 21 16:16:15.116991 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 21 16:16:15.116991 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 21 16:16:15.116991 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:16:15.116991 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 21 16:16:15.116991 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 21 16:16:15.116991 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 21 16:16:15.116991 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 21 16:16:15.116991 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:16:15.116991 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 21 16:16:15.116991 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:16:15.116991 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:16:15.116991 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:16:15.118443 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:16:15.118443 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:16:15.118443 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:16:15.118443 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:16:15.118443 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 21 16:16:15.118443 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:16:15.118443 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 21 16:16:15.118443 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 21 16:16:15.118443 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:16:15.118443 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 21 16:16:15.118443 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:16:15.118443 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:16:15.118443 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:16:15.118443 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:16:15.118443 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:16:15.118443 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 21 16:16:15.118443 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 21 16:16:15.118443 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-578ce270-fe28-45db-b9cc-91dafc7af727 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:16:15.119671 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-578ce270-fe28-45db-b9cc-91dafc7af727 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014921 Sep 21 16:16:15.119671 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 22/42] 10.222.0.64 () {60 vars in 1190 bytes} [Wed Sep 21 16:16:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 21 16:16:16.357692 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-a5f5e139-8468-44d2-a256-98b26ebe78af admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:16:16.358734 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-a5f5e139-8468-44d2-a256-98b26ebe78af admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Sep 21 16:16:16.359134 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 21/43] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Sep 21 16:16:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:16:16.892850 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-2c49fa3d-9308-4d9f-9ee5-0c32d7ab93b9 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:16:16.898404 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.wsgi [None req-2c49fa3d-9308-4d9f-9ee5-0c32d7ab93b9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 21 16:16:16.899930 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-2c49fa3d-9308-4d9f-9ee5-0c32d7ab93b9 admin admin] Request method failure captured: Sep 21 16:16:16.899930 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 21 16:16:16.899930 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: Accept: application/json Sep 21 16:16:16.899930 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: Accept-Encoding: gzip, deflate Sep 21 16:16:16.899930 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: Connection: keep-alive Sep 21 16:16:16.899930 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: Content-Length: 0 Sep 21 16:16:16.899930 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: Host: 10.222.0.64 Sep 21 16:16:16.899930 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: Openstack-Api-Version: compute 2.92 Sep 21 16:16:16.899930 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: Openstack-System-Scope: None Sep 21 16:16:16.899930 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: User-Agent: python-novaclient Sep 21 16:16:16.899930 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Auth-Token: gAAAAABjKzjQIYI4ljMuB0Tj8_jsv_LY6Z8p7ITUmtB66AMSm0DaFx9yKU2qhtzDPCNxCXNTx353lUhbcR12818G0tt5dnDKzPxS7EL575k4VKT4AdmV9ky1IoX8oyLNte2TPK6dbMjZTnmpLzYv02iljIm_fFfC7vkaS_cm1WgH58vDYuu4a5o Sep 21 16:16:16.899930 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Domain-Id: None Sep 21 16:16:16.899930 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Domain-Name: None Sep 21 16:16:16.899930 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Identity-Status: Confirmed Sep 21 16:16:16.899930 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Is-Admin-Project: True Sep 21 16:16:16.899930 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Openstack-Nova-Api-Version: 2.92 Sep 21 16:16:16.899930 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Project-Domain-Id: default Sep 21 16:16:16.899930 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Project-Domain-Name: Default Sep 21 16:16:16.899930 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Project-Id: 92877a675fac490b8473d8157aef4217 Sep 21 16:16:16.899930 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Project-Name: admin Sep 21 16:16:16.899930 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Role: member,reader,admin Sep 21 16:16:16.899930 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Roles: member,reader,admin Sep 21 16:16:16.901570 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/92877a675fac490b8473d8157aef4217"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/92877a675fac490b8473d8157aef4217"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_92877a675fac490b8473d8157aef4217"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/92877a675fac490b8473d8157aef4217"}]}] Sep 21 16:16:16.901570 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Tenant: admin Sep 21 16:16:16.901570 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Tenant-Id: 92877a675fac490b8473d8157aef4217 Sep 21 16:16:16.901570 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Tenant-Name: admin Sep 21 16:16:16.901570 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-User: admin Sep 21 16:16:16.901570 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-User-Domain-Id: default Sep 21 16:16:16.901570 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-User-Domain-Name: Default Sep 21 16:16:16.901570 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-User-Id: b9a31b5d481f471a90714fa648bfed35 Sep 21 16:16:16.901570 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-User-Name: admin Sep 21 16:16:16.901570 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: method: > Sep 21 16:16:16.901570 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: exception: Flavor 84 could not be found. Sep 21 16:16:16.901570 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: action_args: {'id': '84'} Sep 21 16:16:16.901570 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:16:16.901570 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:16:16.902513 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 21 16:16:16.902513 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 21 16:16:16.902513 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 21 16:16:16.902513 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 21 16:16:16.902513 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 21 16:16:16.902513 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 21 16:16:16.902513 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 21 16:16:16.902513 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 21 16:16:16.902513 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 21 16:16:16.902513 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:16:16.902513 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 21 16:16:16.902513 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 21 16:16:16.902513 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 21 16:16:16.902513 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 21 16:16:16.902513 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:16:16.902513 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 21 16:16:16.902513 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:16:16.902513 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:16:16.902513 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:16:16.904006 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:16:16.904006 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:16:16.904006 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:16:16.904006 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:16:16.904006 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 21 16:16:16.904006 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:16:16.904006 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 21 16:16:16.904006 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 21 16:16:16.904006 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:16:16.904006 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 21 16:16:16.904006 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:16:16.904006 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:16:16.904006 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:16:16.904006 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:16:16.904006 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:16:16.904006 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 21 16:16:16.904006 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 21 16:16:16.904006 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-2c49fa3d-9308-4d9f-9ee5-0c32d7ab93b9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:16:16.905316 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-2c49fa3d-9308-4d9f-9ee5-0c32d7ab93b9 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.404676 Sep 21 16:16:16.905316 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 23/44] 10.222.0.64 () {60 vars in 1190 bytes} [Wed Sep 21 16:16:16 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 21 16:16:16.916786 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-74126c94-139d-4e24-9c2f-a2270042f326 admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:16:16.932182 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-74126c94-139d-4e24-9c2f-a2270042f326 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019706 Sep 21 16:16:16.932744 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 22/45] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Sep 21 16:16:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:16:16.942962 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-3f2bf9ad-a558-416e-b289-467ea268af4b admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:16:16.958813 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-3f2bf9ad-a558-416e-b289-467ea268af4b admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019505 Sep 21 16:16:16.959375 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 24/46] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Sep 21 16:16:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:16:16.969536 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-fddaac00-0941-4aef-bc12-098a4c3d01ed admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:16:16.974661 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.wsgi [None req-fddaac00-0941-4aef-bc12-098a4c3d01ed admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 21 16:16:16.977728 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-fddaac00-0941-4aef-bc12-098a4c3d01ed admin admin] Request method failure captured: Sep 21 16:16:16.977728 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 21 16:16:16.977728 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: Accept: application/json Sep 21 16:16:16.977728 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: Accept-Encoding: gzip, deflate Sep 21 16:16:16.977728 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: Connection: keep-alive Sep 21 16:16:16.977728 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: Content-Length: 0 Sep 21 16:16:16.977728 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: Host: 10.222.0.64 Sep 21 16:16:16.977728 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: Openstack-Api-Version: compute 2.92 Sep 21 16:16:16.977728 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: Openstack-System-Scope: None Sep 21 16:16:16.977728 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: User-Agent: python-novaclient Sep 21 16:16:16.977728 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Auth-Token: gAAAAABjKzjQIYI4ljMuB0Tj8_jsv_LY6Z8p7ITUmtB66AMSm0DaFx9yKU2qhtzDPCNxCXNTx353lUhbcR12818G0tt5dnDKzPxS7EL575k4VKT4AdmV9ky1IoX8oyLNte2TPK6dbMjZTnmpLzYv02iljIm_fFfC7vkaS_cm1WgH58vDYuu4a5o Sep 21 16:16:16.977728 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Domain-Id: None Sep 21 16:16:16.977728 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Domain-Name: None Sep 21 16:16:16.977728 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Identity-Status: Confirmed Sep 21 16:16:16.977728 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Is-Admin-Project: True Sep 21 16:16:16.977728 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Openstack-Nova-Api-Version: 2.92 Sep 21 16:16:16.977728 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Project-Domain-Id: default Sep 21 16:16:16.977728 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Project-Domain-Name: Default Sep 21 16:16:16.977728 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Project-Id: 92877a675fac490b8473d8157aef4217 Sep 21 16:16:16.977728 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Project-Name: admin Sep 21 16:16:16.977728 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Role: member,reader,admin Sep 21 16:16:16.977728 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Roles: member,reader,admin Sep 21 16:16:16.980076 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/92877a675fac490b8473d8157aef4217"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/92877a675fac490b8473d8157aef4217"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_92877a675fac490b8473d8157aef4217"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/92877a675fac490b8473d8157aef4217"}]}] Sep 21 16:16:16.980076 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Tenant: admin Sep 21 16:16:16.980076 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Tenant-Id: 92877a675fac490b8473d8157aef4217 Sep 21 16:16:16.980076 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Tenant-Name: admin Sep 21 16:16:16.980076 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-User: admin Sep 21 16:16:16.980076 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-User-Domain-Id: default Sep 21 16:16:16.980076 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-User-Domain-Name: Default Sep 21 16:16:16.980076 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-User-Id: b9a31b5d481f471a90714fa648bfed35 Sep 21 16:16:16.980076 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-User-Name: admin Sep 21 16:16:16.980076 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: method: > Sep 21 16:16:16.980076 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: exception: Flavor 84 could not be found. Sep 21 16:16:16.980076 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: action_args: {'id': '84'} Sep 21 16:16:16.980076 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:16:16.980076 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:16:16.981143 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 21 16:16:16.981143 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 21 16:16:16.981143 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 21 16:16:16.981143 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 21 16:16:16.981143 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 21 16:16:16.981143 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 21 16:16:16.981143 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 21 16:16:16.981143 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 21 16:16:16.981143 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 21 16:16:16.981143 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:16:16.981143 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 21 16:16:16.981143 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 21 16:16:16.981143 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 21 16:16:16.981143 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Sep 21 16:16:16.981143 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:16:16.981143 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Sep 21 16:16:16.981143 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:16:16.981143 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:16:16.981143 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:16:16.982478 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:16:16.982478 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:16:16.982478 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:16:16.982478 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:16:16.982478 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 21 16:16:16.982478 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:16:16.982478 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 21 16:16:16.982478 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Sep 21 16:16:16.982478 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:16:16.982478 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Sep 21 16:16:16.982478 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:16:16.982478 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:16:16.982478 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:16:16.982478 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:16:16.982478 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:16:16.982478 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 21 16:16:16.982478 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Sep 21 16:16:16.982478 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-fddaac00-0941-4aef-bc12-098a4c3d01ed admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:16:16.983782 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-fddaac00-0941-4aef-bc12-098a4c3d01ed admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012746 Sep 21 16:16:16.983782 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 23/47] 10.222.0.64 () {60 vars in 1190 bytes} [Wed Sep 21 16:16:16 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 21 16:16:18.229819 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-3f2bf9ad-a558-416e-b289-467ea268af4b admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:16:18.230918 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-3f2bf9ad-a558-416e-b289-467ea268af4b admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Sep 21 16:16:18.231319 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 25/48] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Sep 21 16:16:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:16:18.766651 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-4122c56a-a70f-4b4e-a872-a67404f135f0 admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:16:18.772641 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.wsgi [None req-4122c56a-a70f-4b4e-a872-a67404f135f0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 21 16:16:18.774190 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-4122c56a-a70f-4b4e-a872-a67404f135f0 admin admin] Request method failure captured: Sep 21 16:16:18.774190 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 21 16:16:18.774190 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: Accept: application/json Sep 21 16:16:18.774190 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: Accept-Encoding: gzip, deflate Sep 21 16:16:18.774190 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: Connection: keep-alive Sep 21 16:16:18.774190 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: Content-Length: 0 Sep 21 16:16:18.774190 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: Host: 10.222.0.64 Sep 21 16:16:18.774190 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: Openstack-Api-Version: compute 2.92 Sep 21 16:16:18.774190 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: Openstack-System-Scope: None Sep 21 16:16:18.774190 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: User-Agent: python-novaclient Sep 21 16:16:18.774190 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Auth-Token: gAAAAABjKzjSgk8M555AyoAQb7elID1UCDW-ia-IBpYdMLdtnU2HDkwMBzJmzGGI0_1v9RC7hkhX-_1TOwE7g2qyASpsOT7hupx2oboyDqUPOTbD_K2e991L7MBkmIiie5Rz7eWNEL88pan4Sf0_B6cJWmR5P6CIJokKrpbnl1wFHx0ebY19ZPM Sep 21 16:16:18.774190 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Domain-Id: None Sep 21 16:16:18.774190 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Domain-Name: None Sep 21 16:16:18.774190 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Identity-Status: Confirmed Sep 21 16:16:18.774190 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Is-Admin-Project: True Sep 21 16:16:18.774190 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Openstack-Nova-Api-Version: 2.92 Sep 21 16:16:18.774190 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Project-Domain-Id: default Sep 21 16:16:18.774190 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Project-Domain-Name: Default Sep 21 16:16:18.774190 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Project-Id: 92877a675fac490b8473d8157aef4217 Sep 21 16:16:18.774190 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Project-Name: admin Sep 21 16:16:18.774190 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Role: member,reader,admin Sep 21 16:16:18.774190 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Roles: member,reader,admin Sep 21 16:16:18.775801 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/92877a675fac490b8473d8157aef4217"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/92877a675fac490b8473d8157aef4217"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_92877a675fac490b8473d8157aef4217"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/92877a675fac490b8473d8157aef4217"}]}] Sep 21 16:16:18.775801 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Tenant: admin Sep 21 16:16:18.775801 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Tenant-Id: 92877a675fac490b8473d8157aef4217 Sep 21 16:16:18.775801 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-Tenant-Name: admin Sep 21 16:16:18.775801 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-User: admin Sep 21 16:16:18.775801 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-User-Domain-Id: default Sep 21 16:16:18.775801 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-User-Domain-Name: Default Sep 21 16:16:18.775801 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-User-Id: b9a31b5d481f471a90714fa648bfed35 Sep 21 16:16:18.775801 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: X-User-Name: admin Sep 21 16:16:18.775801 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: method: > Sep 21 16:16:18.775801 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: exception: Flavor 451 could not be found. Sep 21 16:16:18.775801 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: action_args: {'id': '451'} Sep 21 16:16:18.775801 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:16:18.775801 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:16:18.776680 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 21 16:16:18.776680 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 21 16:16:18.776680 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 21 16:16:18.776680 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 21 16:16:18.776680 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 21 16:16:18.776680 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 21 16:16:18.776680 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 21 16:16:18.776680 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 21 16:16:18.776680 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 21 16:16:18.776680 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:16:18.776680 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 21 16:16:18.776680 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 21 16:16:18.776680 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 21 16:16:18.776680 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Sep 21 16:16:18.776680 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:16:18.776680 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Sep 21 16:16:18.776680 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:16:18.776680 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:16:18.776680 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:16:18.778351 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:16:18.778351 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:16:18.778351 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:16:18.778351 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:16:18.778351 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 21 16:16:18.778351 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:16:18.778351 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 21 16:16:18.778351 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Sep 21 16:16:18.778351 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:16:18.778351 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Sep 21 16:16:18.778351 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:16:18.778351 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:16:18.778351 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:16:18.778351 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:16:18.778351 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:16:18.778351 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 21 16:16:18.778351 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Sep 21 16:16:18.778351 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-4122c56a-a70f-4b4e-a872-a67404f135f0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:16:18.779474 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-4122c56a-a70f-4b4e-a872-a67404f135f0 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.407771 Sep 21 16:16:18.779474 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 24/49] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Sep 21 16:16:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 409 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 21 16:16:18.785461 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-685467c1-8ba0-4efb-8843-1d1f29c34ab0 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:16:18.801260 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-685467c1-8ba0-4efb-8843-1d1f29c34ab0 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019244 Sep 21 16:16:18.801955 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 26/50] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Sep 21 16:16:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 16:16:18.812423 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-df2e1874-2129-4c56-9771-3b2ae93e53ff admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:16:18.827283 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-df2e1874-2129-4c56-9771-3b2ae93e53ff admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018409 Sep 21 16:16:18.827818 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 25/51] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Sep 21 16:16:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:16:18.837301 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-6a321fac-6fb5-43a8-b743-895693966853 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:16:18.842815 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.wsgi [None req-6a321fac-6fb5-43a8-b743-895693966853 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 21 16:16:18.844342 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-6a321fac-6fb5-43a8-b743-895693966853 admin admin] Request method failure captured: Sep 21 16:16:18.844342 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 21 16:16:18.844342 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: Accept: application/json Sep 21 16:16:18.844342 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: Accept-Encoding: gzip, deflate Sep 21 16:16:18.844342 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: Connection: keep-alive Sep 21 16:16:18.844342 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: Content-Length: 0 Sep 21 16:16:18.844342 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: Host: 10.222.0.64 Sep 21 16:16:18.844342 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: Openstack-Api-Version: compute 2.92 Sep 21 16:16:18.844342 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: Openstack-System-Scope: None Sep 21 16:16:18.844342 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: User-Agent: python-novaclient Sep 21 16:16:18.844342 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Auth-Token: gAAAAABjKzjSgk8M555AyoAQb7elID1UCDW-ia-IBpYdMLdtnU2HDkwMBzJmzGGI0_1v9RC7hkhX-_1TOwE7g2qyASpsOT7hupx2oboyDqUPOTbD_K2e991L7MBkmIiie5Rz7eWNEL88pan4Sf0_B6cJWmR5P6CIJokKrpbnl1wFHx0ebY19ZPM Sep 21 16:16:18.844342 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Domain-Id: None Sep 21 16:16:18.844342 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Domain-Name: None Sep 21 16:16:18.844342 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Identity-Status: Confirmed Sep 21 16:16:18.844342 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Is-Admin-Project: True Sep 21 16:16:18.844342 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Openstack-Nova-Api-Version: 2.92 Sep 21 16:16:18.844342 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Project-Domain-Id: default Sep 21 16:16:18.844342 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Project-Domain-Name: Default Sep 21 16:16:18.844342 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Project-Id: 92877a675fac490b8473d8157aef4217 Sep 21 16:16:18.844342 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Project-Name: admin Sep 21 16:16:18.844342 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Role: member,reader,admin Sep 21 16:16:18.844342 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Roles: member,reader,admin Sep 21 16:16:18.845846 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/92877a675fac490b8473d8157aef4217"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/92877a675fac490b8473d8157aef4217"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_92877a675fac490b8473d8157aef4217"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/92877a675fac490b8473d8157aef4217"}]}] Sep 21 16:16:18.845846 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Tenant: admin Sep 21 16:16:18.845846 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Tenant-Id: 92877a675fac490b8473d8157aef4217 Sep 21 16:16:18.845846 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-Tenant-Name: admin Sep 21 16:16:18.845846 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-User: admin Sep 21 16:16:18.845846 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-User-Domain-Id: default Sep 21 16:16:18.845846 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-User-Domain-Name: Default Sep 21 16:16:18.845846 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-User-Id: b9a31b5d481f471a90714fa648bfed35 Sep 21 16:16:18.845846 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: X-User-Name: admin Sep 21 16:16:18.845846 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: method: > Sep 21 16:16:18.845846 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: exception: Flavor 451 could not be found. Sep 21 16:16:18.845846 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: action_args: {'id': '451'} Sep 21 16:16:18.845846 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:16:18.845846 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:16:18.846808 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 21 16:16:18.846808 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 21 16:16:18.846808 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 21 16:16:18.846808 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 21 16:16:18.846808 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 21 16:16:18.846808 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 21 16:16:18.846808 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 21 16:16:18.846808 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 21 16:16:18.846808 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 21 16:16:18.846808 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:16:18.846808 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 21 16:16:18.846808 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 21 16:16:18.846808 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 21 16:16:18.846808 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 21 16:16:18.846808 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:16:18.846808 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 21 16:16:18.846808 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:16:18.846808 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:16:18.846808 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:16:18.848024 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:16:18.848024 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:16:18.848024 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:16:18.848024 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:16:18.848024 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 21 16:16:18.848024 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:16:18.848024 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 21 16:16:18.848024 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 21 16:16:18.848024 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:16:18.848024 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 21 16:16:18.848024 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:16:18.848024 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:16:18.848024 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:16:18.848024 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:16:18.848024 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:16:18.848024 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 21 16:16:18.848024 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 21 16:16:18.848024 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-6a321fac-6fb5-43a8-b743-895693966853 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:16:18.849043 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-6a321fac-6fb5-43a8-b743-895693966853 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012079 Sep 21 16:16:18.849043 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 27/52] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Sep 21 16:16:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 21 16:16:20.092824 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-df2e1874-2129-4c56-9771-3b2ae93e53ff admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:16:20.093840 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-df2e1874-2129-4c56-9771-3b2ae93e53ff admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 21 16:16:20.094271 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 26/53] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Sep 21 16:16:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:16:20.630522 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-1c0d07f8-5c27-4b09-9279-79513ca4a4ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:16:20.651700 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-1c0d07f8-5c27-4b09-9279-79513ca4a4ef admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.418494 Sep 21 16:16:20.652253 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 28/54] 10.222.0.64 () {64 vars in 1235 bytes} [Wed Sep 21 16:16:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 16:16:21.892527 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-df2e1874-2129-4c56-9771-3b2ae93e53ff admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:16:21.893588 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-df2e1874-2129-4c56-9771-3b2ae93e53ff admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Sep 21 16:16:21.893986 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 27/55] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Sep 21 16:16:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:16:22.431725 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-546bee29-f4ed-4fea-bbcc-e997725a7516 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:16:22.450380 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-546bee29-f4ed-4fea-bbcc-e997725a7516 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.410524 Sep 21 16:16:22.451062 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 29/56] 10.222.0.64 () {64 vars in 1235 bytes} [Wed Sep 21 16:16:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 16:16:23.720945 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-df2e1874-2129-4c56-9771-3b2ae93e53ff admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:16:23.721985 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-df2e1874-2129-4c56-9771-3b2ae93e53ff admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Sep 21 16:16:23.722486 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 28/57] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Sep 21 16:16:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:16:24.270913 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-b04aaade-2f7d-405e-a0e6-b0ed9b42d802 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:16:24.291370 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-b04aaade-2f7d-405e-a0e6-b0ed9b42d802 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.432131 Sep 21 16:16:24.291920 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 30/58] 10.222.0.64 () {64 vars in 1235 bytes} [Wed Sep 21 16:16:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 16:16:25.712315 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-df2e1874-2129-4c56-9771-3b2ae93e53ff admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:16:25.713324 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-df2e1874-2129-4c56-9771-3b2ae93e53ff admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 21 16:16:25.713715 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 29/59] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Sep 21 16:16:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:16:26.242331 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-560fd257-94ae-43e9-99f0-9b8d9a52fce2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:16:26.262390 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-560fd257-94ae-43e9-99f0-9b8d9a52fce2 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.411470 Sep 21 16:16:26.262870 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 31/60] 10.222.0.64 () {64 vars in 1235 bytes} [Wed Sep 21 16:16:25 2022] POST /compute/v2.1/flavors => generated 409 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 16:16:27.510841 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-df2e1874-2129-4c56-9771-3b2ae93e53ff admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:16:27.511849 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-df2e1874-2129-4c56-9771-3b2ae93e53ff admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Sep 21 16:16:27.512269 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 30/61] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Sep 21 16:16:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:16:28.038332 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-25b19d61-c00a-4b80-b357-97c72355d669 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:16:28.060049 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-25b19d61-c00a-4b80-b357-97c72355d669 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.408996 Sep 21 16:16:28.060604 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 32/62] 10.222.0.64 () {60 vars in 1202 bytes} [Wed Sep 21 16:16:27 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:17:26.136859 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-df2e1874-2129-4c56-9771-3b2ae93e53ff admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:17:26.137785 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-df2e1874-2129-4c56-9771-3b2ae93e53ff admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 21 16:17:26.138249 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 31/63] 10.222.0.64 () {54 vars in 931 bytes} [Wed Sep 21 16:17:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:17:26.149794 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:17:26.551032 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-866b8b60-e47d-4e59-b2f8-ed915f84f813 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:17:26.571908 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-866b8b60-e47d-4e59-b2f8-ed915f84f813 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.426859 Sep 21 16:17:26.572457 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 33/64] 10.222.0.64 () {60 vars in 1292 bytes} [Wed Sep 21 16:17:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:17:26.593968 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG dbcounter [-] [105500] Writing DB stats nova_api:SELECT=14 {{(pid=105500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:17:26.598302 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-1bce863f-0086-4523-8802-268a0d58e7f3 admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:17:26.605694 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-1bce863f-0086-4523-8802-268a0d58e7f3 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013268 Sep 21 16:17:26.606261 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 32/65] 10.222.0.64 () {60 vars in 1283 bytes} [Wed Sep 21 16:17:26 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:17:26.618924 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-9235354f-3cfa-4e8b-841d-ce87b3d1564c admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:17:26.626275 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-9235354f-3cfa-4e8b-841d-ce87b3d1564c admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010967 Sep 21 16:17:26.626806 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 34/66] 10.222.0.64 () {60 vars in 1286 bytes} [Wed Sep 21 16:17:26 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:17:26.638240 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-f56807e2-7e8c-4449-9e85-08fcc2d50028 admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:17:26.645415 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-f56807e2-7e8c-4449-9e85-08fcc2d50028 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010669 Sep 21 16:17:26.645878 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 33/67] 10.222.0.64 () {60 vars in 1286 bytes} [Wed Sep 21 16:17:26 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:17:26.657401 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-4645170a-8b72-44d3-aee1-d64e945d72b7 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:17:26.672149 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-4645170a-8b72-44d3-aee1-d64e945d72b7 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.018219 Sep 21 16:17:26.672713 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 35/68] 10.222.0.64 () {60 vars in 1283 bytes} [Wed Sep 21 16:17:26 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:20:56.047947 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-f56807e2-7e8c-4449-9e85-08fcc2d50028 admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:20:56.048953 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-f56807e2-7e8c-4449-9e85-08fcc2d50028 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 21 16:20:56.049353 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 34/69] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Sep 21 16:20:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:20:56.188977 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writing DB stats nova_api:SELECT=6 {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:20:56.328242 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-10d8989e-f3c6-4c82-adb8-b78a8d587634 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:20:56.332863 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-10d8989e-f3c6-4c82-adb8-b78a8d587634 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:20:56.333353 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-10d8989e-f3c6-4c82-adb8-b78a8d587634 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:20:56.333778 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-10d8989e-f3c6-4c82-adb8-b78a8d587634 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:20:56.334504 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-10d8989e-f3c6-4c82-adb8-b78a8d587634 admin admin] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:20:56.334946 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-10d8989e-f3c6-4c82-adb8-b78a8d587634 admin admin] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:20:56.335356 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-10d8989e-f3c6-4c82-adb8-b78a8d587634 admin admin] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:20:56.366821 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-10d8989e-f3c6-4c82-adb8-b78a8d587634 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.178930 Sep 21 16:20:56.367384 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 36/70] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Sep 21 16:20:56 2022] GET /compute/v2.1/os-services => generated 791 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 16:20:57.467149 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-f56807e2-7e8c-4449-9e85-08fcc2d50028 admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:20:57.468140 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-f56807e2-7e8c-4449-9e85-08fcc2d50028 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Sep 21 16:20:57.468549 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 35/71] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Sep 21 16:20:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:20:57.657161 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-45035154-d5b0-44a8-8cbf-4302d7249586 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:20:57.660555 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-45035154-d5b0-44a8-8cbf-4302d7249586 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:20:57.661087 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-45035154-d5b0-44a8-8cbf-4302d7249586 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:20:57.661514 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-45035154-d5b0-44a8-8cbf-4302d7249586 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:20:57.662279 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-45035154-d5b0-44a8-8cbf-4302d7249586 admin admin] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:20:57.662722 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-45035154-d5b0-44a8-8cbf-4302d7249586 admin admin] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:20:57.663138 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-45035154-d5b0-44a8-8cbf-4302d7249586 admin admin] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:20:57.683174 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-45035154-d5b0-44a8-8cbf-4302d7249586 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.077031 Sep 21 16:20:57.683733 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 37/72] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Sep 21 16:20:57 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 16:21:09.199681 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-f56807e2-7e8c-4449-9e85-08fcc2d50028 admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:21:09.200695 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-f56807e2-7e8c-4449-9e85-08fcc2d50028 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Sep 21 16:21:09.201089 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 36/73] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Sep 21 16:21:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:21:09.347003 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writing DB stats nova_cell0:SELECT=4 {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:21:09.347625 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writing DB stats nova_cell1:SELECT=4 {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:21:09.348253 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writing DB stats nova_api:SELECT=8 {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:21:09.396841 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-bf5fedcd-c777-4b1c-b293-00ad12682dd0 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:21:09.400278 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-bf5fedcd-c777-4b1c-b293-00ad12682dd0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:21:09.400804 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-bf5fedcd-c777-4b1c-b293-00ad12682dd0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:21:09.401190 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-bf5fedcd-c777-4b1c-b293-00ad12682dd0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:21:09.401892 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-bf5fedcd-c777-4b1c-b293-00ad12682dd0 admin admin] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:21:09.402357 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-bf5fedcd-c777-4b1c-b293-00ad12682dd0 admin admin] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:21:09.402771 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-bf5fedcd-c777-4b1c-b293-00ad12682dd0 admin admin] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:21:09.427890 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-bf5fedcd-c777-4b1c-b293-00ad12682dd0 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.085391 Sep 21 16:21:09.428449 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 38/74] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Sep 21 16:21:09 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:21:10.508076 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-f56807e2-7e8c-4449-9e85-08fcc2d50028 admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:21:10.509084 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-f56807e2-7e8c-4449-9e85-08fcc2d50028 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Sep 21 16:21:10.509478 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 37/75] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Sep 21 16:21:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:21:10.718628 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-dce61fe6-54ea-42db-9a55-867f122f0bf5 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:21:10.722058 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-dce61fe6-54ea-42db-9a55-867f122f0bf5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:21:10.722548 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-dce61fe6-54ea-42db-9a55-867f122f0bf5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:21:10.723014 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-dce61fe6-54ea-42db-9a55-867f122f0bf5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:21:10.724259 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-dce61fe6-54ea-42db-9a55-867f122f0bf5 admin admin] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:21:10.724708 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-dce61fe6-54ea-42db-9a55-867f122f0bf5 admin admin] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:21:10.725165 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-dce61fe6-54ea-42db-9a55-867f122f0bf5 admin admin] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:21:10.747575 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-dce61fe6-54ea-42db-9a55-867f122f0bf5 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.094428 Sep 21 16:21:10.748178 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 39/76] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Sep 21 16:21:10 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:22:07.800131 dv-cinder-858621-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 21 16:22:07.801072 dv-cinder-858621-1-iscsi devstack@n-api.service[105487]: Wed Sep 21 16:22:07 2022 - graceful shutdown triggered... Sep 21 16:22:07.801558 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: Gracefully killing worker 1 (pid: 105500)... Sep 21 16:22:07.802202 dv-cinder-858621-1-iscsi devstack@n-api.service[105501]: Gracefully killing worker 2 (pid: 105501)... Sep 21 16:22:07.931714 dv-cinder-858621-1-iscsi devstack@n-api.service[105500]: DEBUG dbcounter [-] [105500] Writing DB stats nova_api:SELECT=4 {{(pid=105500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:22:08.802301 dv-cinder-858621-1-iscsi devstack@n-api.service[105487]: worker 1 buried after 1 seconds Sep 21 16:22:08.802301 dv-cinder-858621-1-iscsi devstack@n-api.service[105487]: worker 2 buried after 1 seconds Sep 21 16:22:08.802301 dv-cinder-858621-1-iscsi devstack@n-api.service[105487]: goodbye to uWSGI. Sep 21 16:22:08.803918 dv-cinder-858621-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 21 16:22:08.804469 dv-cinder-858621-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 21 16:22:08.807242 dv-cinder-858621-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 21 16:22:08.818719 dv-cinder-858621-1-iscsi devstack@n-api.service[120520]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 21 16:22:08.820728 dv-cinder-858621-1-iscsi devstack@n-api.service[120520]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 21 16:22:08 2022] *** Sep 21 16:22:08.820728 dv-cinder-858621-1-iscsi devstack@n-api.service[120520]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 21 16:22:08.820728 dv-cinder-858621-1-iscsi devstack@n-api.service[120520]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 21 16:22:08.820728 dv-cinder-858621-1-iscsi devstack@n-api.service[120520]: nodename: dv-cinder-858621-1-iscsi Sep 21 16:22:08.820728 dv-cinder-858621-1-iscsi devstack@n-api.service[120520]: machine: x86_64 Sep 21 16:22:08.820728 dv-cinder-858621-1-iscsi devstack@n-api.service[120520]: clock source: unix Sep 21 16:22:08.820728 dv-cinder-858621-1-iscsi devstack@n-api.service[120520]: pcre jit disabled Sep 21 16:22:08.820728 dv-cinder-858621-1-iscsi devstack@n-api.service[120520]: detected number of CPU cores: 4 Sep 21 16:22:08.820728 dv-cinder-858621-1-iscsi devstack@n-api.service[120520]: current working directory: / Sep 21 16:22:08.820728 dv-cinder-858621-1-iscsi devstack@n-api.service[120520]: detected binary path: /usr/bin/uwsgi-core Sep 21 16:22:08.821410 dv-cinder-858621-1-iscsi devstack@n-api.service[120520]: your processes number limit is 47680 Sep 21 16:22:08.821410 dv-cinder-858621-1-iscsi devstack@n-api.service[120520]: your memory page size is 4096 bytes Sep 21 16:22:08.821410 dv-cinder-858621-1-iscsi devstack@n-api.service[120520]: detected max file descriptor number: 2048 Sep 21 16:22:08.821410 dv-cinder-858621-1-iscsi devstack@n-api.service[120520]: lock engine: pthread robust mutexes Sep 21 16:22:08.821410 dv-cinder-858621-1-iscsi devstack@n-api.service[120520]: thunder lock: enabled Sep 21 16:22:08.821410 dv-cinder-858621-1-iscsi devstack@n-api.service[120520]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 21 16:22:08.821410 dv-cinder-858621-1-iscsi devstack@n-api.service[120520]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 21 16:22:08.860762 dv-cinder-858621-1-iscsi devstack@n-api.service[120520]: Python main interpreter initialized at 0x55e7472429c0 Sep 21 16:22:08.860762 dv-cinder-858621-1-iscsi devstack@n-api.service[120520]: python threads support enabled Sep 21 16:22:08.860762 dv-cinder-858621-1-iscsi devstack@n-api.service[120520]: your server socket listen backlog is limited to 100 connections Sep 21 16:22:08.860762 dv-cinder-858621-1-iscsi devstack@n-api.service[120520]: your mercy for graceful operations on workers is 90 seconds Sep 21 16:22:08.861218 dv-cinder-858621-1-iscsi devstack@n-api.service[120520]: mapped 403077 bytes (393 KB) for 2 cores Sep 21 16:22:08.861218 dv-cinder-858621-1-iscsi devstack@n-api.service[120520]: *** Operational MODE: preforking *** Sep 21 16:22:08.861473 dv-cinder-858621-1-iscsi devstack@n-api.service[120520]: *** uWSGI is running in multiple interpreter mode *** Sep 21 16:22:08.861473 dv-cinder-858621-1-iscsi devstack@n-api.service[120520]: spawned uWSGI master process (pid: 120520) Sep 21 16:22:08.861677 dv-cinder-858621-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 21 16:22:08.882093 dv-cinder-858621-1-iscsi devstack@n-api.service[120520]: spawned uWSGI worker 1 (pid: 120531, cores: 1) Sep 21 16:22:08.882093 dv-cinder-858621-1-iscsi devstack@n-api.service[120520]: spawned uWSGI worker 2 (pid: 120532, cores: 1) Sep 21 16:22:08.882093 dv-cinder-858621-1-iscsi devstack@n-api.service[120520]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 21 16:22:09.546702 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 21 16:22:09.550890 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 21 16:22:10.711673 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 21 16:22:10.711673 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: from cryptography.utils import int_from_bytes Sep 21 16:22:10.712451 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 21 16:22:10.712451 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: from cryptography.utils import int_from_bytes Sep 21 16:22:10.714906 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 21 16:22:10.714906 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: from cryptography.utils import int_from_bytes Sep 21 16:22:10.715377 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 21 16:22:10.715377 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: from cryptography.utils import int_from_bytes Sep 21 16:22:13.157649 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 21 16:22:13.158372 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 21 16:22:13.158464 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 21 16:22:13.158881 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 21 16:22:13.159139 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 21 16:22:13.159533 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.159856 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.160174 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.160494 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.160825 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.161134 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.161455 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.161772 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.162123 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.162387 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.162703 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.163198 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-858621-1-iscsi {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.163795 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.164109 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.164424 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.164748 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.165059 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.165390 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.165703 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.166234 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.167716 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.167716 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.167716 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.167716 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.168069 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.168263 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.168520 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.168829 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.169155 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.169468 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.169866 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-858621-1-iscsi {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.170214 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.170523 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.170829 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.171253 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.171574 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.171887 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.172202 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.172527 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.172828 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.173704 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.174015 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.174362 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.174681 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.174986 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.175288 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.175604 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.175923 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.176230 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.176541 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.176790 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.177095 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.177418 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.177730 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.178077 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.178332 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.178584 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.178903 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.179226 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.179533 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.179835 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.180146 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.180441 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.180743 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.181044 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.181956 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.181956 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.181956 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.182466 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.182627 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.182860 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.183176 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.183590 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.183841 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.184148 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.184492 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.184816 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.185119 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.185443 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.185774 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.186107 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.186415 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.186724 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.187043 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.187381 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.187684 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.187934 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.188235 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.188537 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.189413 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.189759 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.190080 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.190406 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.190696 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.191001 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.191302 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.191604 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.191905 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.192207 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.192509 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.192810 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.193112 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.193415 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.193716 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.194037 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.194379 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.194683 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.194991 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.195288 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.195597 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.196128 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.196307 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.196570 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.196905 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.197141 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.197431 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.197746 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.198249 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.198447 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.198674 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.198971 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.199276 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.199589 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.199891 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.200194 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.200494 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.200793 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.201095 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.201398 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.201698 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.201997 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.202319 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.202634 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.202949 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.203253 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.203462 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 21 16:22:13.203885 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.203973 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 21 16:22:13.204056 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.204148 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.204292 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 21 16:22:13.204501 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.204661 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 21 16:22:13.204832 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.204931 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 21 16:22:13.205175 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.205295 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.205488 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.205622 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.205824 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.205950 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.206177 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.206284 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.206494 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.206617 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.206805 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.206930 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.207117 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.207254 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.207440 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.207574 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.207749 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.207901 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.208057 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.208164 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.208364 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.208455 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.208677 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.208916 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-858621-1-iscsi {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.209006 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.209243 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.209343 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.209555 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.209646 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.209868 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.209970 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.210213 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.210317 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.210522 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.210613 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.210839 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.210944 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.211143 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.211232 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.211477 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.211650 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.211789 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.211961 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.212130 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.212266 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.212474 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.212565 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.212785 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.212903 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.213107 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.213219 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.213430 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.213520 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.213738 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.213829 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.214064 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.214271 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.214373 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.214598 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.214697 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.214911 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.215009 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.215297 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.215399 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-858621-1-iscsi {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.215620 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.215710 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.215931 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.216028 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.216245 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.216343 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.216552 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.216641 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.216860 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.216950 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.217171 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.217280 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.217479 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.217579 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.217786 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.217883 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.218144 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.218255 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.218457 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.218548 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.218778 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.218875 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.219109 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.219215 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.219403 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.219494 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.219718 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.219815 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.220050 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.220149 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.220359 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.220449 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.220666 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.220756 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.220968 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.221059 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.221271 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.221378 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.221531 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.221629 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.221842 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.221939 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.222178 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.222265 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.222500 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.222595 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.222827 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.222923 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.223080 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.223162 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.223334 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.223437 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.223653 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.223734 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.223974 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.224063 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.224286 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.224375 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.224598 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.224678 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.224906 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.224986 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.225214 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.225305 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.225521 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.225606 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.225822 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.225908 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.227250 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.227352 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.227454 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.227548 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.227642 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.227728 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.227820 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.227912 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.227912 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.228072 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.228161 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.228258 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.228342 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.228424 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.228505 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.228586 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.228684 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.228776 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.228859 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.228940 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.229118 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.229210 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.229439 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.229594 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.229751 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.229842 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.230072 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.230994 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.231123 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.231209 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.231281 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.231359 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.231446 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.231518 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.231602 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.231695 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.231816 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.231908 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.232006 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.232233 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.232327 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.232419 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.232569 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.232669 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.232873 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.232972 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.233216 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.233320 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.233536 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.233644 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.233845 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.233937 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.234178 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.234288 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.234481 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.234571 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.234782 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.234872 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.235083 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.235181 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.235387 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.236021 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.236254 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.236354 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.236564 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.236664 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.236865 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.236955 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.237167 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.237262 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.237468 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.237571 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.237775 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.237872 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.238103 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.238196 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.238412 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.238511 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.238733 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.238824 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.239053 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.239150 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.239363 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.239455 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.239673 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.239763 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.239981 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.240071 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.240289 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.240380 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.240597 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.240698 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.240910 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.241222 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.241543 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.241855 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.242030 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.242243 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.242385 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.242490 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.242730 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.242831 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.243052 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.243150 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.243372 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.243469 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.243700 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.243797 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.244015 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.244106 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.244332 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.244429 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.244659 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.244756 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.244967 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.245059 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.245281 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.245371 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.245590 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.245679 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.245905 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.245996 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.246241 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.246346 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.246553 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.246651 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.246860 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.246955 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.247168 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.247275 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.247476 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.247575 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.247782 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.247879 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.248087 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.248185 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.248392 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.248492 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.248711 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.248801 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.249018 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.249115 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.249333 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.249432 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.249637 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.249727 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.249944 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.250034 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.250291 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 16:22:13.250397 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.250622 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.250712 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.250933 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.251024 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.251805 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.251927 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.252127 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.252227 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.252438 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.252533 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.252748 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.252840 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.253059 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.253157 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.253366 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.253456 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.253670 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.253777 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.253978 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.254088 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.254319 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.254428 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.254637 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.254740 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.254927 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.255026 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.255232 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.255336 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.255544 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.255645 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.255852 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.255943 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.256161 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.256266 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.256464 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.256562 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.256773 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.256913 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.257094 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.257298 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.257429 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.257564 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.257693 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.257827 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.258012 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.258184 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.258321 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.258449 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.258627 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.258767 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.258948 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.259081 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.259254 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.259394 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.259557 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.259696 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.259857 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.260027 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.260169 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.260346 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.260477 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.260660 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.260805 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.260974 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.261117 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.261319 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.261458 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.261636 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.261778 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.261953 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.262104 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.262300 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.262432 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.262608 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.262739 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.262919 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.263059 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.263237 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.263378 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.263548 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.263685 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.263859 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.263999 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.264169 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.264301 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.264479 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.264612 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.264788 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.264924 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.265098 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.265239 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.265421 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.265562 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.265730 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.265870 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.266091 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.266238 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.266358 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.266474 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.266664 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.266834 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.266997 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.267138 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.267317 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.267442 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.267625 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.267984 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.268128 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.268269 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.268398 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.268535 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.268671 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.268824 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.268956 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.269150 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.269282 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.269474 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.269619 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.269783 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.269912 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.270138 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.270282 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.270449 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.270588 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.270753 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.270883 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.271062 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.271200 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.271367 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.271507 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.271671 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.271810 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.271979 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.272110 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.272281 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.272412 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.272583 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.272722 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.272885 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.273017 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.273192 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.273331 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.273493 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.273624 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.273796 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.273939 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.274120 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.274261 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.274424 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.274555 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.274737 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.274877 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.275043 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.275182 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.275351 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.275482 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.275653 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.275804 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.275969 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.276108 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.276275 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.276411 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.276575 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.276720 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.276877 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.277016 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.277178 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.277309 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.277518 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.277658 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.277823 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.277953 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.278240 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.278378 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.278530 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.278652 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.278833 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.278972 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.279138 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.279271 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.279442 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.279582 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.279755 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.279892 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.280059 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.280197 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.280363 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.280500 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.280663 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.280802 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.280965 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.281096 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.281271 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.281408 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.281573 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.281705 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.281876 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.282006 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.282205 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.282849 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.283120 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.283262 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.283401 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.283543 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.283679 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.283807 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.283918 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.284052 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.284187 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.284325 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.284504 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.284636 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.284814 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.284960 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.285121 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.285324 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.285454 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.285587 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.285722 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.285850 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.286020 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.286195 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.286347 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.286488 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.286657 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.286797 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.286962 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.287115 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.287280 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.287414 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.287585 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.287717 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.287890 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.288014 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.288195 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.288400 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.288765 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.288890 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.289054 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.289186 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.289358 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.289489 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.289682 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.289819 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.289991 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.290139 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.290321 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.290452 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.290624 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.290768 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.290930 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.291067 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.291231 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.291361 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.291534 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.291674 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.291842 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.291971 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.292162 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.292293 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.292476 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.292615 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.292778 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.292908 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.293084 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.293224 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.293443 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.293585 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.293722 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.293858 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.293987 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.294134 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.294281 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.294418 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.294570 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.294702 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.294873 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.295005 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.295175 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.295322 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.295479 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.295618 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.295780 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.295913 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.296107 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.296240 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.296413 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.296545 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.296713 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.296857 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.297015 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.297155 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.297317 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.297456 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.297659 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.297799 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.298677 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.298822 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.298942 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.299050 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.299165 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.299311 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.299485 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.299617 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.299799 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.299930 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.300108 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.300242 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.300416 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.300546 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.300725 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.300862 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.301029 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.301238 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.301378 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.301491 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.301636 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.301776 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.301919 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.302075 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.302252 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.302398 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.302554 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.302741 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.302891 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.303030 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.303161 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.303308 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.303561 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.303707 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.303847 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.303976 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.304112 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.304242 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.304377 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.304506 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.304673 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.304813 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.304998 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.305133 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.305276 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.305406 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.305557 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.305730 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.305878 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.306021 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.306203 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.306352 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.306482 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.306616 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.306774 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.306907 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.307084 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.307229 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.307393 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.307527 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.307702 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.307841 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.308008 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.308168 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.308351 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.308503 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.308645 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.308788 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.308998 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.309131 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.309259 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.309413 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.309577 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.309706 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.309885 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.310033 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.310197 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.310335 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.310527 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.310660 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.310800 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.310937 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.311075 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.311204 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.311332 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.311466 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.311643 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.311776 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.311968 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.312100 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.312279 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.312425 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.312594 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.312720 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.312909 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.313049 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.313221 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.313443 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.313624 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.313792 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.313980 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.314180 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.314455 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.314602 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.314792 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.314923 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.315112 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.315250 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.315433 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.315575 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.315791 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.315931 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.316145 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.316274 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.316401 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.316534 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.316720 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.316860 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.317028 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.317161 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.317333 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.317465 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.317638 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.317777 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.317959 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.318112 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.318288 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.318419 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.318602 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.318734 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.318909 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.319064 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.319215 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.319347 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.319520 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.319662 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.319832 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.320010 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.320151 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.320323 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.320462 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.320634 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.320768 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.320957 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.321090 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.321279 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.321419 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.321605 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.321745 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.321910 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.322081 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.322225 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.322353 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.322547 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.322680 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.322858 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.322991 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.323164 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.323374 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.323512 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.323640 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.323775 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.323903 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.324069 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.324209 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.324390 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.324527 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.324712 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.324849 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.325026 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.325168 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.325350 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.325490 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.325678 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.325809 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.325984 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.326146 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.326341 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.326481 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.326648 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.326781 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.326954 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.327088 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.327259 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.327378 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.327570 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.327694 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.327877 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.328011 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.328179 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.328313 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.328491 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.328630 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.328802 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.328941 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.329105 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.329259 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.329439 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.329571 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.329743 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.329876 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.330090 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.330236 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.330366 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.330512 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.330665 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.330796 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.330983 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.331114 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.331284 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.331429 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.331587 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.331718 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.331901 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.332041 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.332209 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.332351 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.332512 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.332651 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.332823 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.332954 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.333127 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.333260 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.333439 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.333571 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.333742 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.333880 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.334062 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.334196 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.334369 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.334509 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.334676 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.334814 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.334987 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.335127 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.335292 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.335424 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.335618 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.335751 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.335931 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.336063 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.336243 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.336384 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.336548 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.336690 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.336856 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.336989 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.337160 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.337300 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.337466 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.337611 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.337775 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.337907 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.338120 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.338256 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.338428 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.338572 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.338731 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.338864 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.339039 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.339178 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.339340 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.339472 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.339643 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.339787 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.339946 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.340077 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.340253 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.340391 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.340552 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.340683 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.340854 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.340992 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.341156 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.341294 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.341460 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.341600 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.341765 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.341904 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.342121 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.342263 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.342399 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.342527 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.342692 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.342831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.342997 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.343129 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.343297 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.343437 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.343638 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.343771 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.343941 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.344081 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.344271 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.344413 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.344621 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.344751 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.345405 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.345542 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.345719 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.345851 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.346033 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.346199 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.346368 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.346500 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.346690 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.346837 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.346996 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.347134 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.347306 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.347445 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.347619 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.347763 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.347924 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.348063 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.348229 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.348360 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.348537 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.348681 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.348854 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.348986 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.349166 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.349396 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.349520 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.349724 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.349865 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.350038 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.350190 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.350371 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.350512 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.350682 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.350815 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.350996 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.351136 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.351309 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.351451 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.351620 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.351759 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.351930 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.352062 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.352239 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.352384 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.352549 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.352690 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.352867 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.353005 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.353186 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.353326 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.353502 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.353632 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.353819 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.353951 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.354156 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.354291 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.354468 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.354607 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.354779 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.354917 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.355088 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.355226 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.355415 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.355551 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.355730 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.355871 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.356036 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.356174 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.356348 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.356479 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.356663 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.356807 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.356971 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.357102 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.357278 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.357416 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.357584 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.357729 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.357894 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.358026 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.358229 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.358371 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.358539 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.358680 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.358847 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.358987 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.359157 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.359281 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.359467 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.359599 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.359792 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.359926 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.360127 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.360259 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.360467 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.361122 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.361304 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.361444 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.361618 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.361751 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.361988 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.362181 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.362323 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.362474 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.362615 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.362795 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.362937 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.363130 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.363264 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.363458 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.363590 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.363783 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.363924 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.364100 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.364233 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.364418 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.364558 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.364732 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.364863 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.365044 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.365182 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.365350 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.365482 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.365661 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.365801 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.365971 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.366133 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.366298 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.366490 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.366624 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.366812 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.366955 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.367126 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.367259 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.367454 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.367593 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.367779 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.367912 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.368108 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.368329 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.368473 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.368679 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.368811 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.368995 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.369128 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.369320 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.369462 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.369645 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.369775 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.369961 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.370118 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.370290 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.370422 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.370613 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.370755 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.370919 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.371052 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.371226 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.371367 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.371542 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.371674 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.371852 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.371992 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.372157 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.372300 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.372460 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.372600 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.372770 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.372910 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.373078 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.373211 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.373383 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.373517 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.373692 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.373833 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.373996 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.374219 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.374406 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.374547 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.374713 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.374927 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.375058 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.375187 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.375315 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.375443 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.375609 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.375751 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.375912 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.376083 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.376223 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.376353 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.376538 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.376686 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.376827 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.376957 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.377167 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.377313 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.377458 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.377596 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.377725 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.377860 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.378066 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.378221 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.378388 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.378529 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.378714 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.378854 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.379040 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.379173 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.379348 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.379473 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.379668 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.379799 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.379974 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.380114 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.380277 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.380410 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.380582 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.380706 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.380890 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.381021 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.381213 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.381355 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.381523 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.381663 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.381831 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.381973 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.382190 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.382323 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.382508 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.382649 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.382820 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.383040 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.383173 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.383375 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.383518 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.383694 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.383827 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.384025 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.384166 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.384357 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.384490 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.384663 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.384804 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.384969 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.385103 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.385275 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.385415 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.385586 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.385735 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.385893 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.386027 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.386228 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.386370 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.386543 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.386683 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.386852 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.386983 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.387153 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.387292 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.387459 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.387604 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.387764 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.387904 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.388069 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.388201 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.388376 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.388509 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.388683 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.388816 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.388993 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.389133 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.389298 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.389429 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.389603 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.389742 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.389905 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.390028 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.390243 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.390376 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.390572 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.390703 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.390905 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.391038 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.391217 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.391350 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.391543 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.391699 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.391897 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.392041 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.392216 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.392357 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.392532 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.392670 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.392843 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.392984 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.393153 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.393278 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.393468 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.393608 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.393785 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.393928 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.394108 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.394251 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.394415 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.394547 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.394735 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.394858 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.395056 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.395187 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.395434 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.395594 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.395739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.395927 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.396067 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.396243 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.396383 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.396559 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.396700 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.396878 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.397017 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.397195 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.397328 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.397511 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.397638 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.397825 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.397965 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.398162 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.398298 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.398478 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.398619 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.398789 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.398923 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.399123 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.399262 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.399428 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.399567 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.399732 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.399864 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.400040 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.400174 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.400356 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.400496 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.400666 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.400799 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.400970 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.401115 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.401270 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.401409 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.401576 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.401710 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.401879 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.402012 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.402209 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.402338 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.402494 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.402627 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.402795 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.402928 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.403099 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.403231 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.403398 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.403530 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.403735 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.403867 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.403995 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.404130 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.404258 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.404387 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.404559 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.404699 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.404858 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.404997 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.405162 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.405302 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.405462 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.405601 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.405763 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.405905 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.406083 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.406306 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.406441 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.406637 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.406769 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.406956 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.407098 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.407272 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.407923 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.408118 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.408251 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.408447 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.408662 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.408809 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.408984 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.409117 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.409320 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.409453 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.409649 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.409769 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.409967 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.410105 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.410313 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.410430 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.410619 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.410737 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.410952 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.411071 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.411259 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.411383 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.411569 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.411704 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.411879 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.412011 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.412187 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.412328 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.412493 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.412625 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.412798 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.412939 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.413119 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.413266 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.413427 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.413807 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.413993 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.414181 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.414327 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.414444 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.414645 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.414864 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.414966 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.415219 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.415327 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.415536 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.415632 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.415865 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.415964 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.416171 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.416289 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.416483 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.416589 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.416791 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.416894 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.417104 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.417212 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.417414 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.417507 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.417719 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.417818 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.418024 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.418162 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.418356 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.418463 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.418662 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.418772 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.418965 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.419083 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.419271 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.419450 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.419607 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.419764 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.419923 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.420075 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.420225 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.420367 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.420509 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.420658 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.420814 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.420965 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.421108 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.421250 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.421398 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.421557 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.421720 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.421870 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.422013 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.422224 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.422371 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.422532 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.422684 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.422834 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.423025 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.423673 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 21 16:22:13.423832 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.423985 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.424278 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.424689 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.424996 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.425311 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.425661 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.425971 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.426302 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.426629 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.426936 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.427246 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.427563 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.427875 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.428198 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.428510 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.428824 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.429173 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.429491 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.430029 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.430386 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.430709 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.431047 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.431382 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.431689 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.431996 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.432302 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.432625 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.432937 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.433252 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.433563 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.433873 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.434208 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.434520 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.434830 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.435138 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.435449 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.435759 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.436069 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.436379 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.436689 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.436997 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.437320 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.437666 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.437989 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.438337 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.438697 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.439019 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.439334 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.439648 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.439960 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.440272 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.440591 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.440921 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.441237 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.441564 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.441962 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.442304 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.442627 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.442949 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.443259 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.443582 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.443905 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.444217 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.444539 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.444850 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.445179 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.445522 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.445851 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.446206 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.446516 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.446822 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.447132 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.447441 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.447760 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.448072 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.448375 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.448677 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.448985 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.449289 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.449591 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.449894 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.450220 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.450527 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.450828 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.451131 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.451432 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.451749 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.452029 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.452329 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.452635 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.452936 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.453241 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.453541 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.453844 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.454167 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.454547 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.454883 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.455200 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.455526 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.455841 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.456164 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.456478 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.456801 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.457128 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.457447 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.457759 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.458114 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.458431 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.458748 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.459064 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.459377 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.459705 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.459996 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.460327 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.460656 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.460963 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.461290 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.461610 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.461959 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.462275 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.462590 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.462922 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.463236 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.463549 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.463859 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.464173 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.464487 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.464806 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.465118 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.465430 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.465749 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.466084 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.466415 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.466746 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.467057 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.467390 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.467718 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.468065 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.468380 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.468726 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.469056 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.469374 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.469689 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.470557 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 16:22:13.470804 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 21 16:22:13.484917 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO dbcounter [None req-871ada55-72b2-46de-9762-423e0c5c0d18 None None] Registered counter for database nova_api Sep 21 16:22:13.508616 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_db.sqlalchemy.engines [None req-871ada55-72b2-46de-9762-423e0c5c0d18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 16:22:13.512413 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writer thread running {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 16:22:13.533819 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO dbcounter [None req-d35d93ef-917d-485c-a715-74f095b4da42 None None] Registered counter for database nova_api Sep 21 16:22:13.554773 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_db.sqlalchemy.engines [None req-d35d93ef-917d-485c-a715-74f095b4da42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120532) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 16:22:13.561585 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writer thread running {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 16:22:13.569501 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.context [None req-871ada55-72b2-46de-9762-423e0c5c0d18 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),02bd0416-446f-49db-ab6e-c32e12984242(cell1) {{(pid=120531) load_cells /opt/stack/nova/nova/context.py:464}} Sep 21 16:22:13.573518 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-871ada55-72b2-46de-9762-423e0c5c0d18 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:22:13.573992 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-871ada55-72b2-46de-9762-423e0c5c0d18 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:22:13.575590 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-871ada55-72b2-46de-9762-423e0c5c0d18 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:22:13.576322 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-871ada55-72b2-46de-9762-423e0c5c0d18 None None] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:22:13.576766 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-871ada55-72b2-46de-9762-423e0c5c0d18 None None] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:22:13.578802 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-871ada55-72b2-46de-9762-423e0c5c0d18 None None] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:22:13.580829 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO dbcounter [None req-871ada55-72b2-46de-9762-423e0c5c0d18 None None] Registered counter for database nova_cell0 Sep 21 16:22:13.584904 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO dbcounter [None req-871ada55-72b2-46de-9762-423e0c5c0d18 None None] Registered counter for database nova_cell1 Sep 21 16:22:13.592467 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_db.sqlalchemy.engines [None req-871ada55-72b2-46de-9762-423e0c5c0d18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 16:22:13.594145 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_db.sqlalchemy.engines [None req-871ada55-72b2-46de-9762-423e0c5c0d18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 16:22:13.600914 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writer thread running {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 16:22:13.602196 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writer thread running {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 16:22:13.618814 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.context [None req-d35d93ef-917d-485c-a715-74f095b4da42 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),02bd0416-446f-49db-ab6e-c32e12984242(cell1) {{(pid=120532) load_cells /opt/stack/nova/nova/context.py:464}} Sep 21 16:22:13.622879 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d35d93ef-917d-485c-a715-74f095b4da42 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:22:13.623357 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d35d93ef-917d-485c-a715-74f095b4da42 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:22:13.624940 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d35d93ef-917d-485c-a715-74f095b4da42 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:22:13.625685 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d35d93ef-917d-485c-a715-74f095b4da42 None None] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:22:13.626187 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d35d93ef-917d-485c-a715-74f095b4da42 None None] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:22:13.628189 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d35d93ef-917d-485c-a715-74f095b4da42 None None] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:22:13.630232 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO dbcounter [None req-d35d93ef-917d-485c-a715-74f095b4da42 None None] Registered counter for database nova_cell0 Sep 21 16:22:13.634292 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO dbcounter [None req-d35d93ef-917d-485c-a715-74f095b4da42 None None] Registered counter for database nova_cell1 Sep 21 16:22:13.641604 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_db.sqlalchemy.engines [None req-d35d93ef-917d-485c-a715-74f095b4da42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120532) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 16:22:13.644342 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_db.sqlalchemy.engines [None req-d35d93ef-917d-485c-a715-74f095b4da42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120532) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 16:22:13.649782 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writer thread running {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 16:22:13.651894 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writer thread running {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 16:22:13.749050 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO dbcounter [None req-871ada55-72b2-46de-9762-423e0c5c0d18 None None] Registered counter for database nova_cell0 Sep 21 16:22:13.755736 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_db.sqlalchemy.engines [None req-871ada55-72b2-46de-9762-423e0c5c0d18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 16:22:13.761981 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writer thread running {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 16:22:13.799560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO dbcounter [None req-d35d93ef-917d-485c-a715-74f095b4da42 None None] Registered counter for database nova_cell0 Sep 21 16:22:13.808333 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_db.sqlalchemy.engines [None req-d35d93ef-917d-485c-a715-74f095b4da42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120532) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 16:22:13.812870 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writer thread running {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 16:22:14.082585 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: WARNING keystonemiddleware.auth_token [None req-871ada55-72b2-46de-9762-423e0c5c0d18 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 21 16:22:14.090016 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: WARNING keystonemiddleware.auth_token [None req-871ada55-72b2-46de-9762-423e0c5c0d18 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 21 16:22:14.135692 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: WARNING keystonemiddleware.auth_token [None req-d35d93ef-917d-485c-a715-74f095b4da42 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 21 16:22:14.143944 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: WARNING keystonemiddleware.auth_token [None req-d35d93ef-917d-485c-a715-74f095b4da42 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 21 16:22:14.441100 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: WARNING keystonemiddleware.auth_token [None req-871ada55-72b2-46de-9762-423e0c5c0d18 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 21 16:22:14.447140 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: WARNING keystonemiddleware.auth_token [None req-871ada55-72b2-46de-9762-423e0c5c0d18 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 21 16:22:14.452643 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e7472429c0 pid: 120531 (default app) Sep 21 16:22:14.491797 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: WARNING keystonemiddleware.auth_token [None req-d35d93ef-917d-485c-a715-74f095b4da42 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 21 16:22:14.497916 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: WARNING keystonemiddleware.auth_token [None req-d35d93ef-917d-485c-a715-74f095b4da42 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 21 16:22:14.503340 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e7472429c0 pid: 120532 (default app) Sep 21 16:22:51.466163 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_api:SELECT=3 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:22:51.470031 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell0:SELECT=3 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:22:51.470031 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=3 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:22:51.470031 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell0:SELECT=3 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:22:51.810561 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-b83fdd3d-5e99-4520-a3a4-7e247bc23077 tempest-VolumesTestJSON-1535337896 tempest-VolumesTestJSON-1535337896-project] Calling method '.version_select at 0x7fdb89c3bf70>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:22:51.840233 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_api:SELECT=3 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:22:51.841246 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=3 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:22:51.842370 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell0:SELECT=3 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:22:51.844377 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell0:SELECT=3 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:22:52.771080 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-fe233585-d544-4a78-8fb6-f4f250364cde tempest-VolumesGetTestJSON-1043750163 tempest-VolumesGetTestJSON-1043750163-project] Action: 'create', calling method: .version_select at 0x7fdb89b8d430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1717987125", "metadata": {"Type": "work"}}} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:22:52.940276 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-b83fdd3d-5e99-4520-a3a4-7e247bc23077 tempest-VolumesTestJSON-1535337896 tempest-VolumesTestJSON-1535337896-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/a7db52b1-2241-406e-a8cc-554d65788e35" status: 200 len: 350 microversion: 2.1 time: 1.368762 Sep 21 16:22:52.941473 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 1/1] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Sep 21 16:22:51 2022] GET /compute/v2.1/os-volumes/a7db52b1-2241-406e-a8cc-554d65788e35 => generated 350 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:22:54.210099 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-fe233585-d544-4a78-8fb6-f4f250364cde tempest-VolumesGetTestJSON-1043750163 tempest-VolumesGetTestJSON-1043750163-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.758572 Sep 21 16:22:54.222900 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 1/2] 10.222.0.64 () {60 vars in 1156 bytes} [Wed Sep 21 16:22:51 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2773 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 21 16:22:54.228924 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-f837a559-5870-4b98-b8f3-2007ae8f3c5f tempest-VolumesGetTestJSON-1043750163 tempest-VolumesGetTestJSON-1043750163-project] Calling method '.version_select at 0x7fdb89a38310>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:22:54.334120 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-f837a559-5870-4b98-b8f3-2007ae8f3c5f tempest-VolumesGetTestJSON-1043750163 tempest-VolumesGetTestJSON-1043750163-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/e575058b-5e12-40c6-81a0-f9d0246e5543" status: 200 len: 353 microversion: 2.1 time: 0.110499 Sep 21 16:22:54.335001 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 2/3] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Sep 21 16:22:54 2022] GET /compute/v2.1/os-volumes/e575058b-5e12-40c6-81a0-f9d0246e5543 => generated 353 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:22:55.218749 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-62e22d5d-c540-4917-803d-0a2cf08822d1 tempest-VolumesTestJSON-1535337896 tempest-VolumesTestJSON-1535337896-project] Calling method '.version_select at 0x7fdb89a60310>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:22:55.349029 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ad93644f-2bdd-42f2-9150-94830a1ff183 tempest-VolumesGetTestJSON-1043750163 tempest-VolumesGetTestJSON-1043750163-project] Calling method '.version_select at 0x7fdb89a383a0>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:22:55.444708 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-62e22d5d-c540-4917-803d-0a2cf08822d1 tempest-VolumesTestJSON-1535337896 tempest-VolumesTestJSON-1535337896-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/6c80e5fd-beea-4010-a60b-7ea3fc583966" status: 200 len: 350 microversion: 2.1 time: 0.230624 Sep 21 16:22:55.445365 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 2/4] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Sep 21 16:22:55 2022] GET /compute/v2.1/os-volumes/6c80e5fd-beea-4010-a60b-7ea3fc583966 => generated 350 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:22:55.446490 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ad93644f-2bdd-42f2-9150-94830a1ff183 tempest-VolumesGetTestJSON-1043750163 tempest-VolumesGetTestJSON-1043750163-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/e575058b-5e12-40c6-81a0-f9d0246e5543" status: 200 len: 354 microversion: 2.1 time: 0.101370 Sep 21 16:22:55.455348 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 3/5] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Sep 21 16:22:55 2022] GET /compute/v2.1/os-volumes/e575058b-5e12-40c6-81a0-f9d0246e5543 => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:22:55.461547 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-c6fe697e-b032-4140-a536-fbfa88c4d05b tempest-VolumesGetTestJSON-1043750163 tempest-VolumesGetTestJSON-1043750163-project] Calling method '.version_select at 0x7fdb89a60a60>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:22:55.737939 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-c6fe697e-b032-4140-a536-fbfa88c4d05b tempest-VolumesGetTestJSON-1043750163 tempest-VolumesGetTestJSON-1043750163-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/e575058b-5e12-40c6-81a0-f9d0246e5543" status: 200 len: 354 microversion: 2.1 time: 0.280535 Sep 21 16:22:55.751148 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 3/6] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Sep 21 16:22:55 2022] GET /compute/v2.1/os-volumes/e575058b-5e12-40c6-81a0-f9d0246e5543 => generated 354 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:22:55.769969 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-b6af9306-c19f-40c9-af55-4c21e4e61364 tempest-VolumesGetTestJSON-1043750163 tempest-VolumesGetTestJSON-1043750163-project] Calling method '.version_select at 0x7fdb89a38af0>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:22:56.091791 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-b6af9306-c19f-40c9-af55-4c21e4e61364 tempest-VolumesGetTestJSON-1043750163 tempest-VolumesGetTestJSON-1043750163-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/e575058b-5e12-40c6-81a0-f9d0246e5543" status: 202 len: 0 microversion: 2.1 time: 0.333678 Sep 21 16:22:56.094452 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 4/7] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Sep 21 16:22:55 2022] DELETE /compute/v2.1/os-volumes/e575058b-5e12-40c6-81a0-f9d0246e5543 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 16:22:56.105938 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-b2e6975c-2282-448b-840a-ecea4e2ec31c tempest-VolumesGetTestJSON-1043750163 tempest-VolumesGetTestJSON-1043750163-project] Calling method '.version_select at 0x7fdb899fa160>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:22:56.276526 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-b2e6975c-2282-448b-840a-ecea4e2ec31c tempest-VolumesGetTestJSON-1043750163 tempest-VolumesGetTestJSON-1043750163-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/e575058b-5e12-40c6-81a0-f9d0246e5543" status: 200 len: 353 microversion: 2.1 time: 0.177713 Sep 21 16:22:56.277131 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 4/8] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Sep 21 16:22:56 2022] GET /compute/v2.1/os-volumes/e575058b-5e12-40c6-81a0-f9d0246e5543 => generated 353 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:22:57.295596 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-82db205b-0af5-40e0-8529-0fe49715a450 tempest-VolumesGetTestJSON-1043750163 tempest-VolumesGetTestJSON-1043750163-project] Calling method '.version_select at 0x7fdb89a58280>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:22:57.327713 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-24b29caf-e0b7-404a-88b2-0e4e2d6fad11 tempest-VolumesTestJSON-1535337896 tempest-VolumesTestJSON-1535337896-project] Calling method '.version_select at 0x7fdb89a60d30>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:22:57.351873 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.wsgi [None req-82db205b-0af5-40e0-8529-0fe49715a450 tempest-VolumesGetTestJSON-1043750163 tempest-VolumesGetTestJSON-1043750163-project] HTTP exception thrown: Volume e575058b-5e12-40c6-81a0-f9d0246e5543 could not be found. Sep 21 16:22:57.388925 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-82db205b-0af5-40e0-8529-0fe49715a450 tempest-VolumesGetTestJSON-1043750163 tempest-VolumesGetTestJSON-1043750163-project] Request method failure captured: Sep 21 16:22:57.388925 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: request: GET /compute/v2.1/os-volumes/e575058b-5e12-40c6-81a0-f9d0246e5543 HTTP/1.1 Sep 21 16:22:57.388925 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept: application/json Sep 21 16:22:57.388925 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept-Encoding: identity Sep 21 16:22:57.388925 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Connection: close Sep 21 16:22:57.388925 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Length: 0 Sep 21 16:22:57.388925 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Type: application/json Sep 21 16:22:57.388925 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Host: 10.222.0.64 Sep 21 16:22:57.388925 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Openstack-System-Scope: None Sep 21 16:22:57.388925 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: User-Agent: python-urllib3/1.26.12 Sep 21 16:22:57.388925 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Auth-Token: gAAAAABjKzpb4lhrmaCjIIImv4bUpQvYAPb2gUs8t6VselS1hHfZEqhI2A0U2tGSE8MyGWz5KvMLlW20VVzFf8jpNtJKRgP9jyCHpSUrUrkE-YS0bsb2IFBAMi3pcT-QqFKC0C9DYJ_-pG8iyI4k6Y5u2_-9NfEC4D8Ny2rTNF5xLKfjP_Lb9w4 Sep 21 16:22:57.388925 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Id: None Sep 21 16:22:57.388925 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Name: None Sep 21 16:22:57.388925 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Identity-Status: Confirmed Sep 21 16:22:57.388925 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Is-Admin-Project: True Sep 21 16:22:57.388925 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Id: default Sep 21 16:22:57.388925 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Name: Default Sep 21 16:22:57.388925 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Id: 7246fd0179c24bd88ccdfe0926098412 Sep 21 16:22:57.388925 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Name: tempest-VolumesGetTestJSON-1043750163 Sep 21 16:22:57.388925 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Role: member,reader Sep 21 16:22:57.388925 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Roles: member,reader Sep 21 16:22:57.390352 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/7246fd0179c24bd88ccdfe0926098412"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/7246fd0179c24bd88ccdfe0926098412"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_7246fd0179c24bd88ccdfe0926098412"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/7246fd0179c24bd88ccdfe0926098412"}]}] Sep 21 16:22:57.390352 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant: tempest-VolumesGetTestJSON-1043750163 Sep 21 16:22:57.390352 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Id: 7246fd0179c24bd88ccdfe0926098412 Sep 21 16:22:57.390352 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Name: tempest-VolumesGetTestJSON-1043750163 Sep 21 16:22:57.390352 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User: tempest-VolumesGetTestJSON-1043750163-project Sep 21 16:22:57.390352 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Id: default Sep 21 16:22:57.390352 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Name: Default Sep 21 16:22:57.390352 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Id: 68603c7e79184c1b9fd765bedbeb2fa1 Sep 21 16:22:57.390352 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Name: tempest-VolumesGetTestJSON-1043750163-project Sep 21 16:22:57.390352 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: method: Sep 21 16:22:57.390352 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: exception: Volume e575058b-5e12-40c6-81a0-f9d0246e5543 could not be found. Sep 21 16:22:57.390352 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: action_args: {'id': 'e575058b-5e12-40c6-81a0-f9d0246e5543'} Sep 21 16:22:57.390352 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:22:57.391235 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:22:57.391235 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 21 16:22:57.391235 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 21 16:22:57.391235 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 21 16:22:57.391235 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 21 16:22:57.391235 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 21 16:22:57.391235 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 21 16:22:57.391235 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 21 16:22:57.391235 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 21 16:22:57.391235 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 21 16:22:57.391235 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 21 16:22:57.391235 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 21 16:22:57.391235 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 21 16:22:57.391235 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 21 16:22:57.391235 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 21 16:22:57.391235 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e575058b-5e12-40c6-81a0-f9d0246e5543 could not be found. (HTTP 404) (Request-ID: req-932c827d-53c8-4c17-bf44-be08e52a8bc5) Sep 21 16:22:57.391235 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:22:57.391235 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:22:57.391235 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:22:57.392578 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:22:57.392578 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 21 16:22:57.392578 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 21 16:22:57.392578 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 21 16:22:57.392578 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 21 16:22:57.392578 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 21 16:22:57.392578 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 21 16:22:57.392578 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 21 16:22:57.392578 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 21 16:22:57.392578 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 21 16:22:57.392578 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 21 16:22:57.392578 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 21 16:22:57.392578 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 21 16:22:57.392578 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 21 16:22:57.392578 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 21 16:22:57.392578 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 21 16:22:57.392578 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 21 16:22:57.392578 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 21 16:22:57.392578 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 21 16:22:57.395040 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 21 16:22:57.395040 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 21 16:22:57.395040 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 21 16:22:57.395040 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 21 16:22:57.395040 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e575058b-5e12-40c6-81a0-f9d0246e5543 could not be found. Sep 21 16:22:57.395040 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:22:57.395040 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:22:57.395040 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:22:57.395040 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:22:57.395040 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:22:57.395040 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:22:57.395040 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:22:57.395040 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:22:57.395040 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 21 16:22:57.395040 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 21 16:22:57.395040 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:22:57.395040 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:22:57.395040 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 21 16:22:57.395040 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:22:57.397131 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e575058b-5e12-40c6-81a0-f9d0246e5543 could not be found. Sep 21 16:22:57.397131 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:22:57.397131 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:22:57.397131 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:22:57.397131 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:22:57.397131 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:22:57.397131 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:22:57.397131 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:22:57.397131 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:22:57.397131 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e575058b-5e12-40c6-81a0-f9d0246e5543 could not be found. Sep 21 16:22:57.397131 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:22:57.397131 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-82db205b-0af5-40e0-8529-0fe49715a450 tempest-VolumesGetTestJSON-1043750163 tempest-VolumesGetTestJSON-1043750163-project] Returning 404 to user: Volume e575058b-5e12-40c6-81a0-f9d0246e5543 could not be found. {{(pid=120532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:22:57.397131 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-82db205b-0af5-40e0-8529-0fe49715a450 tempest-VolumesGetTestJSON-1043750163 tempest-VolumesGetTestJSON-1043750163-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/e575058b-5e12-40c6-81a0-f9d0246e5543" status: 404 len: 109 microversion: 2.1 time: 0.099345 Sep 21 16:22:57.397131 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 5/9] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Sep 21 16:22:57 2022] GET /compute/v2.1/os-volumes/e575058b-5e12-40c6-81a0-f9d0246e5543 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 16:22:57.524878 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-24b29caf-e0b7-404a-88b2-0e4e2d6fad11 tempest-VolumesTestJSON-1535337896 tempest-VolumesTestJSON-1535337896-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/70c79bc4-7199-49de-9710-57a471e8a54d" status: 200 len: 351 microversion: 2.1 time: 0.207882 Sep 21 16:22:57.525696 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 5/10] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Sep 21 16:22:57 2022] GET /compute/v2.1/os-volumes/70c79bc4-7199-49de-9710-57a471e8a54d => generated 351 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:22:57.540880 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-e04fce97-4805-4ee6-8b96-ef1968a225e1 tempest-VolumesTestJSON-1535337896 tempest-VolumesTestJSON-1535337896-project] Calling method '.version_select at 0x7fdb89a58b80>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:22:57.820191 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-e04fce97-4805-4ee6-8b96-ef1968a225e1 tempest-VolumesTestJSON-1535337896 tempest-VolumesTestJSON-1535337896-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.284673 Sep 21 16:22:57.830620 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 6/11] 10.222.0.64 () {58 vars in 1134 bytes} [Wed Sep 21 16:22:57 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:22:57.837524 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-bc0b775e-e399-44fb-9e85-8027d5675471 tempest-VolumesTestJSON-1535337896 tempest-VolumesTestJSON-1535337896-project] Calling method '.version_select at 0x7fdb89a605e0>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:22:58.039836 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-bc0b775e-e399-44fb-9e85-8027d5675471 tempest-VolumesTestJSON-1535337896 tempest-VolumesTestJSON-1535337896-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.207377 Sep 21 16:22:58.040446 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 6/12] 10.222.0.64 () {58 vars in 1149 bytes} [Wed Sep 21 16:22:57 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:22:58.063295 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-4d1057d1-2779-46fe-a5fe-d89936e489f4 tempest-VolumesTestJSON-1535337896 tempest-VolumesTestJSON-1535337896-project] Calling method '.version_select at 0x7fdb89a580d0>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:22:58.272111 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-4d1057d1-2779-46fe-a5fe-d89936e489f4 tempest-VolumesTestJSON-1535337896 tempest-VolumesTestJSON-1535337896-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.220611 Sep 21 16:22:58.280776 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 7/13] 10.222.0.64 () {58 vars in 1134 bytes} [Wed Sep 21 16:22:58 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:22:58.285793 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-8640b485-57ae-4e8b-adc7-64c0abe279cb tempest-VolumesTestJSON-1535337896 tempest-VolumesTestJSON-1535337896-project] Calling method '.version_select at 0x7fdb899faca0>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:22:58.473498 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-8640b485-57ae-4e8b-adc7-64c0abe279cb tempest-VolumesTestJSON-1535337896 tempest-VolumesTestJSON-1535337896-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.189693 Sep 21 16:22:58.476464 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 7/14] 10.222.0.64 () {58 vars in 1167 bytes} [Wed Sep 21 16:22:58 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:22:58.489207 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c72917e6-5af3-454c-8d5e-6d799ae932b8 tempest-VolumesTestJSON-1535337896 tempest-VolumesTestJSON-1535337896-project] Calling method '.version_select at 0x7fdb899d6820>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:22:58.729271 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-c72917e6-5af3-454c-8d5e-6d799ae932b8 tempest-VolumesTestJSON-1535337896 tempest-VolumesTestJSON-1535337896-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.243673 Sep 21 16:22:58.730019 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 8/15] 10.222.0.64 () {58 vars in 1170 bytes} [Wed Sep 21 16:22:58 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:22:58.744466 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-980d70fb-5c5f-4264-9cf0-faebcf35b334 tempest-VolumesTestJSON-1535337896 tempest-VolumesTestJSON-1535337896-project] Calling method '.version_select at 0x7fdb89a605e0>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:22:59.024973 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-980d70fb-5c5f-4264-9cf0-faebcf35b334 tempest-VolumesTestJSON-1535337896 tempest-VolumesTestJSON-1535337896-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.284461 Sep 21 16:22:59.025546 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 8/16] 10.222.0.64 () {58 vars in 1155 bytes} [Wed Sep 21 16:22:58 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:22:59.050282 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-bf182454-b56d-4a97-8ae7-a00c018846f6 tempest-VolumesTestJSON-1535337896 tempest-VolumesTestJSON-1535337896-project] Calling method '.version_select at 0x7fdb899d6790>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:22:59.261992 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-bf182454-b56d-4a97-8ae7-a00c018846f6 tempest-VolumesTestJSON-1535337896 tempest-VolumesTestJSON-1535337896-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.218759 Sep 21 16:22:59.262858 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 9/17] 10.222.0.64 () {58 vars in 1188 bytes} [Wed Sep 21 16:22:59 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:22:59.285023 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-eb8ae4e3-ac64-416e-94d4-b1f8e6976f85 tempest-VolumesTestJSON-1535337896 tempest-VolumesTestJSON-1535337896-project] Calling method '.version_select at 0x7fdb899fa0d0>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:22:59.564330 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-eb8ae4e3-ac64-416e-94d4-b1f8e6976f85 tempest-VolumesTestJSON-1535337896 tempest-VolumesTestJSON-1535337896-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.286408 Sep 21 16:22:59.564911 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 9/18] 10.222.0.64 () {58 vars in 1155 bytes} [Wed Sep 21 16:22:59 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:07.063585 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ce9c1245-3b29-4434-919d-2f293a5facd0 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Action: 'create', calling method: .version_select at 0x7fdb899c5af0>, body: {"keypair": {"name": "tempest-keypair-1639095373", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbYNvrSiC+1GbvbyOmHe66Pjgv5u8D8iaARm7dsQSxF723X1e6YAVWt8yhiXxu9sstP6Y9w0J6XaqSuwvaUoTvFiZwz+xvjv2s5hCaP+n+MzF0JcN7JTXZ2QawAyunOdQ=="}} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:23:07.207437 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.quota [None req-ce9c1245-3b29-4434-919d-2f293a5facd0 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Getting quotas for project 0d61f0fe37cf4dc0ba6a2415ddf14518. Resources: {'key_pairs'} {{(pid=120532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 16:23:07.235270 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.quota [None req-ce9c1245-3b29-4434-919d-2f293a5facd0 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Getting quotas for user 617ba5f9896b457f8182f760ed44aa58 and project 0d61f0fe37cf4dc0ba6a2415ddf14518. Resources: {'key_pairs'} {{(pid=120532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 16:23:07.366007 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ce9c1245-3b29-4434-919d-2f293a5facd0 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.995667 Sep 21 16:23:07.368395 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 10/19] 10.222.0.64 () {62 vars in 1200 bytes} [Wed Sep 21 16:23:06 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 999 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 21 16:23:08.417865 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-6b00391a-650a-40e9-a563-dca13cf59955 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-216439134", "imageRef": "600db436-ed6c-41b7-89f7-7dd31852a1a7", "flavorRef": "452", "networks": [{"uuid": "344ca914-11fb-4bad-8d70-9a8cc1fdb1b2"}]}} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:23:08.629522 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.network.neutron [None req-6b00391a-650a-40e9-a563-dca13cf59955 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] validate_networks() for [('344ca914-11fb-4bad-8d70-9a8cc1fdb1b2', None, None, None, None, None)] {{(pid=120531) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 16:23:10.621637 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-12458fa6-b393-405d-8e6d-6f397b858de0 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Action: 'create', calling method: .version_select at 0x7fdb899a7280>, body: {"keypair": {"name": "tempest-keypair-1792611049", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVrFmNSZuJlCTHk0VSOIvtCKcEoO4WpQYEdNDjnrlgSgssG7xlYCtsk7yP5Ne36TLehsNr5sVx93Om0DK/K1b9QMtmVaYVXM0yfDG/Tfh1glNL1YoF8iiCdQiVDHWTizg=="}} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:23:10.685588 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.quota [None req-12458fa6-b393-405d-8e6d-6f397b858de0 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Getting quotas for project ce7a3e77ddf14b48986752434dda6d33. Resources: {'key_pairs'} {{(pid=120532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 16:23:10.705227 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.quota [None req-12458fa6-b393-405d-8e6d-6f397b858de0 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Getting quotas for user b917d84a650f4355a676e315ea039f0e and project ce7a3e77ddf14b48986752434dda6d33. Resources: {'key_pairs'} {{(pid=120532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 16:23:10.783838 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-12458fa6-b393-405d-8e6d-6f397b858de0 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.952935 Sep 21 16:23:10.787093 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 11/20] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Sep 21 16:23:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:23:12.964657 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-6b00391a-650a-40e9-a563-dca13cf59955 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Flavor limits 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 16:23:12.967913 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-6b00391a-650a-40e9-a563-dca13cf59955 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Image limits 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 16:23:12.970079 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-6b00391a-650a-40e9-a563-dca13cf59955 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Flavor pref 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 16:23:12.971033 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-6b00391a-650a-40e9-a563-dca13cf59955 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Image pref 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 16:23:12.972656 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-6b00391a-650a-40e9-a563-dca13cf59955 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 16:23:13.102714 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6b00391a-650a-40e9-a563-dca13cf59955 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:13.131852 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6b00391a-650a-40e9-a563-dca13cf59955 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:13.132653 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6b00391a-650a-40e9-a563-dca13cf59955 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:13.134507 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6b00391a-650a-40e9-a563-dca13cf59955 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:13.135813 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6b00391a-650a-40e9-a563-dca13cf59955 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:13.138320 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6b00391a-650a-40e9-a563-dca13cf59955 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:13.230431 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.quota [None req-6b00391a-650a-40e9-a563-dca13cf59955 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Getting quotas for project b94ef89f42ce4bc9920e9ac5f1c573e4. Resources: {'cores', 'ram', 'instances'} {{(pid=120531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 16:23:13.250617 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.quota [None req-6b00391a-650a-40e9-a563-dca13cf59955 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Getting quotas for user a4f83757d3484a58b89ec39d46effaab and project b94ef89f42ce4bc9920e9ac5f1c573e4. Resources: {'cores', 'ram', 'instances'} {{(pid=120531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 16:23:13.283949 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-6b00391a-650a-40e9-a563-dca13cf59955 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Going to run 1 instances... {{(pid=120531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 16:23:13.296316 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-6b00391a-650a-40e9-a563-dca13cf59955 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] [instance: 62a18317-e115-4326-b942-b6bc791a882a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='600db436-ed6c-41b7-89f7-7dd31852a1a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 16:23:13.535458 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-6b00391a-650a-40e9-a563-dca13cf59955 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.457218 Sep 21 16:23:13.538965 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 10/21] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Sep 21 16:23:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 5463 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 21 16:23:13.561559 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-4fcbfb39-d8d8-4e6c-97d2-271e5a2a58ba tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:13.563062 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-4fcbfb39-d8d8-4e6c-97d2-271e5a2a58ba tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] [instance: 62a18317-e115-4326-b942-b6bc791a882a] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:13.939591 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-4fcbfb39-d8d8-4e6c-97d2-271e5a2a58ba tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f83757d3484a58b89ec39d46effaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94ef89f42ce4bc9920e9ac5f1c573e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:13.998521 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-4fcbfb39-d8d8-4e6c-97d2-271e5a2a58ba tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] 10.222.0.64 "GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a" status: 200 len: 1214 microversion: 2.1 time: 0.440940 Sep 21 16:23:14.001249 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 12/22] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:13 2022] GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a => generated 1214 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:23:15.027008 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-a8c2f8bf-e5ab-4071-af55-2d493a75b2cb tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:15.028306 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-a8c2f8bf-e5ab-4071-af55-2d493a75b2cb tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] [instance: 62a18317-e115-4326-b942-b6bc791a882a] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:15.252320 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-75ae4d45-2558-4de3-a5a4-fcacc5846331 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-525528069", "imageRef": "600db436-ed6c-41b7-89f7-7dd31852a1a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:23:15.440726 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.network.neutron [None req-75ae4d45-2558-4de3-a5a4-fcacc5846331 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] validate_networks() for [('5eaa1fce-f04b-494b-a504-b5b88bc5ecc1', None, None, None, None, None)] {{(pid=120531) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 16:23:15.491248 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a8c2f8bf-e5ab-4071-af55-2d493a75b2cb tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f83757d3484a58b89ec39d46effaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94ef89f42ce4bc9920e9ac5f1c573e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:15.506909 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-a8c2f8bf-e5ab-4071-af55-2d493a75b2cb tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] 10.222.0.64 "GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a" status: 200 len: 1214 microversion: 2.1 time: 0.481175 Sep 21 16:23:15.530827 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 13/23] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:15 2022] GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a => generated 1214 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:23:16.082750 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-f0225797-668e-48f6-a908-c560a1026dd2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Action: 'create', calling method: .version_select at 0x7fdb89922a60>, body: {"keypair": {"name": "tempest-keypair-1382118449", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYBz5prbo3s9XElRkWvikPtTgFZMhRKxzFyY8v18FIP85ejwfjjlY2KEqEIaYf8b+SqtDUVipI8PO8qPE+lz5mOjOPrEWPIQUMYesONa+UkXP6mVcUu4bogVUVrULJxlQ=="}} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:23:16.154596 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.quota [None req-f0225797-668e-48f6-a908-c560a1026dd2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Getting quotas for project 9c326adfa14149e5ae1d4eb45f4807b8. Resources: {'key_pairs'} {{(pid=120532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 16:23:16.176230 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.quota [None req-f0225797-668e-48f6-a908-c560a1026dd2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Getting quotas for user 2e5204475ce7477f9cfeeffed457a445 and project 9c326adfa14149e5ae1d4eb45f4807b8. Resources: {'key_pairs'} {{(pid=120532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 16:23:16.291442 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-f0225797-668e-48f6-a908-c560a1026dd2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.759146 Sep 21 16:23:16.292064 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 14/24] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Sep 21 16:23:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:23:16.328884 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-e4986562-a380-453d-9ba6-310f5e1a1975 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-822116195", "imageRef": "600db436-ed6c-41b7-89f7-7dd31852a1a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6f1a14e1-0882-4675-b49d-c15411eec58b"}], "security_groups": [{"name": "tempest-securitygroup--335067608"}], "key_name": "tempest-keypair-1639095373", "user_data": "}} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:23:17.131490 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.network.neutron [None req-e4986562-a380-453d-9ba6-310f5e1a1975 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] validate_networks() for [('6f1a14e1-0882-4675-b49d-c15411eec58b', None, None, None, None, None)] {{(pid=120532) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 16:23:18.288320 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-75ae4d45-2558-4de3-a5a4-fcacc5846331 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Flavor limits 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 16:23:18.289803 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-75ae4d45-2558-4de3-a5a4-fcacc5846331 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Image limits 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 16:23:18.290700 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-75ae4d45-2558-4de3-a5a4-fcacc5846331 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Flavor pref 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 16:23:18.291344 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-75ae4d45-2558-4de3-a5a4-fcacc5846331 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Image pref 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 16:23:18.291920 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-75ae4d45-2558-4de3-a5a4-fcacc5846331 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 16:23:18.307646 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-75ae4d45-2558-4de3-a5a4-fcacc5846331 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:18.308598 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-75ae4d45-2558-4de3-a5a4-fcacc5846331 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:18.316273 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-75ae4d45-2558-4de3-a5a4-fcacc5846331 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:18.321234 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-75ae4d45-2558-4de3-a5a4-fcacc5846331 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:18.323144 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-75ae4d45-2558-4de3-a5a4-fcacc5846331 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:18.323871 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-75ae4d45-2558-4de3-a5a4-fcacc5846331 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:18.391750 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.quota [None req-75ae4d45-2558-4de3-a5a4-fcacc5846331 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Getting quotas for project b93e202a295d427a85fdaf0209951bd5. Resources: {'cores', 'ram', 'instances'} {{(pid=120531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 16:23:18.409922 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.quota [None req-75ae4d45-2558-4de3-a5a4-fcacc5846331 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Getting quotas for user d2382a6610ae42fa865283ed12dd9982 and project b93e202a295d427a85fdaf0209951bd5. Resources: {'cores', 'ram', 'instances'} {{(pid=120531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 16:23:18.456537 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-75ae4d45-2558-4de3-a5a4-fcacc5846331 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Going to run 1 instances... {{(pid=120531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 16:23:18.467117 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-75ae4d45-2558-4de3-a5a4-fcacc5846331 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='600db436-ed6c-41b7-89f7-7dd31852a1a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 16:23:18.722316 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-75ae4d45-2558-4de3-a5a4-fcacc5846331 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.046217 Sep 21 16:23:18.724444 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 11/25] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Sep 21 16:23:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 4050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 21 16:23:18.739598 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-91855727-c75c-4425-b615-836bed911d07 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:18.740452 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-91855727-c75c-4425-b615-836bed911d07 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] [instance: 62a18317-e115-4326-b942-b6bc791a882a] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:18.800090 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-91855727-c75c-4425-b615-836bed911d07 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:18.800742 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-91855727-c75c-4425-b615-836bed911d07 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:18.807364 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-91855727-c75c-4425-b615-836bed911d07 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:18.808287 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-91855727-c75c-4425-b615-836bed911d07 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:18.809328 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-91855727-c75c-4425-b615-836bed911d07 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:18.809791 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-91855727-c75c-4425-b615-836bed911d07 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:19.903687 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-91855727-c75c-4425-b615-836bed911d07 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f83757d3484a58b89ec39d46effaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94ef89f42ce4bc9920e9ac5f1c573e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:19.953798 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-91855727-c75c-4425-b615-836bed911d07 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] 10.222.0.64 "GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a" status: 200 len: 1284 microversion: 2.1 time: 1.227312 Sep 21 16:23:19.957634 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 12/26] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:18 2022] GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a => generated 1284 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:19.974010 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-dfe745dd-bbd4-4874-aa16-0fe4080e7867 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:19.974658 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-dfe745dd-bbd4-4874-aa16-0fe4080e7867 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:20.216075 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-dfe745dd-bbd4-4874-aa16-0fe4080e7867 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:20.244516 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-dfe745dd-bbd4-4874-aa16-0fe4080e7867 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 200 len: 1221 microversion: 2.1 time: 0.285393 Sep 21 16:23:20.251459 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 13/27] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:19 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 1221 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:20.498913 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-3db476f5-6212-44be-ba14-ed6e24983418 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-914859522", "imageRef": "600db436-ed6c-41b7-89f7-7dd31852a1a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8e8cfcce-7266-4377-accc-1ed5295280a6"}], "security_groups": [{"name": "tempest-securitygroup--680311048"}], "key_name": "tempest-keypair-1792611049", "user_data": "}} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:23:21.025506 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-e4986562-a380-453d-9ba6-310f5e1a1975 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Flavor limits 0:0:0 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 16:23:21.026850 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-e4986562-a380-453d-9ba6-310f5e1a1975 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Image limits 0:0:0 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 16:23:21.028071 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-e4986562-a380-453d-9ba6-310f5e1a1975 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Flavor pref 0:0:0 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 16:23:21.028711 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-e4986562-a380-453d-9ba6-310f5e1a1975 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Image pref 0:0:0 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 16:23:21.029370 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-e4986562-a380-453d-9ba6-310f5e1a1975 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 16:23:21.054456 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e4986562-a380-453d-9ba6-310f5e1a1975 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:21.056183 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e4986562-a380-453d-9ba6-310f5e1a1975 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:21.056660 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e4986562-a380-453d-9ba6-310f5e1a1975 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:21.058980 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e4986562-a380-453d-9ba6-310f5e1a1975 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:21.059784 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e4986562-a380-453d-9ba6-310f5e1a1975 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:21.061890 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e4986562-a380-453d-9ba6-310f5e1a1975 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:21.139579 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.quota [None req-e4986562-a380-453d-9ba6-310f5e1a1975 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Getting quotas for project 0d61f0fe37cf4dc0ba6a2415ddf14518. Resources: {'cores', 'ram', 'instances'} {{(pid=120532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 16:23:21.155898 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.quota [None req-e4986562-a380-453d-9ba6-310f5e1a1975 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Getting quotas for user 617ba5f9896b457f8182f760ed44aa58 and project 0d61f0fe37cf4dc0ba6a2415ddf14518. Resources: {'cores', 'ram', 'instances'} {{(pid=120532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 16:23:21.189455 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-e4986562-a380-453d-9ba6-310f5e1a1975 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Going to run 1 instances... {{(pid=120532) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 16:23:21.201684 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-e4986562-a380-453d-9ba6-310f5e1a1975 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='600db436-ed6c-41b7-89f7-7dd31852a1a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120532) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 16:23:21.364456 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-e4986562-a380-453d-9ba6-310f5e1a1975 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 5.071083 Sep 21 16:23:21.366413 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 15/28] 10.222.0.64 () {62 vars in 1188 bytes} [Wed Sep 21 16:23:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 5074 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 21 16:23:21.374722 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-534b0842-0690-4c7a-89c0-bc6edbefc312 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-410991186", "imageRef": "600db436-ed6c-41b7-89f7-7dd31852a1a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:23:21.429380 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.network.neutron [None req-3db476f5-6212-44be-ba14-ed6e24983418 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] validate_networks() for [('8e8cfcce-7266-4377-accc-1ed5295280a6', None, None, None, None, None)] {{(pid=120531) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 16:23:21.535834 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.network.neutron [None req-534b0842-0690-4c7a-89c0-bc6edbefc312 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] validate_networks() for [('5eaa1fce-f04b-494b-a504-b5b88bc5ecc1', None, None, None, None, None)] {{(pid=120532) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 16:23:24.015045 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-534b0842-0690-4c7a-89c0-bc6edbefc312 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Flavor limits 0:0:0 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 16:23:24.016099 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-534b0842-0690-4c7a-89c0-bc6edbefc312 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Image limits 0:0:0 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 16:23:24.017218 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-534b0842-0690-4c7a-89c0-bc6edbefc312 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Flavor pref 0:0:0 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 16:23:24.017817 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-534b0842-0690-4c7a-89c0-bc6edbefc312 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Image pref 0:0:0 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 16:23:24.018579 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-534b0842-0690-4c7a-89c0-bc6edbefc312 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 16:23:24.045449 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-534b0842-0690-4c7a-89c0-bc6edbefc312 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:24.046171 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-534b0842-0690-4c7a-89c0-bc6edbefc312 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:24.047076 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-534b0842-0690-4c7a-89c0-bc6edbefc312 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:24.050702 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-534b0842-0690-4c7a-89c0-bc6edbefc312 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:24.053280 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-534b0842-0690-4c7a-89c0-bc6edbefc312 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:24.054268 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-534b0842-0690-4c7a-89c0-bc6edbefc312 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:24.137946 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.quota [None req-534b0842-0690-4c7a-89c0-bc6edbefc312 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Getting quotas for project b93e202a295d427a85fdaf0209951bd5. Resources: {'cores', 'ram', 'instances'} {{(pid=120532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 16:23:24.161933 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.quota [None req-534b0842-0690-4c7a-89c0-bc6edbefc312 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Getting quotas for user d2382a6610ae42fa865283ed12dd9982 and project b93e202a295d427a85fdaf0209951bd5. Resources: {'cores', 'ram', 'instances'} {{(pid=120532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 16:23:24.240278 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-534b0842-0690-4c7a-89c0-bc6edbefc312 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Going to run 1 instances... {{(pid=120532) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 16:23:24.266212 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-534b0842-0690-4c7a-89c0-bc6edbefc312 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='600db436-ed6c-41b7-89f7-7dd31852a1a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120532) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 16:23:24.480718 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-534b0842-0690-4c7a-89c0-bc6edbefc312 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.111742 Sep 21 16:23:24.484186 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 16/29] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Sep 21 16:23:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 3117 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 21 16:23:24.512273 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-63bfed6b-fbe0-40ce-9375-e18fb2b22872 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:24.522412 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-63bfed6b-fbe0-40ce-9375-e18fb2b22872 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] [instance: 62a18317-e115-4326-b942-b6bc791a882a] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:24.539885 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-63bfed6b-fbe0-40ce-9375-e18fb2b22872 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:24.559085 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-63bfed6b-fbe0-40ce-9375-e18fb2b22872 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:24.559797 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-63bfed6b-fbe0-40ce-9375-e18fb2b22872 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:24.560751 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-63bfed6b-fbe0-40ce-9375-e18fb2b22872 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:24.564790 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-63bfed6b-fbe0-40ce-9375-e18fb2b22872 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:24.566786 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-63bfed6b-fbe0-40ce-9375-e18fb2b22872 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:27.712291 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-3db476f5-6212-44be-ba14-ed6e24983418 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Flavor limits 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 16:23:27.713447 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-3db476f5-6212-44be-ba14-ed6e24983418 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Image limits 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 16:23:27.714636 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-3db476f5-6212-44be-ba14-ed6e24983418 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Flavor pref 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 16:23:27.715539 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-3db476f5-6212-44be-ba14-ed6e24983418 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Image pref 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 16:23:27.716438 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-3db476f5-6212-44be-ba14-ed6e24983418 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 16:23:27.778031 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3db476f5-6212-44be-ba14-ed6e24983418 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:27.783439 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3db476f5-6212-44be-ba14-ed6e24983418 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:27.784753 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3db476f5-6212-44be-ba14-ed6e24983418 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:27.788181 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3db476f5-6212-44be-ba14-ed6e24983418 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:27.793052 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3db476f5-6212-44be-ba14-ed6e24983418 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:27.794263 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3db476f5-6212-44be-ba14-ed6e24983418 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:27.867586 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-63bfed6b-fbe0-40ce-9375-e18fb2b22872 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f83757d3484a58b89ec39d46effaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94ef89f42ce4bc9920e9ac5f1c573e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:27.929946 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.quota [None req-3db476f5-6212-44be-ba14-ed6e24983418 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Getting quotas for project ce7a3e77ddf14b48986752434dda6d33. Resources: {'cores', 'ram', 'instances'} {{(pid=120531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 16:23:27.951820 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.quota [None req-3db476f5-6212-44be-ba14-ed6e24983418 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Getting quotas for user b917d84a650f4355a676e315ea039f0e and project ce7a3e77ddf14b48986752434dda6d33. Resources: {'cores', 'ram', 'instances'} {{(pid=120531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 16:23:27.956224 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-63bfed6b-fbe0-40ce-9375-e18fb2b22872 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] 10.222.0.64 "GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a" status: 200 len: 1314 microversion: 2.1 time: 3.470524 Sep 21 16:23:27.961285 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 17/30] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:24 2022] GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a => generated 1314 bytes in 3476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:27.986808 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-74f1b97a-ad1e-452e-b43e-390a5e91284b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:28.004041 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-74f1b97a-ad1e-452e-b43e-390a5e91284b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:28.033133 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-3db476f5-6212-44be-ba14-ed6e24983418 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Going to run 1 instances... {{(pid=120531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 16:23:28.055712 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-3db476f5-6212-44be-ba14-ed6e24983418 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='600db436-ed6c-41b7-89f7-7dd31852a1a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 16:23:28.061155 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-74f1b97a-ad1e-452e-b43e-390a5e91284b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:28.070457 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-74f1b97a-ad1e-452e-b43e-390a5e91284b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:28.075659 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-74f1b97a-ad1e-452e-b43e-390a5e91284b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:28.077622 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-74f1b97a-ad1e-452e-b43e-390a5e91284b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:28.082438 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-74f1b97a-ad1e-452e-b43e-390a5e91284b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:28.084450 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-74f1b97a-ad1e-452e-b43e-390a5e91284b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:28.360820 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-3db476f5-6212-44be-ba14-ed6e24983418 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 7.863053 Sep 21 16:23:28.378471 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 14/31] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Sep 21 16:23:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 7889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 21 16:23:28.414531 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-6323e1c3-ad21-418a-9747-7d80f3b7b7f1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:28.423208 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-6323e1c3-ad21-418a-9747-7d80f3b7b7f1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:28.460035 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6323e1c3-ad21-418a-9747-7d80f3b7b7f1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:28.461689 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6323e1c3-ad21-418a-9747-7d80f3b7b7f1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:28.468388 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6323e1c3-ad21-418a-9747-7d80f3b7b7f1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:28.472381 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6323e1c3-ad21-418a-9747-7d80f3b7b7f1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:28.473617 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6323e1c3-ad21-418a-9747-7d80f3b7b7f1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:28.474738 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6323e1c3-ad21-418a-9747-7d80f3b7b7f1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:28.994934 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-6323e1c3-ad21-418a-9747-7d80f3b7b7f1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:29.015175 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-6323e1c3-ad21-418a-9747-7d80f3b7b7f1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1281 microversion: 2.1 time: 0.630039 Sep 21 16:23:29.016525 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 15/32] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:28 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1281 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:29.036550 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-a58baa30-a014-4cf1-b2b7-05c98c9668c1 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:29.041699 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-a58baa30-a014-4cf1-b2b7-05c98c9668c1 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:29.266269 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-a58baa30-a014-4cf1-b2b7-05c98c9668c1 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:29.275933 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-a58baa30-a014-4cf1-b2b7-05c98c9668c1 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77" status: 200 len: 1241 microversion: 2.1 time: 0.257830 Sep 21 16:23:29.284430 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 16/33] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:29 2022] GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 => generated 1241 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:29.311312 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-73e75a8e-8f81-4874-bd5e-5bc8b37f89a2 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:29.317475 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-73e75a8e-8f81-4874-bd5e-5bc8b37f89a2 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] [instance: 62a18317-e115-4326-b942-b6bc791a882a] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:29.341903 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-74f1b97a-ad1e-452e-b43e-390a5e91284b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:29.378447 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-73e75a8e-8f81-4874-bd5e-5bc8b37f89a2 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:29.390082 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-73e75a8e-8f81-4874-bd5e-5bc8b37f89a2 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:29.404647 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-73e75a8e-8f81-4874-bd5e-5bc8b37f89a2 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:29.409423 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-73e75a8e-8f81-4874-bd5e-5bc8b37f89a2 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:29.414118 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-73e75a8e-8f81-4874-bd5e-5bc8b37f89a2 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:29.419753 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-73e75a8e-8f81-4874-bd5e-5bc8b37f89a2 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:29.425181 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-74f1b97a-ad1e-452e-b43e-390a5e91284b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:29.445975 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-74f1b97a-ad1e-452e-b43e-390a5e91284b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:29.451793 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-74f1b97a-ad1e-452e-b43e-390a5e91284b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1339 microversion: 2.20 time: 1.486237 Sep 21 16:23:29.465669 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 18/34] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:23:27 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1339 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:23:29.520255 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-223dd3c4-219e-419a-a330-823d1e1e012c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1905557479", "imageRef": "600db436-ed6c-41b7-89f7-7dd31852a1a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "527f5b0e-37ca-4da6-8599-53723996567f"}], "security_groups": [{"name": "tempest-securitygroup--1112302831"}], "key_name": "tempest-keypair-1382118449", "user_data": "}} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:23:30.485196 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.network.neutron [None req-223dd3c4-219e-419a-a330-823d1e1e012c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] validate_networks() for [('527f5b0e-37ca-4da6-8599-53723996567f', None, None, None, None, None)] {{(pid=120532) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 16:23:30.826440 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-73e75a8e-8f81-4874-bd5e-5bc8b37f89a2 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f83757d3484a58b89ec39d46effaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94ef89f42ce4bc9920e9ac5f1c573e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:30.854338 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-73e75a8e-8f81-4874-bd5e-5bc8b37f89a2 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] 10.222.0.64 "GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a" status: 200 len: 1314 microversion: 2.1 time: 1.561659 Sep 21 16:23:30.858734 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 17/35] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:29 2022] GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a => generated 1314 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:30.878294 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-922cab6e-241b-4e53-a467-a74845a234e6 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:30.880207 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-922cab6e-241b-4e53-a467-a74845a234e6 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:30.915288 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-922cab6e-241b-4e53-a467-a74845a234e6 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:30.920261 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-922cab6e-241b-4e53-a467-a74845a234e6 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:30.924222 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-922cab6e-241b-4e53-a467-a74845a234e6 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:30.927214 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-922cab6e-241b-4e53-a467-a74845a234e6 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:30.929374 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-922cab6e-241b-4e53-a467-a74845a234e6 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:30.931052 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-922cab6e-241b-4e53-a467-a74845a234e6 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:31.769866 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-922cab6e-241b-4e53-a467-a74845a234e6 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:31.804404 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-922cab6e-241b-4e53-a467-a74845a234e6 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1279 microversion: 2.1 time: 0.932586 Sep 21 16:23:31.805618 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 18/36] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:30 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1279 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:31.895634 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-a00c9928-3062-4033-add9-a7fb282efd5b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:31.902424 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-a00c9928-3062-4033-add9-a7fb282efd5b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:31.930819 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a00c9928-3062-4033-add9-a7fb282efd5b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:31.932486 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a00c9928-3062-4033-add9-a7fb282efd5b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:31.933895 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a00c9928-3062-4033-add9-a7fb282efd5b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:31.935889 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a00c9928-3062-4033-add9-a7fb282efd5b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:31.937443 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a00c9928-3062-4033-add9-a7fb282efd5b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:31.938588 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a00c9928-3062-4033-add9-a7fb282efd5b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:32.856845 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-a00c9928-3062-4033-add9-a7fb282efd5b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:32.876565 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-a00c9928-3062-4033-add9-a7fb282efd5b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77" status: 200 len: 1293 microversion: 2.1 time: 1.055805 Sep 21 16:23:32.887439 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 19/37] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:31 2022] GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 => generated 1293 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:32.906825 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-489d0293-70c3-428a-9256-e1b6c2487998 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:32.908476 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-489d0293-70c3-428a-9256-e1b6c2487998 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:32.924243 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-489d0293-70c3-428a-9256-e1b6c2487998 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:32.926893 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-489d0293-70c3-428a-9256-e1b6c2487998 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:32.927842 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-489d0293-70c3-428a-9256-e1b6c2487998 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:32.935291 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-489d0293-70c3-428a-9256-e1b6c2487998 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:32.935846 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-489d0293-70c3-428a-9256-e1b6c2487998 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:32.942923 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-489d0293-70c3-428a-9256-e1b6c2487998 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:33.257550 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-489d0293-70c3-428a-9256-e1b6c2487998 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:33.276760 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-489d0293-70c3-428a-9256-e1b6c2487998 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:33.278506 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-489d0293-70c3-428a-9256-e1b6c2487998 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:33.279945 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-489d0293-70c3-428a-9256-e1b6c2487998 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1339 microversion: 2.20 time: 0.391118 Sep 21 16:23:33.284285 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 20/38] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:23:32 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1339 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:23:33.289710 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-933f384a-56c4-49ef-9207-8dc07bf8ef79 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:33.290420 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-933f384a-56c4-49ef-9207-8dc07bf8ef79 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] [instance: 62a18317-e115-4326-b942-b6bc791a882a] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:33.315011 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-933f384a-56c4-49ef-9207-8dc07bf8ef79 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:33.315667 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-933f384a-56c4-49ef-9207-8dc07bf8ef79 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:33.316163 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-933f384a-56c4-49ef-9207-8dc07bf8ef79 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:33.317048 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-933f384a-56c4-49ef-9207-8dc07bf8ef79 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:33.317698 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-933f384a-56c4-49ef-9207-8dc07bf8ef79 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:33.318381 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-933f384a-56c4-49ef-9207-8dc07bf8ef79 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:34.080745 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell0:SELECT=4 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:34.109008 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-933f384a-56c4-49ef-9207-8dc07bf8ef79 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f83757d3484a58b89ec39d46effaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94ef89f42ce4bc9920e9ac5f1c573e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:34.129550 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-933f384a-56c4-49ef-9207-8dc07bf8ef79 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] 10.222.0.64 "GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a" status: 200 len: 1314 microversion: 2.1 time: 0.843539 Sep 21 16:23:34.162613 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 21/39] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:33 2022] GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a => generated 1314 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:34.180164 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-1ffce895-9066-4c78-8eb9-b0f73cf401c5 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:34.181082 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-1ffce895-9066-4c78-8eb9-b0f73cf401c5 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:34.189283 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1ffce895-9066-4c78-8eb9-b0f73cf401c5 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:34.190093 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1ffce895-9066-4c78-8eb9-b0f73cf401c5 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:34.190853 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1ffce895-9066-4c78-8eb9-b0f73cf401c5 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:34.193508 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell0:SELECT=28 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:34.195525 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1ffce895-9066-4c78-8eb9-b0f73cf401c5 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:34.196426 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1ffce895-9066-4c78-8eb9-b0f73cf401c5 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:34.202908 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1ffce895-9066-4c78-8eb9-b0f73cf401c5 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:34.702032 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-223dd3c4-219e-419a-a330-823d1e1e012c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Flavor limits 0:0:0 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 16:23:34.702791 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-223dd3c4-219e-419a-a330-823d1e1e012c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Image limits 0:0:0 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 16:23:34.703487 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-223dd3c4-219e-419a-a330-823d1e1e012c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Flavor pref 0:0:0 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 16:23:34.704128 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-223dd3c4-219e-419a-a330-823d1e1e012c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Image pref 0:0:0 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 16:23:34.704712 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-223dd3c4-219e-419a-a330-823d1e1e012c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 16:23:34.727886 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-223dd3c4-219e-419a-a330-823d1e1e012c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:34.728395 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-223dd3c4-219e-419a-a330-823d1e1e012c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:34.728837 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-223dd3c4-219e-419a-a330-823d1e1e012c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:34.730882 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-223dd3c4-219e-419a-a330-823d1e1e012c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:34.742909 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-223dd3c4-219e-419a-a330-823d1e1e012c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:34.743725 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-223dd3c4-219e-419a-a330-823d1e1e012c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:34.864797 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.quota [None req-223dd3c4-219e-419a-a330-823d1e1e012c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Getting quotas for project 9c326adfa14149e5ae1d4eb45f4807b8. Resources: {'cores', 'ram', 'instances'} {{(pid=120532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 16:23:34.902671 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.quota [None req-223dd3c4-219e-419a-a330-823d1e1e012c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Getting quotas for user 2e5204475ce7477f9cfeeffed457a445 and project 9c326adfa14149e5ae1d4eb45f4807b8. Resources: {'cores', 'ram', 'instances'} {{(pid=120532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 16:23:35.006931 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-223dd3c4-219e-419a-a330-823d1e1e012c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Going to run 1 instances... {{(pid=120532) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 16:23:35.021781 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-223dd3c4-219e-419a-a330-823d1e1e012c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='600db436-ed6c-41b7-89f7-7dd31852a1a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120532) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 16:23:35.251690 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:35.435731 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-223dd3c4-219e-419a-a330-823d1e1e012c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.965344 Sep 21 16:23:35.437614 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 19/40] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Sep 21 16:23:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 5970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 21 16:23:36.460928 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-f5adbe99-b5a2-4746-abd1-66e43eaaefe0 req-92aed372-3047-4401-a10c-4709d30611b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62a18317-e115-4326-b942-b6bc791a882a", "tag": "2f918381-0144-4a84-9f9f-e5a972f31ab9"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:23:36.508135 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-f5adbe99-b5a2-4746-abd1-66e43eaaefe0 req-92aed372-3047-4401-a10c-4709d30611b0 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:36.517877 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-f5adbe99-b5a2-4746-abd1-66e43eaaefe0 req-92aed372-3047-4401-a10c-4709d30611b0 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:36.518574 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-f5adbe99-b5a2-4746-abd1-66e43eaaefe0 req-92aed372-3047-4401-a10c-4709d30611b0 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:36.619421 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-1ffce895-9066-4c78-8eb9-b0f73cf401c5 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:36.621069 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-f5adbe99-b5a2-4746-abd1-66e43eaaefe0 req-92aed372-3047-4401-a10c-4709d30611b0 service nova] Creating event network-changed:2f918381-0144-4a84-9f9f-e5a972f31ab9 for instance 62a18317-e115-4326-b942-b6bc791a882a on hv-cinder-85862 Sep 21 16:23:36.621271 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-f5adbe99-b5a2-4746-abd1-66e43eaaefe0 req-92aed372-3047-4401-a10c-4709d30611b0 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120532) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 21 16:23:36.628568 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-f5adbe99-b5a2-4746-abd1-66e43eaaefe0 req-92aed372-3047-4401-a10c-4709d30611b0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120532) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 21 16:23:36.631526 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cd423015-7872-4794-a3e0-83bf9691c618 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:36.634823 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cd423015-7872-4794-a3e0-83bf9691c618 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:36.638687 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cd423015-7872-4794-a3e0-83bf9691c618 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:36.640391 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cd423015-7872-4794-a3e0-83bf9691c618 None None] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:36.642910 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cd423015-7872-4794-a3e0-83bf9691c618 None None] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:36.644929 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cd423015-7872-4794-a3e0-83bf9691c618 None None] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:36.664969 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-1ffce895-9066-4c78-8eb9-b0f73cf401c5 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1321 microversion: 2.1 time: 2.500787 Sep 21 16:23:36.716294 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.compute.rpcapi [None req-cd423015-7872-4794-a3e0-83bf9691c618 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 21 16:23:36.717024 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 22/41] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:34 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1321 bytes in 2553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:36.720066 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cd423015-7872-4794-a3e0-83bf9691c618 None None] Releasing lock "compute-rpcapi-router" {{(pid=120532) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 21 16:23:36.740532 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-a5f202c2-2703-423c-9afc-820e3c097663 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:36.742409 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-a5f202c2-2703-423c-9afc-820e3c097663 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:36.780212 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a5f202c2-2703-423c-9afc-820e3c097663 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:36.780212 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a5f202c2-2703-423c-9afc-820e3c097663 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:36.780817 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-cd423015-7872-4794-a3e0-83bf9691c618 None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.333189 Sep 21 16:23:36.780924 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a5f202c2-2703-423c-9afc-820e3c097663 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:36.781013 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 20/42] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:23:36.781103 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a5f202c2-2703-423c-9afc-820e3c097663 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:36.781103 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a5f202c2-2703-423c-9afc-820e3c097663 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:36.781103 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a5f202c2-2703-423c-9afc-820e3c097663 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:36.811788 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-b3d64eee-5171-46a7-9cc0-0f2c4beea9f7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:36.816435 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-b3d64eee-5171-46a7-9cc0-0f2c4beea9f7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:36.848544 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b3d64eee-5171-46a7-9cc0-0f2c4beea9f7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:36.852995 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b3d64eee-5171-46a7-9cc0-0f2c4beea9f7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:36.854275 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b3d64eee-5171-46a7-9cc0-0f2c4beea9f7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:36.856061 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b3d64eee-5171-46a7-9cc0-0f2c4beea9f7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:36.856947 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b3d64eee-5171-46a7-9cc0-0f2c4beea9f7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:36.861035 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b3d64eee-5171-46a7-9cc0-0f2c4beea9f7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:37.216823 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-a5f202c2-2703-423c-9afc-820e3c097663 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:37.255061 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-a5f202c2-2703-423c-9afc-820e3c097663 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77" status: 200 len: 1299 microversion: 2.1 time: 0.535528 Sep 21 16:23:37.263516 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 23/43] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:36 2022] GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 => generated 1299 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:37.306104 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-7e11636c-6187-4a3a-ba57-faddd07fce44 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:37.307608 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-7e11636c-6187-4a3a-ba57-faddd07fce44 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] [instance: 62a18317-e115-4326-b942-b6bc791a882a] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:37.355778 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7e11636c-6187-4a3a-ba57-faddd07fce44 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:37.356840 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7e11636c-6187-4a3a-ba57-faddd07fce44 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:37.357768 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7e11636c-6187-4a3a-ba57-faddd07fce44 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:37.359190 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7e11636c-6187-4a3a-ba57-faddd07fce44 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:37.373440 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7e11636c-6187-4a3a-ba57-faddd07fce44 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:37.379607 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7e11636c-6187-4a3a-ba57-faddd07fce44 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:37.846974 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell0:SELECT=6 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:38.267678 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-b3d64eee-5171-46a7-9cc0-0f2c4beea9f7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:38.324606 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-b3d64eee-5171-46a7-9cc0-0f2c4beea9f7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:38.336246 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-b3d64eee-5171-46a7-9cc0-0f2c4beea9f7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:38.343992 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-b3d64eee-5171-46a7-9cc0-0f2c4beea9f7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1406 microversion: 2.20 time: 1.564612 Sep 21 16:23:38.367511 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 21/44] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:23:36 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1406 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:23:38.378678 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-650db513-dc43-41a4-82b3-1807bd123c80 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:38.381511 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-650db513-dc43-41a4-82b3-1807bd123c80 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:38.397281 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-650db513-dc43-41a4-82b3-1807bd123c80 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:38.399905 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-650db513-dc43-41a4-82b3-1807bd123c80 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:38.401986 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-650db513-dc43-41a4-82b3-1807bd123c80 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:38.407640 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-650db513-dc43-41a4-82b3-1807bd123c80 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:38.408430 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-650db513-dc43-41a4-82b3-1807bd123c80 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:38.409031 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-650db513-dc43-41a4-82b3-1807bd123c80 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:38.823987 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-650db513-dc43-41a4-82b3-1807bd123c80 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:38.867302 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-650db513-dc43-41a4-82b3-1807bd123c80 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1290 microversion: 2.1 time: 0.489622 Sep 21 16:23:38.871462 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 22/45] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:38 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1290 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:38.935516 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-7e11636c-6187-4a3a-ba57-faddd07fce44 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f83757d3484a58b89ec39d46effaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94ef89f42ce4bc9920e9ac5f1c573e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:38.945571 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=65 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:38.946086 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-af09f5aa-2247-40eb-8e04-8474ba6d7c25 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:38.949780 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-af09f5aa-2247-40eb-8e04-8474ba6d7c25 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:38.981292 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-af09f5aa-2247-40eb-8e04-8474ba6d7c25 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:38.981818 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-7e11636c-6187-4a3a-ba57-faddd07fce44 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] 10.222.0.64 "GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a" status: 200 len: 1314 microversion: 2.1 time: 1.714035 Sep 21 16:23:38.986668 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 24/46] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:37 2022] GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a => generated 1314 bytes in 1723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:38.987030 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-af09f5aa-2247-40eb-8e04-8474ba6d7c25 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:38.990572 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-af09f5aa-2247-40eb-8e04-8474ba6d7c25 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:38.992377 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-af09f5aa-2247-40eb-8e04-8474ba6d7c25 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:38.997902 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-af09f5aa-2247-40eb-8e04-8474ba6d7c25 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:39.000613 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-af09f5aa-2247-40eb-8e04-8474ba6d7c25 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:39.025225 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-98566815-a938-4274-a148-9305062cdfe4 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:39.031994 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-98566815-a938-4274-a148-9305062cdfe4 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:39.060130 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=9 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:39.088995 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-98566815-a938-4274-a148-9305062cdfe4 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:39.095416 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-98566815-a938-4274-a148-9305062cdfe4 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:39.101255 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-98566815-a938-4274-a148-9305062cdfe4 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:39.112439 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-98566815-a938-4274-a148-9305062cdfe4 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:39.121635 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-98566815-a938-4274-a148-9305062cdfe4 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:39.124619 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-98566815-a938-4274-a148-9305062cdfe4 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:39.329926 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell0:SELECT=22 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:40.190351 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-98566815-a938-4274-a148-9305062cdfe4 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:40.224055 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-98566815-a938-4274-a148-9305062cdfe4 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77" status: 200 len: 1299 microversion: 2.1 time: 1.231630 Sep 21 16:23:40.239548 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 25/47] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:38 2022] GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 => generated 1299 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:40.264308 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-af09f5aa-2247-40eb-8e04-8474ba6d7c25 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:40.281763 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-af09f5aa-2247-40eb-8e04-8474ba6d7c25 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1321 microversion: 2.1 time: 1.380996 Sep 21 16:23:40.282855 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-fe43664d-4e26-42fc-be0c-3729d7931bc1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:40.285026 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 23/48] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:38 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1321 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:40.285850 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-fe43664d-4e26-42fc-be0c-3729d7931bc1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:40.296830 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-5bdeedfa-c3fb-43a7-85f4-0efbfd9ca65a req-836a32cd-e784-4fbe-9b59-27b6e25c1b57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f563aac-6055-4b77-b3bb-894ed14c1f64", "tag": "252450c8-e7d3-467d-be6e-17b527b01bb8"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:23:40.332237 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fe43664d-4e26-42fc-be0c-3729d7931bc1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:40.337304 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fe43664d-4e26-42fc-be0c-3729d7931bc1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:40.338920 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fe43664d-4e26-42fc-be0c-3729d7931bc1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:40.341710 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fe43664d-4e26-42fc-be0c-3729d7931bc1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:40.343523 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fe43664d-4e26-42fc-be0c-3729d7931bc1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:40.351382 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fe43664d-4e26-42fc-be0c-3729d7931bc1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:40.370741 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-5bdeedfa-c3fb-43a7-85f4-0efbfd9ca65a req-836a32cd-e784-4fbe-9b59-27b6e25c1b57 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:40.373530 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-5bdeedfa-c3fb-43a7-85f4-0efbfd9ca65a req-836a32cd-e784-4fbe-9b59-27b6e25c1b57 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:40.377236 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-5bdeedfa-c3fb-43a7-85f4-0efbfd9ca65a req-836a32cd-e784-4fbe-9b59-27b6e25c1b57 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:40.457950 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-5bdeedfa-c3fb-43a7-85f4-0efbfd9ca65a req-836a32cd-e784-4fbe-9b59-27b6e25c1b57 service nova] Creating event network-changed:252450c8-e7d3-467d-be6e-17b527b01bb8 for instance 5f563aac-6055-4b77-b3bb-894ed14c1f64 on hv-cinder-85862 Sep 21 16:23:40.476782 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-5bdeedfa-c3fb-43a7-85f4-0efbfd9ca65a req-836a32cd-e784-4fbe-9b59-27b6e25c1b57 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186796 Sep 21 16:23:40.484661 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 24/49] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:23:40.517065 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-737596e5-016d-4606-99dc-727aeab9c87b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:40.526509 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-737596e5-016d-4606-99dc-727aeab9c87b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:40.564893 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-737596e5-016d-4606-99dc-727aeab9c87b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:40.568653 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-737596e5-016d-4606-99dc-727aeab9c87b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:40.572747 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-737596e5-016d-4606-99dc-727aeab9c87b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:40.575076 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-737596e5-016d-4606-99dc-727aeab9c87b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:40.576772 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-737596e5-016d-4606-99dc-727aeab9c87b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:40.577972 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-737596e5-016d-4606-99dc-727aeab9c87b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:40.853466 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-737596e5-016d-4606-99dc-727aeab9c87b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:40.892387 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-737596e5-016d-4606-99dc-727aeab9c87b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1296 microversion: 2.1 time: 0.398033 Sep 21 16:23:40.910273 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 25/50] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:40 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1296 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:40.937218 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-5cc76677-2339-4d70-9863-3b397777ce02 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:40.938728 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-5cc76677-2339-4d70-9863-3b397777ce02 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] [instance: 62a18317-e115-4326-b942-b6bc791a882a] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:40.962082 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5cc76677-2339-4d70-9863-3b397777ce02 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:40.965989 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5cc76677-2339-4d70-9863-3b397777ce02 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:40.968792 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5cc76677-2339-4d70-9863-3b397777ce02 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:40.969768 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5cc76677-2339-4d70-9863-3b397777ce02 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:40.973722 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5cc76677-2339-4d70-9863-3b397777ce02 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:40.974445 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5cc76677-2339-4d70-9863-3b397777ce02 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:41.447148 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5cc76677-2339-4d70-9863-3b397777ce02 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f83757d3484a58b89ec39d46effaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94ef89f42ce4bc9920e9ac5f1c573e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:41.456485 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-5cc76677-2339-4d70-9863-3b397777ce02 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] 10.222.0.64 "GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a" status: 200 len: 1314 microversion: 2.1 time: 0.539373 Sep 21 16:23:41.457096 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 26/51] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:40 2022] GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a => generated 1314 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:41.479387 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-36e7f3ca-6e08-4643-bb18-3e835df498e3 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:41.482233 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-36e7f3ca-6e08-4643-bb18-3e835df498e3 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:41.502547 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-36e7f3ca-6e08-4643-bb18-3e835df498e3 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:41.504520 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-36e7f3ca-6e08-4643-bb18-3e835df498e3 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:41.505618 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-36e7f3ca-6e08-4643-bb18-3e835df498e3 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:41.509100 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-36e7f3ca-6e08-4643-bb18-3e835df498e3 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:41.511031 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-36e7f3ca-6e08-4643-bb18-3e835df498e3 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:41.512752 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-36e7f3ca-6e08-4643-bb18-3e835df498e3 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:41.862801 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-36e7f3ca-6e08-4643-bb18-3e835df498e3 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:41.888105 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-36e7f3ca-6e08-4643-bb18-3e835df498e3 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77" status: 200 len: 1366 microversion: 2.1 time: 0.423735 Sep 21 16:23:41.889969 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 27/52] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:41 2022] GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 => generated 1366 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:41.903813 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-95f553d2-b277-4036-98f3-76b8308cb648 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:41.906385 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-95f553d2-b277-4036-98f3-76b8308cb648 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:41.920852 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-95f553d2-b277-4036-98f3-76b8308cb648 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:41.921729 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-95f553d2-b277-4036-98f3-76b8308cb648 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:41.922833 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-95f553d2-b277-4036-98f3-76b8308cb648 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:41.924527 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-95f553d2-b277-4036-98f3-76b8308cb648 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:41.925970 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-95f553d2-b277-4036-98f3-76b8308cb648 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:41.928185 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-95f553d2-b277-4036-98f3-76b8308cb648 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:42.018077 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-fe43664d-4e26-42fc-be0c-3729d7931bc1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:42.031864 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-fe43664d-4e26-42fc-be0c-3729d7931bc1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:42.036611 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-fe43664d-4e26-42fc-be0c-3729d7931bc1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:42.040811 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-fe43664d-4e26-42fc-be0c-3729d7931bc1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1406 microversion: 2.20 time: 1.794815 Sep 21 16:23:42.054985 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 26/53] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:23:40 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1406 bytes in 1814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:23:42.067343 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-509e2670-bee9-4192-9889-30fed07b5569 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:42.068133 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-509e2670-bee9-4192-9889-30fed07b5569 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:42.076462 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-509e2670-bee9-4192-9889-30fed07b5569 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:42.077162 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-509e2670-bee9-4192-9889-30fed07b5569 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:42.077701 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-509e2670-bee9-4192-9889-30fed07b5569 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:42.079068 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-509e2670-bee9-4192-9889-30fed07b5569 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:42.079823 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-509e2670-bee9-4192-9889-30fed07b5569 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:42.080386 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-509e2670-bee9-4192-9889-30fed07b5569 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:42.241367 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-95f553d2-b277-4036-98f3-76b8308cb648 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:42.269763 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-95f553d2-b277-4036-98f3-76b8308cb648 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1321 microversion: 2.1 time: 0.378087 Sep 21 16:23:42.279847 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 28/54] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:41 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1321 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:42.503329 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-a60271ef-d3f6-4c3d-aa46-4a2d3c383624 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:42.504357 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-a60271ef-d3f6-4c3d-aa46-4a2d3c383624 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] [instance: 62a18317-e115-4326-b942-b6bc791a882a] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:42.522632 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a60271ef-d3f6-4c3d-aa46-4a2d3c383624 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:42.522814 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a60271ef-d3f6-4c3d-aa46-4a2d3c383624 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:42.523263 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a60271ef-d3f6-4c3d-aa46-4a2d3c383624 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:42.528705 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a60271ef-d3f6-4c3d-aa46-4a2d3c383624 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:42.529332 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a60271ef-d3f6-4c3d-aa46-4a2d3c383624 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:42.529782 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a60271ef-d3f6-4c3d-aa46-4a2d3c383624 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:42.708506 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-509e2670-bee9-4192-9889-30fed07b5569 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:42.717391 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-509e2670-bee9-4192-9889-30fed07b5569 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1296 microversion: 2.1 time: 0.661074 Sep 21 16:23:42.717984 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 27/55] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:42 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1296 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:42.919646 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-8fc425eb-10e4-486c-a0d4-513f6f7636d5 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:42.923793 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-8fc425eb-10e4-486c-a0d4-513f6f7636d5 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:42.935515 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8fc425eb-10e4-486c-a0d4-513f6f7636d5 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:42.949612 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8fc425eb-10e4-486c-a0d4-513f6f7636d5 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:42.952109 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8fc425eb-10e4-486c-a0d4-513f6f7636d5 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:42.953138 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8fc425eb-10e4-486c-a0d4-513f6f7636d5 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:42.954067 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8fc425eb-10e4-486c-a0d4-513f6f7636d5 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:42.956566 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8fc425eb-10e4-486c-a0d4-513f6f7636d5 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:43.067178 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a60271ef-d3f6-4c3d-aa46-4a2d3c383624 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f83757d3484a58b89ec39d46effaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94ef89f42ce4bc9920e9ac5f1c573e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:43.080036 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-a60271ef-d3f6-4c3d-aa46-4a2d3c383624 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] 10.222.0.64 "GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a" status: 200 len: 1314 microversion: 2.1 time: 0.580727 Sep 21 16:23:43.085420 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 29/56] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:42 2022] GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a => generated 1314 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:23:43.105439 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-9e049575-41a5-4e10-bd7f-32c6f4c942a3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:43.106807 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-9e049575-41a5-4e10-bd7f-32c6f4c942a3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:43.124632 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9e049575-41a5-4e10-bd7f-32c6f4c942a3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:43.126669 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9e049575-41a5-4e10-bd7f-32c6f4c942a3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:43.127931 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9e049575-41a5-4e10-bd7f-32c6f4c942a3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:43.129455 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9e049575-41a5-4e10-bd7f-32c6f4c942a3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:43.130681 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9e049575-41a5-4e10-bd7f-32c6f4c942a3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:43.132105 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9e049575-41a5-4e10-bd7f-32c6f4c942a3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:43.605876 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-9e049575-41a5-4e10-bd7f-32c6f4c942a3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:43.640146 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-9e049575-41a5-4e10-bd7f-32c6f4c942a3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:43.648505 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-9e049575-41a5-4e10-bd7f-32c6f4c942a3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:43.658531 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-9e049575-41a5-4e10-bd7f-32c6f4c942a3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1406 microversion: 2.20 time: 0.571019 Sep 21 16:23:43.659873 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 30/57] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:23:43 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1406 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:23:43.684906 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-dbc1277c-5de5-4bb5-8b90-c4c25f8cbf7d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:43.692745 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-dbc1277c-5de5-4bb5-8b90-c4c25f8cbf7d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:43.732526 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dbc1277c-5de5-4bb5-8b90-c4c25f8cbf7d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:43.733408 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dbc1277c-5de5-4bb5-8b90-c4c25f8cbf7d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:43.734240 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dbc1277c-5de5-4bb5-8b90-c4c25f8cbf7d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:43.740612 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dbc1277c-5de5-4bb5-8b90-c4c25f8cbf7d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:43.742195 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dbc1277c-5de5-4bb5-8b90-c4c25f8cbf7d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:43.743037 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dbc1277c-5de5-4bb5-8b90-c4c25f8cbf7d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:44.397592 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-8fc425eb-10e4-486c-a0d4-513f6f7636d5 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:44.423014 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-8fc425eb-10e4-486c-a0d4-513f6f7636d5 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77" status: 200 len: 1366 microversion: 2.1 time: 1.508001 Sep 21 16:23:44.431089 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 28/58] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:42 2022] GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 => generated 1366 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:44.674220 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-ec7cb4a0-2bb9-4468-8f51-194630ce504d req-03ecf911-b42c-4582-b454-3ff562663aec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ece03bf-7582-46b8-8966-0f46577abe14", "tag": "bfec785e-5f96-4772-937f-5c90aabd9fb8"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:23:44.697475 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-ec7cb4a0-2bb9-4468-8f51-194630ce504d req-03ecf911-b42c-4582-b454-3ff562663aec service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:44.698406 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-ec7cb4a0-2bb9-4468-8f51-194630ce504d req-03ecf911-b42c-4582-b454-3ff562663aec service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:44.699295 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-ec7cb4a0-2bb9-4468-8f51-194630ce504d req-03ecf911-b42c-4582-b454-3ff562663aec service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:44.736405 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-ec7cb4a0-2bb9-4468-8f51-194630ce504d req-03ecf911-b42c-4582-b454-3ff562663aec service nova] Creating event network-changed:bfec785e-5f96-4772-937f-5c90aabd9fb8 for instance 0ece03bf-7582-46b8-8966-0f46577abe14 on hv-cinder-85862 Sep 21 16:23:44.737312 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-ec7cb4a0-2bb9-4468-8f51-194630ce504d req-03ecf911-b42c-4582-b454-3ff562663aec service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120531) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 21 16:23:44.737856 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-ec7cb4a0-2bb9-4468-8f51-194630ce504d req-03ecf911-b42c-4582-b454-3ff562663aec service nova] Acquired lock "compute-rpcapi-router" {{(pid=120531) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 21 16:23:44.739192 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e95261f3-a638-4b2b-9194-d27402e642e0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:44.739906 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e95261f3-a638-4b2b-9194-d27402e642e0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:44.740495 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e95261f3-a638-4b2b-9194-d27402e642e0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:44.741423 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e95261f3-a638-4b2b-9194-d27402e642e0 None None] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:44.742150 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e95261f3-a638-4b2b-9194-d27402e642e0 None None] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:44.742736 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e95261f3-a638-4b2b-9194-d27402e642e0 None None] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:44.756069 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.compute.rpcapi [None req-e95261f3-a638-4b2b-9194-d27402e642e0 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 21 16:23:44.757266 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e95261f3-a638-4b2b-9194-d27402e642e0 None None] Releasing lock "compute-rpcapi-router" {{(pid=120531) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 21 16:23:44.789078 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-e95261f3-a638-4b2b-9194-d27402e642e0 None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.355221 Sep 21 16:23:44.791608 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 29/59] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:23:44.811053 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-f98fbb3f-ad22-4152-9ef9-56e78d2b9769 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:44.813171 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-f98fbb3f-ad22-4152-9ef9-56e78d2b9769 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:44.838929 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f98fbb3f-ad22-4152-9ef9-56e78d2b9769 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:44.839534 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f98fbb3f-ad22-4152-9ef9-56e78d2b9769 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:44.842386 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f98fbb3f-ad22-4152-9ef9-56e78d2b9769 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:44.843249 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f98fbb3f-ad22-4152-9ef9-56e78d2b9769 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:44.843735 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f98fbb3f-ad22-4152-9ef9-56e78d2b9769 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:44.846514 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f98fbb3f-ad22-4152-9ef9-56e78d2b9769 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:44.966625 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell0:SELECT=6 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:44.984211 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-dbc1277c-5de5-4bb5-8b90-c4c25f8cbf7d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:45.011878 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-dbc1277c-5de5-4bb5-8b90-c4c25f8cbf7d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1321 microversion: 2.1 time: 1.348388 Sep 21 16:23:45.032750 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 31/60] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:43 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1321 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:45.052746 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c251b851-3a9e-4932-88de-5c7dbbd1c5a0 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:45.053575 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-c251b851-3a9e-4932-88de-5c7dbbd1c5a0 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] [instance: 62a18317-e115-4326-b942-b6bc791a882a] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:45.081929 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c251b851-3a9e-4932-88de-5c7dbbd1c5a0 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:45.084104 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c251b851-3a9e-4932-88de-5c7dbbd1c5a0 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:45.085402 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c251b851-3a9e-4932-88de-5c7dbbd1c5a0 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:45.087796 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c251b851-3a9e-4932-88de-5c7dbbd1c5a0 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:45.091177 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c251b851-3a9e-4932-88de-5c7dbbd1c5a0 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:45.095965 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c251b851-3a9e-4932-88de-5c7dbbd1c5a0 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:45.235450 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-f98fbb3f-ad22-4152-9ef9-56e78d2b9769 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:45.247287 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-f98fbb3f-ad22-4152-9ef9-56e78d2b9769 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1296 microversion: 2.1 time: 0.451453 Sep 21 16:23:45.248677 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 30/61] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:44 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1296 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:45.254911 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-aef07e5d-8293-47e5-abd3-964107458ff9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:45.255818 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-aef07e5d-8293-47e5-abd3-964107458ff9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:45.265628 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-aef07e5d-8293-47e5-abd3-964107458ff9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:45.266598 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-aef07e5d-8293-47e5-abd3-964107458ff9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:45.267223 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-aef07e5d-8293-47e5-abd3-964107458ff9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:45.268613 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-aef07e5d-8293-47e5-abd3-964107458ff9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:45.269355 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-aef07e5d-8293-47e5-abd3-964107458ff9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:45.270267 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-aef07e5d-8293-47e5-abd3-964107458ff9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:45.635746 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-c251b851-3a9e-4932-88de-5c7dbbd1c5a0 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f83757d3484a58b89ec39d46effaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94ef89f42ce4bc9920e9ac5f1c573e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:45.651708 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-c251b851-3a9e-4932-88de-5c7dbbd1c5a0 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] 10.222.0.64 "GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a" status: 200 len: 1314 microversion: 2.1 time: 0.613338 Sep 21 16:23:45.662351 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 32/62] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:45 2022] GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a => generated 1314 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:45.677065 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-3c81108c-8c22-4db8-aa15-7d21db345fb0 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:45.681382 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-3c81108c-8c22-4db8-aa15-7d21db345fb0 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:45.705745 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3c81108c-8c22-4db8-aa15-7d21db345fb0 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:45.710026 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3c81108c-8c22-4db8-aa15-7d21db345fb0 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:45.711584 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3c81108c-8c22-4db8-aa15-7d21db345fb0 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:45.715710 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3c81108c-8c22-4db8-aa15-7d21db345fb0 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:45.719687 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3c81108c-8c22-4db8-aa15-7d21db345fb0 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:45.720283 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3c81108c-8c22-4db8-aa15-7d21db345fb0 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:46.285751 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-3c81108c-8c22-4db8-aa15-7d21db345fb0 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:46.297113 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-3c81108c-8c22-4db8-aa15-7d21db345fb0 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77" status: 200 len: 1366 microversion: 2.1 time: 0.631296 Sep 21 16:23:46.297718 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 33/63] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:45 2022] GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 => generated 1366 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:46.309863 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-29903bb1-a96e-437a-a8e1-2b443c7890da tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:46.310715 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-29903bb1-a96e-437a-a8e1-2b443c7890da tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:46.317503 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-aef07e5d-8293-47e5-abd3-964107458ff9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:46.342456 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-29903bb1-a96e-437a-a8e1-2b443c7890da tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:46.345278 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-29903bb1-a96e-437a-a8e1-2b443c7890da tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:46.346460 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-aef07e5d-8293-47e5-abd3-964107458ff9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:46.348327 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-29903bb1-a96e-437a-a8e1-2b443c7890da tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:46.351506 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-aef07e5d-8293-47e5-abd3-964107458ff9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:46.352220 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-29903bb1-a96e-437a-a8e1-2b443c7890da tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:46.354107 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-29903bb1-a96e-437a-a8e1-2b443c7890da tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:46.359278 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-29903bb1-a96e-437a-a8e1-2b443c7890da tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:46.361702 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-aef07e5d-8293-47e5-abd3-964107458ff9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1406 microversion: 2.20 time: 1.110413 Sep 21 16:23:46.376350 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 31/64] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:23:45 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1406 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:23:46.414860 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-bd93a0a0-42d3-4c8e-b2e7-b31e7fce2bc7 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:46.416280 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-bd93a0a0-42d3-4c8e-b2e7-b31e7fce2bc7 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:46.428142 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bd93a0a0-42d3-4c8e-b2e7-b31e7fce2bc7 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:46.429192 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bd93a0a0-42d3-4c8e-b2e7-b31e7fce2bc7 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:46.430009 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bd93a0a0-42d3-4c8e-b2e7-b31e7fce2bc7 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:46.431373 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bd93a0a0-42d3-4c8e-b2e7-b31e7fce2bc7 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:46.432198 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bd93a0a0-42d3-4c8e-b2e7-b31e7fce2bc7 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:46.433024 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bd93a0a0-42d3-4c8e-b2e7-b31e7fce2bc7 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:46.464128 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=99 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:46.715203 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell0:SELECT=4 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:46.865604 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-29903bb1-a96e-437a-a8e1-2b443c7890da tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:46.881919 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-bd93a0a0-42d3-4c8e-b2e7-b31e7fce2bc7 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:46.907918 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-bd93a0a0-42d3-4c8e-b2e7-b31e7fce2bc7 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1296 microversion: 2.1 time: 0.503821 Sep 21 16:23:46.922919 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 32/65] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:46 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1296 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:46.961744 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-29903bb1-a96e-437a-a8e1-2b443c7890da tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1321 microversion: 2.1 time: 0.653245 Sep 21 16:23:46.965160 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 34/66] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:46 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1321 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:46.966993 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-9faf5012-9997-4d11-b8cc-2f89e04342ce tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:46.973911 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-9faf5012-9997-4d11-b8cc-2f89e04342ce tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] [instance: 62a18317-e115-4326-b942-b6bc791a882a] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:46.998216 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9faf5012-9997-4d11-b8cc-2f89e04342ce tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:47.000458 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9faf5012-9997-4d11-b8cc-2f89e04342ce tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:47.002600 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9faf5012-9997-4d11-b8cc-2f89e04342ce tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:47.007713 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9faf5012-9997-4d11-b8cc-2f89e04342ce tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:47.010928 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9faf5012-9997-4d11-b8cc-2f89e04342ce tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:47.012954 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9faf5012-9997-4d11-b8cc-2f89e04342ce tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:47.249163 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-ab1d6375-553a-4a38-a405-ab58c9828aae req-66610afe-4ae3-4c58-b116-6cf41c025f8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ef57390-7f44-4191-bee4-bacbdd74290c", "tag": "710045ab-6156-4322-9f3c-1697ccbafdd0"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:23:47.274916 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-ab1d6375-553a-4a38-a405-ab58c9828aae req-66610afe-4ae3-4c58-b116-6cf41c025f8b service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:47.275917 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-ab1d6375-553a-4a38-a405-ab58c9828aae req-66610afe-4ae3-4c58-b116-6cf41c025f8b service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:47.286174 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-ab1d6375-553a-4a38-a405-ab58c9828aae req-66610afe-4ae3-4c58-b116-6cf41c025f8b service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:47.323790 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-ab1d6375-553a-4a38-a405-ab58c9828aae req-66610afe-4ae3-4c58-b116-6cf41c025f8b service nova] Creating event network-changed:710045ab-6156-4322-9f3c-1697ccbafdd0 for instance 7ef57390-7f44-4191-bee4-bacbdd74290c on hv-cinder-85862 Sep 21 16:23:47.341455 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-ab1d6375-553a-4a38-a405-ab58c9828aae req-66610afe-4ae3-4c58-b116-6cf41c025f8b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102696 Sep 21 16:23:47.344333 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 35/67] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:23:47.375977 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-d25bb2f0-9696-42e9-a0a4-bcb1fc6356c8 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:47.378644 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-d25bb2f0-9696-42e9-a0a4-bcb1fc6356c8 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:47.397569 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d25bb2f0-9696-42e9-a0a4-bcb1fc6356c8 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:47.398988 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d25bb2f0-9696-42e9-a0a4-bcb1fc6356c8 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:47.401360 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d25bb2f0-9696-42e9-a0a4-bcb1fc6356c8 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:47.404277 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d25bb2f0-9696-42e9-a0a4-bcb1fc6356c8 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:47.405833 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d25bb2f0-9696-42e9-a0a4-bcb1fc6356c8 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:47.408640 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d25bb2f0-9696-42e9-a0a4-bcb1fc6356c8 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:47.797716 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d25bb2f0-9696-42e9-a0a4-bcb1fc6356c8 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:47.809738 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-d25bb2f0-9696-42e9-a0a4-bcb1fc6356c8 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77" status: 200 len: 1366 microversion: 2.1 time: 0.461765 Sep 21 16:23:47.810398 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 36/68] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:47 2022] GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 => generated 1366 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:47.831745 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-a2c78229-37bd-4a9b-9bb4-6e9e38a4334c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:47.832682 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-a2c78229-37bd-4a9b-9bb4-6e9e38a4334c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:47.846846 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a2c78229-37bd-4a9b-9bb4-6e9e38a4334c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:47.849026 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a2c78229-37bd-4a9b-9bb4-6e9e38a4334c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:47.851146 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a2c78229-37bd-4a9b-9bb4-6e9e38a4334c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:47.852446 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a2c78229-37bd-4a9b-9bb4-6e9e38a4334c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:47.854605 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a2c78229-37bd-4a9b-9bb4-6e9e38a4334c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:47.857330 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a2c78229-37bd-4a9b-9bb4-6e9e38a4334c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:48.153737 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a2c78229-37bd-4a9b-9bb4-6e9e38a4334c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:48.170755 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a2c78229-37bd-4a9b-9bb4-6e9e38a4334c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:48.175474 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a2c78229-37bd-4a9b-9bb4-6e9e38a4334c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:48.176675 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-a2c78229-37bd-4a9b-9bb4-6e9e38a4334c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1406 microversion: 2.20 time: 0.357133 Sep 21 16:23:48.177332 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 37/69] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:23:47 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1406 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:23:48.197931 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-9faf5012-9997-4d11-b8cc-2f89e04342ce tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f83757d3484a58b89ec39d46effaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94ef89f42ce4bc9920e9ac5f1c573e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:48.206857 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-9faf5012-9997-4d11-b8cc-2f89e04342ce tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] 10.222.0.64 "GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a" status: 200 len: 1314 microversion: 2.1 time: 1.282380 Sep 21 16:23:48.210935 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 33/70] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:46 2022] GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a => generated 1314 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:48.227968 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-899d2294-3481-4a45-9b2a-533ff380bda2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:48.229495 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-899d2294-3481-4a45-9b2a-533ff380bda2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:48.245768 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-899d2294-3481-4a45-9b2a-533ff380bda2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:48.246324 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-899d2294-3481-4a45-9b2a-533ff380bda2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:48.246771 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-899d2294-3481-4a45-9b2a-533ff380bda2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:48.247511 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-899d2294-3481-4a45-9b2a-533ff380bda2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:48.247976 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-899d2294-3481-4a45-9b2a-533ff380bda2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:48.248403 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-899d2294-3481-4a45-9b2a-533ff380bda2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:48.472111 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-e14d5ed9-b5dc-4e31-819b-6a6b1e78074c req-6a599598-9f88-42d7-a1ce-7e1a8272e0ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62a18317-e115-4326-b942-b6bc791a882a", "name": "network-vif-plugged", "status": "completed", "tag": "2f918381-0144-4a84-9f9f-e5a972f31ab9"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:23:48.500517 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-e14d5ed9-b5dc-4e31-819b-6a6b1e78074c req-6a599598-9f88-42d7-a1ce-7e1a8272e0ca service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:48.501406 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-e14d5ed9-b5dc-4e31-819b-6a6b1e78074c req-6a599598-9f88-42d7-a1ce-7e1a8272e0ca service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:48.502215 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-e14d5ed9-b5dc-4e31-819b-6a6b1e78074c req-6a599598-9f88-42d7-a1ce-7e1a8272e0ca service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:48.561004 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-e14d5ed9-b5dc-4e31-819b-6a6b1e78074c req-6a599598-9f88-42d7-a1ce-7e1a8272e0ca service nova] Creating event network-vif-plugged:2f918381-0144-4a84-9f9f-e5a972f31ab9 for instance 62a18317-e115-4326-b942-b6bc791a882a on hv-cinder-85862 Sep 21 16:23:48.575682 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-e14d5ed9-b5dc-4e31-819b-6a6b1e78074c req-6a599598-9f88-42d7-a1ce-7e1a8272e0ca service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.396916 Sep 21 16:23:48.578156 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 38/71] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:23:48.595935 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-afeb704a-bde6-4517-9637-b95c91b1c606 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:48.596848 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-afeb704a-bde6-4517-9637-b95c91b1c606 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:48.606017 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-afeb704a-bde6-4517-9637-b95c91b1c606 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:48.607052 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-afeb704a-bde6-4517-9637-b95c91b1c606 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:48.608101 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-afeb704a-bde6-4517-9637-b95c91b1c606 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:48.609299 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-afeb704a-bde6-4517-9637-b95c91b1c606 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:48.610939 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-afeb704a-bde6-4517-9637-b95c91b1c606 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:48.611815 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-afeb704a-bde6-4517-9637-b95c91b1c606 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:49.128462 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-afeb704a-bde6-4517-9637-b95c91b1c606 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:49.163023 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-afeb704a-bde6-4517-9637-b95c91b1c606 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1321 microversion: 2.1 time: 0.579561 Sep 21 16:23:49.164187 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 39/72] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:48 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1321 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:49.185414 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-fb8016bf-d1f9-49c8-a054-4137caa0c582 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:49.190837 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-fb8016bf-d1f9-49c8-a054-4137caa0c582 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:49.202604 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fb8016bf-d1f9-49c8-a054-4137caa0c582 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:49.203480 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fb8016bf-d1f9-49c8-a054-4137caa0c582 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:49.204268 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fb8016bf-d1f9-49c8-a054-4137caa0c582 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:49.205340 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fb8016bf-d1f9-49c8-a054-4137caa0c582 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:49.206131 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fb8016bf-d1f9-49c8-a054-4137caa0c582 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:49.206787 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fb8016bf-d1f9-49c8-a054-4137caa0c582 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:49.444700 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-fb8016bf-d1f9-49c8-a054-4137caa0c582 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:49.456135 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-fb8016bf-d1f9-49c8-a054-4137caa0c582 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77" status: 200 len: 1366 microversion: 2.1 time: 0.284625 Sep 21 16:23:49.457803 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 40/73] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:49 2022] GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 => generated 1366 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:49.476765 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-576465cf-1666-4898-a60e-26ec8efc4ec1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:49.476765 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-576465cf-1666-4898-a60e-26ec8efc4ec1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:49.476765 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-576465cf-1666-4898-a60e-26ec8efc4ec1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:49.476765 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-576465cf-1666-4898-a60e-26ec8efc4ec1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:49.478016 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-576465cf-1666-4898-a60e-26ec8efc4ec1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:49.478016 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-576465cf-1666-4898-a60e-26ec8efc4ec1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:49.478016 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-576465cf-1666-4898-a60e-26ec8efc4ec1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:49.478016 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-576465cf-1666-4898-a60e-26ec8efc4ec1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:49.629982 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-899d2294-3481-4a45-9b2a-533ff380bda2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:49.651816 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-899d2294-3481-4a45-9b2a-533ff380bda2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1364 microversion: 2.1 time: 1.438930 Sep 21 16:23:49.669005 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 34/74] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:48 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1364 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:49.696742 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-e41fcc13-d7a6-4d24-b77f-72deacae982a tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:49.698567 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-e41fcc13-d7a6-4d24-b77f-72deacae982a tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] [instance: 62a18317-e115-4326-b942-b6bc791a882a] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:49.713614 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e41fcc13-d7a6-4d24-b77f-72deacae982a tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:49.714964 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e41fcc13-d7a6-4d24-b77f-72deacae982a tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:49.716084 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e41fcc13-d7a6-4d24-b77f-72deacae982a tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:49.719901 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e41fcc13-d7a6-4d24-b77f-72deacae982a tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:49.721415 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e41fcc13-d7a6-4d24-b77f-72deacae982a tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:49.723733 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e41fcc13-d7a6-4d24-b77f-72deacae982a tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:49.804253 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-576465cf-1666-4898-a60e-26ec8efc4ec1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:49.819679 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-576465cf-1666-4898-a60e-26ec8efc4ec1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:49.826709 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-576465cf-1666-4898-a60e-26ec8efc4ec1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:49.834925 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-576465cf-1666-4898-a60e-26ec8efc4ec1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1406 microversion: 2.20 time: 0.371545 Sep 21 16:23:49.838170 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 41/75] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:23:49 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1406 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:23:49.852804 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-a85f06fa-0347-45d4-9d49-35af2c2dfc89 req-fcd98c9d-7d82-434d-a5ee-5a827f2c58ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72c89a30-cc9f-472e-9fa3-8ad2f7c36b77", "tag": "be058d27-ec10-484e-9f81-e51deac36522"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:23:49.874860 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-a85f06fa-0347-45d4-9d49-35af2c2dfc89 req-fcd98c9d-7d82-434d-a5ee-5a827f2c58ed service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:49.875706 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-a85f06fa-0347-45d4-9d49-35af2c2dfc89 req-fcd98c9d-7d82-434d-a5ee-5a827f2c58ed service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:49.876416 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-a85f06fa-0347-45d4-9d49-35af2c2dfc89 req-fcd98c9d-7d82-434d-a5ee-5a827f2c58ed service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:49.902112 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-a85f06fa-0347-45d4-9d49-35af2c2dfc89 req-fcd98c9d-7d82-434d-a5ee-5a827f2c58ed service nova] Creating event network-changed:be058d27-ec10-484e-9f81-e51deac36522 for instance 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 on hv-cinder-85862 Sep 21 16:23:49.921081 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-a85f06fa-0347-45d4-9d49-35af2c2dfc89 req-fcd98c9d-7d82-434d-a5ee-5a827f2c58ed service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081023 Sep 21 16:23:49.922113 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 42/76] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:23:50.188868 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-8a5ac3a4-c300-4737-aca0-406ea58e6478 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:50.189581 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-8a5ac3a4-c300-4737-aca0-406ea58e6478 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:50.204409 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8a5ac3a4-c300-4737-aca0-406ea58e6478 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:50.204805 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8a5ac3a4-c300-4737-aca0-406ea58e6478 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:50.205436 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8a5ac3a4-c300-4737-aca0-406ea58e6478 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:50.206393 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8a5ac3a4-c300-4737-aca0-406ea58e6478 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:50.206869 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8a5ac3a4-c300-4737-aca0-406ea58e6478 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:50.207303 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8a5ac3a4-c300-4737-aca0-406ea58e6478 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:50.396859 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-8a5ac3a4-c300-4737-aca0-406ea58e6478 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:50.401739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-e41fcc13-d7a6-4d24-b77f-72deacae982a tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f83757d3484a58b89ec39d46effaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94ef89f42ce4bc9920e9ac5f1c573e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:50.416401 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-e41fcc13-d7a6-4d24-b77f-72deacae982a tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] 10.222.0.64 "GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a" status: 200 len: 1314 microversion: 2.1 time: 0.745034 Sep 21 16:23:50.417886 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 35/77] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:49 2022] GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a => generated 1314 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:50.419792 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-8a5ac3a4-c300-4737-aca0-406ea58e6478 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1321 microversion: 2.1 time: 0.235112 Sep 21 16:23:50.420398 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 43/78] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:50 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:50.508759 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-74c843c2-92b0-4407-a5d7-86ce19b29299 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:50.511059 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-74c843c2-92b0-4407-a5d7-86ce19b29299 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:50.525962 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-74c843c2-92b0-4407-a5d7-86ce19b29299 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:50.528949 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-74c843c2-92b0-4407-a5d7-86ce19b29299 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:50.530687 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-74c843c2-92b0-4407-a5d7-86ce19b29299 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:50.532629 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-74c843c2-92b0-4407-a5d7-86ce19b29299 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:50.534027 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-74c843c2-92b0-4407-a5d7-86ce19b29299 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:50.536217 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-74c843c2-92b0-4407-a5d7-86ce19b29299 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:50.602977 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-78e5bfca-8f84-4948-b43b-1208d56e3407 req-0f3b28af-8f4f-4001-bd24-dcef225c1c54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f563aac-6055-4b77-b3bb-894ed14c1f64", "name": "network-vif-plugged", "status": "completed", "tag": "252450c8-e7d3-467d-be6e-17b527b01bb8"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:23:50.622261 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-78e5bfca-8f84-4948-b43b-1208d56e3407 req-0f3b28af-8f4f-4001-bd24-dcef225c1c54 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:50.622763 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-78e5bfca-8f84-4948-b43b-1208d56e3407 req-0f3b28af-8f4f-4001-bd24-dcef225c1c54 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:50.628787 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-78e5bfca-8f84-4948-b43b-1208d56e3407 req-0f3b28af-8f4f-4001-bd24-dcef225c1c54 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:50.655514 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-78e5bfca-8f84-4948-b43b-1208d56e3407 req-0f3b28af-8f4f-4001-bd24-dcef225c1c54 service nova] Creating event network-vif-plugged:252450c8-e7d3-467d-be6e-17b527b01bb8 for instance 5f563aac-6055-4b77-b3bb-894ed14c1f64 on hv-cinder-85862 Sep 21 16:23:50.684844 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-78e5bfca-8f84-4948-b43b-1208d56e3407 req-0f3b28af-8f4f-4001-bd24-dcef225c1c54 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086052 Sep 21 16:23:50.687841 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 44/79] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:23:50.713833 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-1195a79b-5e29-4629-95fa-633c2a886e45 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:50.718242 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-1195a79b-5e29-4629-95fa-633c2a886e45 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:50.736931 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1195a79b-5e29-4629-95fa-633c2a886e45 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:50.738662 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1195a79b-5e29-4629-95fa-633c2a886e45 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:50.739709 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1195a79b-5e29-4629-95fa-633c2a886e45 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:50.741385 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1195a79b-5e29-4629-95fa-633c2a886e45 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:50.742574 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1195a79b-5e29-4629-95fa-633c2a886e45 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:50.745000 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1195a79b-5e29-4629-95fa-633c2a886e45 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:51.090921 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-1195a79b-5e29-4629-95fa-633c2a886e45 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:51.105775 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-1195a79b-5e29-4629-95fa-633c2a886e45 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1364 microversion: 2.1 time: 0.407080 Sep 21 16:23:51.106622 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 45/80] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:50 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1364 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:51.113541 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-89fd24ac-cd4a-4a02-92a5-94553adfc560 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:51.114288 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-89fd24ac-cd4a-4a02-92a5-94553adfc560 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:51.122875 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-89fd24ac-cd4a-4a02-92a5-94553adfc560 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:51.123709 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-89fd24ac-cd4a-4a02-92a5-94553adfc560 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:51.124155 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-89fd24ac-cd4a-4a02-92a5-94553adfc560 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:51.126146 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-89fd24ac-cd4a-4a02-92a5-94553adfc560 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:51.126146 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-89fd24ac-cd4a-4a02-92a5-94553adfc560 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:51.126146 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-89fd24ac-cd4a-4a02-92a5-94553adfc560 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:51.257707 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-74c843c2-92b0-4407-a5d7-86ce19b29299 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:51.267113 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-74c843c2-92b0-4407-a5d7-86ce19b29299 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77" status: 200 len: 1366 microversion: 2.1 time: 0.768215 Sep 21 16:23:51.271524 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 36/81] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:50 2022] GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 => generated 1366 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:51.447357 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-c637919b-6f21-4b7c-8b3b-5563f948ef25 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:51.447994 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-c637919b-6f21-4b7c-8b3b-5563f948ef25 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:51.458092 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c637919b-6f21-4b7c-8b3b-5563f948ef25 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:51.461572 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c637919b-6f21-4b7c-8b3b-5563f948ef25 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:51.462255 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c637919b-6f21-4b7c-8b3b-5563f948ef25 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:51.465823 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c637919b-6f21-4b7c-8b3b-5563f948ef25 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:51.469991 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c637919b-6f21-4b7c-8b3b-5563f948ef25 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:51.470766 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c637919b-6f21-4b7c-8b3b-5563f948ef25 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:51.737856 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-89fd24ac-cd4a-4a02-92a5-94553adfc560 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:51.756205 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-89fd24ac-cd4a-4a02-92a5-94553adfc560 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:51.760572 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-89fd24ac-cd4a-4a02-92a5-94553adfc560 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:51.762098 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-89fd24ac-cd4a-4a02-92a5-94553adfc560 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1406 microversion: 2.20 time: 0.654247 Sep 21 16:23:51.764447 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 46/82] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:23:51 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1406 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:23:51.777792 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-54c732ae-c1a8-43f7-b837-cebf3f735830 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:51.783227 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-54c732ae-c1a8-43f7-b837-cebf3f735830 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] [instance: 62a18317-e115-4326-b942-b6bc791a882a] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:51.799903 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-54c732ae-c1a8-43f7-b837-cebf3f735830 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:51.800415 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-54c732ae-c1a8-43f7-b837-cebf3f735830 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:51.800875 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-54c732ae-c1a8-43f7-b837-cebf3f735830 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:51.801827 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-54c732ae-c1a8-43f7-b837-cebf3f735830 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:51.805093 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-54c732ae-c1a8-43f7-b837-cebf3f735830 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:51.808662 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-54c732ae-c1a8-43f7-b837-cebf3f735830 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:52.126695 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-54c732ae-c1a8-43f7-b837-cebf3f735830 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f83757d3484a58b89ec39d46effaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94ef89f42ce4bc9920e9ac5f1c573e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:52.162748 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-54c732ae-c1a8-43f7-b837-cebf3f735830 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] 10.222.0.64 "GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a" status: 200 len: 1501 microversion: 2.1 time: 0.396215 Sep 21 16:23:52.171641 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 47/83] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:51 2022] GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a => generated 1501 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:52.180957 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-3a7f6be9-029b-4c14-8161-a747c3c5d86b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:52.199244 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-3a7f6be9-029b-4c14-8161-a747c3c5d86b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:52.217277 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3a7f6be9-029b-4c14-8161-a747c3c5d86b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:52.219014 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3a7f6be9-029b-4c14-8161-a747c3c5d86b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:52.220095 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3a7f6be9-029b-4c14-8161-a747c3c5d86b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:52.221642 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3a7f6be9-029b-4c14-8161-a747c3c5d86b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:52.222773 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3a7f6be9-029b-4c14-8161-a747c3c5d86b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:52.223918 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3a7f6be9-029b-4c14-8161-a747c3c5d86b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:52.441312 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-c637919b-6f21-4b7c-8b3b-5563f948ef25 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:52.485855 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-c637919b-6f21-4b7c-8b3b-5563f948ef25 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1321 microversion: 2.1 time: 1.042960 Sep 21 16:23:52.491182 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 37/84] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:51 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1321 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:52.522024 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-64ca1c5e-5d38-4a30-84ae-28fb33d3ebd8 req-ef98ab47-94fa-4446-b5ab-14b8b810c8b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c1436cc-a3f6-4683-abf2-e8835aa53021", "tag": "2b416c16-2f39-4d35-bf8a-8301720a840d"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:23:52.571450 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-64ca1c5e-5d38-4a30-84ae-28fb33d3ebd8 req-ef98ab47-94fa-4446-b5ab-14b8b810c8b4 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:52.573694 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-64ca1c5e-5d38-4a30-84ae-28fb33d3ebd8 req-ef98ab47-94fa-4446-b5ab-14b8b810c8b4 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:52.574752 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-64ca1c5e-5d38-4a30-84ae-28fb33d3ebd8 req-ef98ab47-94fa-4446-b5ab-14b8b810c8b4 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:52.587417 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-3a7f6be9-029b-4c14-8161-a747c3c5d86b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:52.609592 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-3a7f6be9-029b-4c14-8161-a747c3c5d86b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1364 microversion: 2.1 time: 0.436527 Sep 21 16:23:52.610787 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 48/85] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:52 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1364 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:52.614446 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-64ca1c5e-5d38-4a30-84ae-28fb33d3ebd8 req-ef98ab47-94fa-4446-b5ab-14b8b810c8b4 service nova] Creating event network-changed:2b416c16-2f39-4d35-bf8a-8301720a840d for instance 1c1436cc-a3f6-4683-abf2-e8835aa53021 on hv-cinder-85862 Sep 21 16:23:52.617191 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-6efe1c98-3c89-466d-85c6-d0f606e5c22e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:52.618307 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-6efe1c98-3c89-466d-85c6-d0f606e5c22e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:52.627460 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6efe1c98-3c89-466d-85c6-d0f606e5c22e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:52.628536 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6efe1c98-3c89-466d-85c6-d0f606e5c22e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:52.629180 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6efe1c98-3c89-466d-85c6-d0f606e5c22e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:52.630291 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6efe1c98-3c89-466d-85c6-d0f606e5c22e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:52.631268 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-64ca1c5e-5d38-4a30-84ae-28fb33d3ebd8 req-ef98ab47-94fa-4446-b5ab-14b8b810c8b4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134457 Sep 21 16:23:52.631464 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6efe1c98-3c89-466d-85c6-d0f606e5c22e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:52.632180 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6efe1c98-3c89-466d-85c6-d0f606e5c22e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:52.633462 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 38/86] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:23:52.834294 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-1447e964-2c41-4891-8bb8-a87387195558 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:52.835722 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-1447e964-2c41-4891-8bb8-a87387195558 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:52.846662 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1447e964-2c41-4891-8bb8-a87387195558 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:52.847718 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1447e964-2c41-4891-8bb8-a87387195558 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:52.848561 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1447e964-2c41-4891-8bb8-a87387195558 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:52.849624 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1447e964-2c41-4891-8bb8-a87387195558 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:52.850830 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1447e964-2c41-4891-8bb8-a87387195558 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:52.851618 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1447e964-2c41-4891-8bb8-a87387195558 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:52.978872 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-6efe1c98-3c89-466d-85c6-d0f606e5c22e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:52.992469 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-6efe1c98-3c89-466d-85c6-d0f606e5c22e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77" status: 200 len: 1366 microversion: 2.1 time: 0.380166 Sep 21 16:23:52.993210 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 49/87] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:52 2022] GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 => generated 1366 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:53.537338 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-b8cb859f-b1b6-4d77-8aba-2eca54cd06b6 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:53.538026 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-b8cb859f-b1b6-4d77-8aba-2eca54cd06b6 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:53.558849 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-1447e964-2c41-4891-8bb8-a87387195558 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:53.565131 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b8cb859f-b1b6-4d77-8aba-2eca54cd06b6 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:53.565702 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b8cb859f-b1b6-4d77-8aba-2eca54cd06b6 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:53.568766 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b8cb859f-b1b6-4d77-8aba-2eca54cd06b6 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:53.574583 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-1447e964-2c41-4891-8bb8-a87387195558 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:53.575329 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b8cb859f-b1b6-4d77-8aba-2eca54cd06b6 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:53.579875 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b8cb859f-b1b6-4d77-8aba-2eca54cd06b6 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:53.584500 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-1447e964-2c41-4891-8bb8-a87387195558 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:53.585056 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b8cb859f-b1b6-4d77-8aba-2eca54cd06b6 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:53.591416 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-1447e964-2c41-4891-8bb8-a87387195558 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1406 microversion: 2.20 time: 0.764649 Sep 21 16:23:53.597847 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 39/88] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:23:52 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1406 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:23:53.613964 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-fcbeadf1-2cf7-47ef-9452-2ad7be0fec15 req-55524f45-46df-45b5-b3ea-50bb0898c213 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ece03bf-7582-46b8-8966-0f46577abe14", "name": "network-vif-plugged", "status": "completed", "tag": "bfec785e-5f96-4772-937f-5c90aabd9fb8"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:23:53.655622 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-fcbeadf1-2cf7-47ef-9452-2ad7be0fec15 req-55524f45-46df-45b5-b3ea-50bb0898c213 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:53.656105 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-fcbeadf1-2cf7-47ef-9452-2ad7be0fec15 req-55524f45-46df-45b5-b3ea-50bb0898c213 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:53.656535 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-fcbeadf1-2cf7-47ef-9452-2ad7be0fec15 req-55524f45-46df-45b5-b3ea-50bb0898c213 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:53.679053 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-fcbeadf1-2cf7-47ef-9452-2ad7be0fec15 req-55524f45-46df-45b5-b3ea-50bb0898c213 service nova] Creating event network-vif-plugged:bfec785e-5f96-4772-937f-5c90aabd9fb8 for instance 0ece03bf-7582-46b8-8966-0f46577abe14 on hv-cinder-85862 Sep 21 16:23:53.684925 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-fcbeadf1-2cf7-47ef-9452-2ad7be0fec15 req-55524f45-46df-45b5-b3ea-50bb0898c213 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080347 Sep 21 16:23:53.685847 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 40/89] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:23:53.691441 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-bc958193-f5d2-48d4-988f-5aeccbb82d4d tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:53.692329 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-bc958193-f5d2-48d4-988f-5aeccbb82d4d tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:53.699697 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bc958193-f5d2-48d4-988f-5aeccbb82d4d tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:53.700191 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bc958193-f5d2-48d4-988f-5aeccbb82d4d tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:53.700630 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bc958193-f5d2-48d4-988f-5aeccbb82d4d tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:53.701336 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bc958193-f5d2-48d4-988f-5aeccbb82d4d tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:53.702218 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bc958193-f5d2-48d4-988f-5aeccbb82d4d tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:53.703064 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bc958193-f5d2-48d4-988f-5aeccbb82d4d tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:53.952877 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-b8cb859f-b1b6-4d77-8aba-2eca54cd06b6 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:53.965596 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-b8cb859f-b1b6-4d77-8aba-2eca54cd06b6 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1321 microversion: 2.1 time: 0.433949 Sep 21 16:23:53.967024 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 50/90] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:53 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1321 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:54.040353 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-4063fdac-e2b4-4b1a-bc5a-4710409f6975 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:54.043411 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-4063fdac-e2b4-4b1a-bc5a-4710409f6975 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:54.068707 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4063fdac-e2b4-4b1a-bc5a-4710409f6975 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:54.070172 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4063fdac-e2b4-4b1a-bc5a-4710409f6975 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:54.071383 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4063fdac-e2b4-4b1a-bc5a-4710409f6975 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:54.073110 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4063fdac-e2b4-4b1a-bc5a-4710409f6975 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:54.074594 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4063fdac-e2b4-4b1a-bc5a-4710409f6975 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:54.076704 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4063fdac-e2b4-4b1a-bc5a-4710409f6975 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:54.413658 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-4063fdac-e2b4-4b1a-bc5a-4710409f6975 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:54.434471 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-4063fdac-e2b4-4b1a-bc5a-4710409f6975 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77" status: 200 len: 1366 microversion: 2.1 time: 0.403965 Sep 21 16:23:54.436564 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 51/91] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:54 2022] GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 => generated 1366 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:54.448367 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-7397da52-71ee-4db9-bbaf-2d899c264118 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6eafe58a-abde-4b0f-a8cc-aeb1042ccf6a"}} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:23:54.454262 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-7397da52-71ee-4db9-bbaf-2d899c264118 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] [instance: 62a18317-e115-4326-b942-b6bc791a882a] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:54.479045 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7397da52-71ee-4db9-bbaf-2d899c264118 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:54.479570 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7397da52-71ee-4db9-bbaf-2d899c264118 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:54.479981 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7397da52-71ee-4db9-bbaf-2d899c264118 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:54.483021 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7397da52-71ee-4db9-bbaf-2d899c264118 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:54.487387 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7397da52-71ee-4db9-bbaf-2d899c264118 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:54.490759 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7397da52-71ee-4db9-bbaf-2d899c264118 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:54.752494 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell0:SELECT=2 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:54.856115 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-bc958193-f5d2-48d4-988f-5aeccbb82d4d tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:54.871938 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-bc958193-f5d2-48d4-988f-5aeccbb82d4d tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1364 microversion: 2.1 time: 1.184301 Sep 21 16:23:54.874808 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 41/92] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:53 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1364 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:54.885493 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-14ebe435-4acc-4d94-99a9-e5e2dcc0bd1d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:54.888019 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-14ebe435-4acc-4d94-99a9-e5e2dcc0bd1d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:54.936226 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-14ebe435-4acc-4d94-99a9-e5e2dcc0bd1d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:54.937362 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-14ebe435-4acc-4d94-99a9-e5e2dcc0bd1d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:54.940049 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-14ebe435-4acc-4d94-99a9-e5e2dcc0bd1d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:54.946145 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-14ebe435-4acc-4d94-99a9-e5e2dcc0bd1d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:54.950802 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-14ebe435-4acc-4d94-99a9-e5e2dcc0bd1d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:54.953823 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-14ebe435-4acc-4d94-99a9-e5e2dcc0bd1d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:55.549530 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:55.624334 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-7397da52-71ee-4db9-bbaf-2d899c264118 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] 10.222.0.64 "POST /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.184444 Sep 21 16:23:55.652493 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 52/93] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Sep 21 16:23:54 2022] POST /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a/os-volume_attachments => generated 194 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:23:55.661385 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ff6b11b3-1502-44ca-984a-d47357cb087b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:55.674215 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ff6b11b3-1502-44ca-984a-d47357cb087b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:55.707454 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ff6b11b3-1502-44ca-984a-d47357cb087b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:55.708339 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ff6b11b3-1502-44ca-984a-d47357cb087b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:55.709154 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ff6b11b3-1502-44ca-984a-d47357cb087b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:55.715612 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ff6b11b3-1502-44ca-984a-d47357cb087b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:55.716666 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ff6b11b3-1502-44ca-984a-d47357cb087b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:55.717441 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ff6b11b3-1502-44ca-984a-d47357cb087b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:56.132319 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-14ebe435-4acc-4d94-99a9-e5e2dcc0bd1d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:56.147200 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ff6b11b3-1502-44ca-984a-d47357cb087b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:56.153767 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-14ebe435-4acc-4d94-99a9-e5e2dcc0bd1d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:56.155590 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-14ebe435-4acc-4d94-99a9-e5e2dcc0bd1d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:56.157062 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-14ebe435-4acc-4d94-99a9-e5e2dcc0bd1d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1599 microversion: 2.20 time: 1.280602 Sep 21 16:23:56.158549 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 42/94] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:23:54 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1599 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:23:56.164952 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-3d6fd55d-40a0-41a7-91ef-2ff9bfcbe220 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:56.168115 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-3d6fd55d-40a0-41a7-91ef-2ff9bfcbe220 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:56.180149 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3d6fd55d-40a0-41a7-91ef-2ff9bfcbe220 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:56.181976 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3d6fd55d-40a0-41a7-91ef-2ff9bfcbe220 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:56.183086 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3d6fd55d-40a0-41a7-91ef-2ff9bfcbe220 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:56.186697 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ff6b11b3-1502-44ca-984a-d47357cb087b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1321 microversion: 2.1 time: 0.533380 Sep 21 16:23:56.187464 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3d6fd55d-40a0-41a7-91ef-2ff9bfcbe220 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:56.188000 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 53/95] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:55 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1321 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:56.191054 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3d6fd55d-40a0-41a7-91ef-2ff9bfcbe220 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:56.191973 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3d6fd55d-40a0-41a7-91ef-2ff9bfcbe220 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:56.197440 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=100 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:23:56.205521 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-dabc773d-6433-46f7-a384-654f427c916a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:56.207637 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-dabc773d-6433-46f7-a384-654f427c916a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:56.227306 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dabc773d-6433-46f7-a384-654f427c916a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:56.230204 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dabc773d-6433-46f7-a384-654f427c916a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:56.230996 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dabc773d-6433-46f7-a384-654f427c916a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:56.236093 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dabc773d-6433-46f7-a384-654f427c916a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:56.237266 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dabc773d-6433-46f7-a384-654f427c916a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:56.237966 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dabc773d-6433-46f7-a384-654f427c916a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:56.522916 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-dabc773d-6433-46f7-a384-654f427c916a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:56.540526 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-dabc773d-6433-46f7-a384-654f427c916a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1364 microversion: 2.1 time: 0.350274 Sep 21 16:23:56.544629 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 54/96] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:56 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1364 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:56.551907 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-2cd11de3-3895-4b2e-b2a0-1830d59f9a51 req-979c1b34-94e8-413d-9356-88edefc3eb81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ef57390-7f44-4191-bee4-bacbdd74290c", "name": "network-vif-plugged", "status": "completed", "tag": "710045ab-6156-4322-9f3c-1697ccbafdd0"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:23:56.567016 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-2cd11de3-3895-4b2e-b2a0-1830d59f9a51 req-979c1b34-94e8-413d-9356-88edefc3eb81 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:56.570497 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-2cd11de3-3895-4b2e-b2a0-1830d59f9a51 req-979c1b34-94e8-413d-9356-88edefc3eb81 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:56.572171 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-2cd11de3-3895-4b2e-b2a0-1830d59f9a51 req-979c1b34-94e8-413d-9356-88edefc3eb81 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:56.602172 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-2cd11de3-3895-4b2e-b2a0-1830d59f9a51 req-979c1b34-94e8-413d-9356-88edefc3eb81 service nova] Creating event network-vif-plugged:710045ab-6156-4322-9f3c-1697ccbafdd0 for instance 7ef57390-7f44-4191-bee4-bacbdd74290c on hv-cinder-85862 Sep 21 16:23:56.609025 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-3d6fd55d-40a0-41a7-91ef-2ff9bfcbe220 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:56.614387 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-2cd11de3-3895-4b2e-b2a0-1830d59f9a51 req-979c1b34-94e8-413d-9356-88edefc3eb81 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066633 Sep 21 16:23:56.617070 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 55/97] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:23:56.624743 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-3d6fd55d-40a0-41a7-91ef-2ff9bfcbe220 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77" status: 200 len: 1366 microversion: 2.1 time: 0.464197 Sep 21 16:23:56.625741 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 43/98] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:56 2022] GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 => generated 1366 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:56.630203 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-e78dec13-3266-4534-adbd-4c6e6af51cda tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:56.631272 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-e78dec13-3266-4534-adbd-4c6e6af51cda tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:56.651170 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e78dec13-3266-4534-adbd-4c6e6af51cda tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:56.653067 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e78dec13-3266-4534-adbd-4c6e6af51cda tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:56.653277 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e78dec13-3266-4534-adbd-4c6e6af51cda tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:56.655114 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e78dec13-3266-4534-adbd-4c6e6af51cda tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:56.656535 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e78dec13-3266-4534-adbd-4c6e6af51cda tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:56.657175 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e78dec13-3266-4534-adbd-4c6e6af51cda tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:56.822600 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-e78dec13-3266-4534-adbd-4c6e6af51cda tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.200926 Sep 21 16:23:56.832395 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 56/99] 10.222.0.64 () {60 vars in 1316 bytes} [Wed Sep 21 16:23:56 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64/os-interface => generated 285 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 16:23:57.233028 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-19bffc27-0a00-4db1-b3c4-48b6e7a43bc1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:57.234495 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-19bffc27-0a00-4db1-b3c4-48b6e7a43bc1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:57.247634 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-19bffc27-0a00-4db1-b3c4-48b6e7a43bc1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:57.249753 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-19bffc27-0a00-4db1-b3c4-48b6e7a43bc1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:57.250828 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-19bffc27-0a00-4db1-b3c4-48b6e7a43bc1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:57.252772 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-19bffc27-0a00-4db1-b3c4-48b6e7a43bc1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:57.256287 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-19bffc27-0a00-4db1-b3c4-48b6e7a43bc1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:57.257060 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-19bffc27-0a00-4db1-b3c4-48b6e7a43bc1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:57.597861 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-bb87a09a-b721-44d2-ae1b-a45e8c5c33c8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:57.599931 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-bb87a09a-b721-44d2-ae1b-a45e8c5c33c8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:57.615522 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb87a09a-b721-44d2-ae1b-a45e8c5c33c8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:57.616091 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb87a09a-b721-44d2-ae1b-a45e8c5c33c8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:57.616631 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb87a09a-b721-44d2-ae1b-a45e8c5c33c8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:57.621578 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb87a09a-b721-44d2-ae1b-a45e8c5c33c8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:57.622714 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb87a09a-b721-44d2-ae1b-a45e8c5c33c8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:57.623179 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb87a09a-b721-44d2-ae1b-a45e8c5c33c8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:58.000579 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-bb87a09a-b721-44d2-ae1b-a45e8c5c33c8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:58.013529 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-bb87a09a-b721-44d2-ae1b-a45e8c5c33c8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1364 microversion: 2.1 time: 0.433761 Sep 21 16:23:58.020674 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 57/100] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:57 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1364 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:58.058185 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-d296265a-7ece-42a3-9469-aab010fdaeca tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:58.060737 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-d296265a-7ece-42a3-9469-aab010fdaeca tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:58.081209 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d296265a-7ece-42a3-9469-aab010fdaeca tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:58.082023 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d296265a-7ece-42a3-9469-aab010fdaeca tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:58.083851 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d296265a-7ece-42a3-9469-aab010fdaeca tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:58.087206 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d296265a-7ece-42a3-9469-aab010fdaeca tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:58.089771 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d296265a-7ece-42a3-9469-aab010fdaeca tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:58.093551 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d296265a-7ece-42a3-9469-aab010fdaeca tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:58.107095 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-19bffc27-0a00-4db1-b3c4-48b6e7a43bc1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:58.160587 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-19bffc27-0a00-4db1-b3c4-48b6e7a43bc1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1321 microversion: 2.1 time: 0.933321 Sep 21 16:23:58.163670 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 44/101] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:57 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1321 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:58.359093 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d296265a-7ece-42a3-9469-aab010fdaeca tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:58.373006 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-d296265a-7ece-42a3-9469-aab010fdaeca tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77" status: 200 len: 1366 microversion: 2.1 time: 0.347568 Sep 21 16:23:58.373969 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 58/102] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:58 2022] GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 => generated 1366 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:59.060096 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-8428564d-f2c6-4ec8-bcdf-3f2256c52931 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:59.063962 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-8428564d-f2c6-4ec8-bcdf-3f2256c52931 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:59.078183 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8428564d-f2c6-4ec8-bcdf-3f2256c52931 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:59.079353 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8428564d-f2c6-4ec8-bcdf-3f2256c52931 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:59.080160 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8428564d-f2c6-4ec8-bcdf-3f2256c52931 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:59.081460 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8428564d-f2c6-4ec8-bcdf-3f2256c52931 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:59.082545 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8428564d-f2c6-4ec8-bcdf-3f2256c52931 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:59.083449 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8428564d-f2c6-4ec8-bcdf-3f2256c52931 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:59.207729 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c83d54cc-f977-4180-a9a2-b0226e7630ee tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:59.208615 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-c83d54cc-f977-4180-a9a2-b0226e7630ee tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:59.225124 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c83d54cc-f977-4180-a9a2-b0226e7630ee tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:59.225888 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c83d54cc-f977-4180-a9a2-b0226e7630ee tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:59.229509 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c83d54cc-f977-4180-a9a2-b0226e7630ee tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:59.232441 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c83d54cc-f977-4180-a9a2-b0226e7630ee tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:59.233673 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c83d54cc-f977-4180-a9a2-b0226e7630ee tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:59.234945 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c83d54cc-f977-4180-a9a2-b0226e7630ee tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:59.660691 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-c83d54cc-f977-4180-a9a2-b0226e7630ee tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:23:59.676993 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-c83d54cc-f977-4180-a9a2-b0226e7630ee tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1321 microversion: 2.1 time: 0.475370 Sep 21 16:23:59.683365 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 59/103] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:59 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1321 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:23:59.698107 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-cfaa5ac6-bda4-430a-b4ca-6c785f747099 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:23:59.698974 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-cfaa5ac6-bda4-430a-b4ca-6c785f747099 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:23:59.719541 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cfaa5ac6-bda4-430a-b4ca-6c785f747099 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:59.721156 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cfaa5ac6-bda4-430a-b4ca-6c785f747099 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:59.722142 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cfaa5ac6-bda4-430a-b4ca-6c785f747099 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:23:59.723481 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cfaa5ac6-bda4-430a-b4ca-6c785f747099 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:23:59.724462 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cfaa5ac6-bda4-430a-b4ca-6c785f747099 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:23:59.725505 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cfaa5ac6-bda4-430a-b4ca-6c785f747099 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:00.100364 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-8428564d-f2c6-4ec8-bcdf-3f2256c52931 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:00.121918 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-8428564d-f2c6-4ec8-bcdf-3f2256c52931 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1364 microversion: 2.1 time: 1.070451 Sep 21 16:24:00.123116 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 45/104] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:59 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1364 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:24:00.129280 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-e85a41d2-d06c-4728-a4b3-5ed0be99005e req-d1a8f34c-858a-401b-b9da-beaf3b803f5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72c89a30-cc9f-472e-9fa3-8ad2f7c36b77", "name": "network-vif-plugged", "status": "completed", "tag": "be058d27-ec10-484e-9f81-e51deac36522"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:24:00.155717 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-e85a41d2-d06c-4728-a4b3-5ed0be99005e req-d1a8f34c-858a-401b-b9da-beaf3b803f5e service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:00.156366 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-e85a41d2-d06c-4728-a4b3-5ed0be99005e req-d1a8f34c-858a-401b-b9da-beaf3b803f5e service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:00.156919 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-e85a41d2-d06c-4728-a4b3-5ed0be99005e req-d1a8f34c-858a-401b-b9da-beaf3b803f5e service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:00.178736 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-e85a41d2-d06c-4728-a4b3-5ed0be99005e req-d1a8f34c-858a-401b-b9da-beaf3b803f5e service nova] Creating event network-vif-plugged:be058d27-ec10-484e-9f81-e51deac36522 for instance 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 on hv-cinder-85862 Sep 21 16:24:00.189894 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-e85a41d2-d06c-4728-a4b3-5ed0be99005e req-d1a8f34c-858a-401b-b9da-beaf3b803f5e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065152 Sep 21 16:24:00.193409 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 46/105] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:24:00.205262 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-cfaa5ac6-bda4-430a-b4ca-6c785f747099 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:00.226795 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-cfaa5ac6-bda4-430a-b4ca-6c785f747099 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77" status: 200 len: 1366 microversion: 2.1 time: 0.541386 Sep 21 16:24:00.232304 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 60/106] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:23:59 2022] GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 => generated 1366 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:00.723588 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-c8a915f1-c412-48fe-a9cb-871f2657fe72 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:00.724825 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-c8a915f1-c412-48fe-a9cb-871f2657fe72 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:00.735095 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c8a915f1-c412-48fe-a9cb-871f2657fe72 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:00.735599 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c8a915f1-c412-48fe-a9cb-871f2657fe72 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:00.736025 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c8a915f1-c412-48fe-a9cb-871f2657fe72 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:00.736934 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c8a915f1-c412-48fe-a9cb-871f2657fe72 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:00.737564 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c8a915f1-c412-48fe-a9cb-871f2657fe72 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:00.738199 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c8a915f1-c412-48fe-a9cb-871f2657fe72 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:01.149449 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-80deb8a7-288b-4176-8629-1f7beae32f5c req-6ae6f778-0cd8-47a9-83ff-0448060a2664 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f563aac-6055-4b77-b3bb-894ed14c1f64", "tag": "252450c8-e7d3-467d-be6e-17b527b01bb8"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:24:01.168996 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-80deb8a7-288b-4176-8629-1f7beae32f5c req-6ae6f778-0cd8-47a9-83ff-0448060a2664 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:01.175137 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-80deb8a7-288b-4176-8629-1f7beae32f5c req-6ae6f778-0cd8-47a9-83ff-0448060a2664 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:01.177185 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-80deb8a7-288b-4176-8629-1f7beae32f5c req-6ae6f778-0cd8-47a9-83ff-0448060a2664 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:01.206933 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-80deb8a7-288b-4176-8629-1f7beae32f5c req-6ae6f778-0cd8-47a9-83ff-0448060a2664 service nova] Creating event network-changed:252450c8-e7d3-467d-be6e-17b527b01bb8 for instance 5f563aac-6055-4b77-b3bb-894ed14c1f64 on hv-cinder-85862 Sep 21 16:24:01.226105 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-80deb8a7-288b-4176-8629-1f7beae32f5c req-6ae6f778-0cd8-47a9-83ff-0448060a2664 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080664 Sep 21 16:24:01.233209 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 61/107] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:24:01.251722 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-533df030-a4f5-4702-8601-39b3fedd10ec tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:01.253641 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-533df030-a4f5-4702-8601-39b3fedd10ec tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:01.277898 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-c8a915f1-c412-48fe-a9cb-871f2657fe72 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:01.293584 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-c8a915f1-c412-48fe-a9cb-871f2657fe72 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1321 microversion: 2.1 time: 0.570905 Sep 21 16:24:01.303032 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-533df030-a4f5-4702-8601-39b3fedd10ec tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:01.310650 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-533df030-a4f5-4702-8601-39b3fedd10ec tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:01.311393 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-533df030-a4f5-4702-8601-39b3fedd10ec tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:01.312663 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-533df030-a4f5-4702-8601-39b3fedd10ec tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:01.313318 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-533df030-a4f5-4702-8601-39b3fedd10ec tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:01.313897 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-533df030-a4f5-4702-8601-39b3fedd10ec tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:01.319959 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 47/108] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:00 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1321 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:01.343277 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-58ce7dfd-664b-4da3-88f2-bc6a4473875f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:01.345816 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-58ce7dfd-664b-4da3-88f2-bc6a4473875f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:01.379851 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-58ce7dfd-664b-4da3-88f2-bc6a4473875f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:01.381682 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-58ce7dfd-664b-4da3-88f2-bc6a4473875f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:01.382620 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-58ce7dfd-664b-4da3-88f2-bc6a4473875f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:01.386886 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-58ce7dfd-664b-4da3-88f2-bc6a4473875f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:01.388772 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-58ce7dfd-664b-4da3-88f2-bc6a4473875f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:01.390623 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-58ce7dfd-664b-4da3-88f2-bc6a4473875f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:01.739972 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-533df030-a4f5-4702-8601-39b3fedd10ec tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:01.754414 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-533df030-a4f5-4702-8601-39b3fedd10ec tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1364 microversion: 2.1 time: 0.519692 Sep 21 16:24:01.759585 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 62/109] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:01 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1364 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:02.100777 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-58ce7dfd-664b-4da3-88f2-bc6a4473875f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:02.113391 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-58ce7dfd-664b-4da3-88f2-bc6a4473875f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77" status: 200 len: 1366 microversion: 2.1 time: 0.791892 Sep 21 16:24:02.117365 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 48/110] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:01 2022] GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 => generated 1366 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:02.221526 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-75369660-7265-48bd-a678-8f99aac7f32e req-2995176e-408f-4485-a553-b496f221515d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c1436cc-a3f6-4683-abf2-e8835aa53021", "name": "network-vif-plugged", "status": "completed", "tag": "2b416c16-2f39-4d35-bf8a-8301720a840d"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:24:02.236210 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-75369660-7265-48bd-a678-8f99aac7f32e req-2995176e-408f-4485-a553-b496f221515d service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:02.237485 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-75369660-7265-48bd-a678-8f99aac7f32e req-2995176e-408f-4485-a553-b496f221515d service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:02.243536 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-75369660-7265-48bd-a678-8f99aac7f32e req-2995176e-408f-4485-a553-b496f221515d service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:02.262801 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-75369660-7265-48bd-a678-8f99aac7f32e req-2995176e-408f-4485-a553-b496f221515d service nova] Creating event network-vif-plugged:2b416c16-2f39-4d35-bf8a-8301720a840d for instance 1c1436cc-a3f6-4683-abf2-e8835aa53021 on hv-cinder-85862 Sep 21 16:24:02.272266 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-75369660-7265-48bd-a678-8f99aac7f32e req-2995176e-408f-4485-a553-b496f221515d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055029 Sep 21 16:24:02.275073 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 63/111] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:24:02.346758 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-db8f670b-cb6e-403f-8acb-f4a5650e8b5f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:02.347489 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-db8f670b-cb6e-403f-8acb-f4a5650e8b5f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:02.359073 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-db8f670b-cb6e-403f-8acb-f4a5650e8b5f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:02.359073 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-db8f670b-cb6e-403f-8acb-f4a5650e8b5f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:02.359073 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-db8f670b-cb6e-403f-8acb-f4a5650e8b5f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:02.366259 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-db8f670b-cb6e-403f-8acb-f4a5650e8b5f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:02.367121 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-db8f670b-cb6e-403f-8acb-f4a5650e8b5f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:02.367901 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-db8f670b-cb6e-403f-8acb-f4a5650e8b5f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:02.808433 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-a38c0040-dc75-49e9-a87c-b85b00e1ea35 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:02.809655 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-a38c0040-dc75-49e9-a87c-b85b00e1ea35 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:02.838798 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a38c0040-dc75-49e9-a87c-b85b00e1ea35 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:02.839497 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a38c0040-dc75-49e9-a87c-b85b00e1ea35 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:02.841139 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a38c0040-dc75-49e9-a87c-b85b00e1ea35 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:02.842298 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a38c0040-dc75-49e9-a87c-b85b00e1ea35 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:02.843397 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a38c0040-dc75-49e9-a87c-b85b00e1ea35 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:02.844111 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a38c0040-dc75-49e9-a87c-b85b00e1ea35 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:03.219657 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a38c0040-dc75-49e9-a87c-b85b00e1ea35 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:03.235662 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-a38c0040-dc75-49e9-a87c-b85b00e1ea35 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1364 microversion: 2.1 time: 0.435872 Sep 21 16:24:03.242440 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 64/112] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:02 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1364 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:24:03.252301 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-687eb20b-9b8c-4b4c-8811-705663b2fb35 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:03.259711 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-687eb20b-9b8c-4b4c-8811-705663b2fb35 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:03.263001 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-db8f670b-cb6e-403f-8acb-f4a5650e8b5f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:03.286289 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-687eb20b-9b8c-4b4c-8811-705663b2fb35 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:03.286869 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-687eb20b-9b8c-4b4c-8811-705663b2fb35 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:03.287329 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-687eb20b-9b8c-4b4c-8811-705663b2fb35 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:03.288174 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-687eb20b-9b8c-4b4c-8811-705663b2fb35 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:03.288648 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-687eb20b-9b8c-4b4c-8811-705663b2fb35 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:03.289084 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-687eb20b-9b8c-4b4c-8811-705663b2fb35 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:03.291504 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-db8f670b-cb6e-403f-8acb-f4a5650e8b5f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1516 microversion: 2.1 time: 0.934237 Sep 21 16:24:03.319680 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 49/113] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:02 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1516 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:03.325534 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-2bc0a711-b15e-4dd8-bb3e-ab1f110ab94a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:24:03.327878 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-2bc0a711-b15e-4dd8-bb3e-ab1f110ab94a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:03.340739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2bc0a711-b15e-4dd8-bb3e-ab1f110ab94a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:03.341617 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2bc0a711-b15e-4dd8-bb3e-ab1f110ab94a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:03.342300 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2bc0a711-b15e-4dd8-bb3e-ab1f110ab94a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:03.343221 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2bc0a711-b15e-4dd8-bb3e-ab1f110ab94a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:03.343854 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2bc0a711-b15e-4dd8-bb3e-ab1f110ab94a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:03.344818 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2bc0a711-b15e-4dd8-bb3e-ab1f110ab94a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:03.435074 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.objects.instance [None req-2bc0a711-b15e-4dd8-bb3e-ab1f110ab94a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lazy-loading 'flavor' on Instance uuid 7ef57390-7f44-4191-bee4-bacbdd74290c {{(pid=120531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 16:24:03.614701 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-687eb20b-9b8c-4b4c-8811-705663b2fb35 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:03.624628 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-2bc0a711-b15e-4dd8-bb3e-ab1f110ab94a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "POST /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c/action" status: 200 len: 32 microversion: 2.1 time: 0.302643 Sep 21 16:24:03.625692 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 50/114] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Sep 21 16:24:03 2022] POST /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c/action => generated 32 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 21 16:24:03.630402 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-687eb20b-9b8c-4b4c-8811-705663b2fb35 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77" status: 200 len: 1366 microversion: 2.1 time: 0.385583 Sep 21 16:24:03.631976 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 65/115] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:03 2022] GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 => generated 1366 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:03.640764 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d6f1d540-7d46-4765-9276-b78193901660 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:03.641960 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d6f1d540-7d46-4765-9276-b78193901660 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:03.656052 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d6f1d540-7d46-4765-9276-b78193901660 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:03.657133 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d6f1d540-7d46-4765-9276-b78193901660 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:03.658027 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d6f1d540-7d46-4765-9276-b78193901660 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:03.659923 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d6f1d540-7d46-4765-9276-b78193901660 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:03.660925 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d6f1d540-7d46-4765-9276-b78193901660 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:03.661823 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d6f1d540-7d46-4765-9276-b78193901660 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:03.904228 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d6f1d540-7d46-4765-9276-b78193901660 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:03.927144 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d6f1d540-7d46-4765-9276-b78193901660 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1522 microversion: 2.1 time: 0.291329 Sep 21 16:24:03.928620 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 51/116] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:03 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:04.288191 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-fd7a6bc7-cd8e-438d-807a-61d9e52a7cc7 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:04.291896 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-fd7a6bc7-cd8e-438d-807a-61d9e52a7cc7 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:04.301574 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fd7a6bc7-cd8e-438d-807a-61d9e52a7cc7 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:04.302737 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fd7a6bc7-cd8e-438d-807a-61d9e52a7cc7 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:04.303609 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fd7a6bc7-cd8e-438d-807a-61d9e52a7cc7 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:04.304728 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fd7a6bc7-cd8e-438d-807a-61d9e52a7cc7 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:04.305794 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fd7a6bc7-cd8e-438d-807a-61d9e52a7cc7 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:04.306510 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fd7a6bc7-cd8e-438d-807a-61d9e52a7cc7 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:04.570577 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-fd7a6bc7-cd8e-438d-807a-61d9e52a7cc7 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:04.580831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-fd7a6bc7-cd8e-438d-807a-61d9e52a7cc7 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1364 microversion: 2.1 time: 0.301858 Sep 21 16:24:04.581500 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 66/117] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:04 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1364 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:04.662984 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-67c3d5a0-ff5c-4843-849a-ac7ae2a99e2b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:04.664209 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-67c3d5a0-ff5c-4843-849a-ac7ae2a99e2b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:04.686026 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-67c3d5a0-ff5c-4843-849a-ac7ae2a99e2b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:04.687253 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-67c3d5a0-ff5c-4843-849a-ac7ae2a99e2b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:04.688290 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-67c3d5a0-ff5c-4843-849a-ac7ae2a99e2b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:04.690440 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-67c3d5a0-ff5c-4843-849a-ac7ae2a99e2b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:04.691899 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-67c3d5a0-ff5c-4843-849a-ac7ae2a99e2b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:04.693615 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-67c3d5a0-ff5c-4843-849a-ac7ae2a99e2b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:04.899148 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-67c3d5a0-ff5c-4843-849a-ac7ae2a99e2b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:04.907903 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-67c3d5a0-ff5c-4843-849a-ac7ae2a99e2b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77" status: 200 len: 1556 microversion: 2.1 time: 0.252909 Sep 21 16:24:04.908771 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 52/118] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:04 2022] GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 => generated 1556 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:04.933718 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-b977a8d9-03cc-4078-908c-a09718f869a5 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:04.934260 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-b977a8d9-03cc-4078-908c-a09718f869a5 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:04.942668 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b977a8d9-03cc-4078-908c-a09718f869a5 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:04.943418 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b977a8d9-03cc-4078-908c-a09718f869a5 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:04.944187 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b977a8d9-03cc-4078-908c-a09718f869a5 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:04.945034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b977a8d9-03cc-4078-908c-a09718f869a5 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:04.945773 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b977a8d9-03cc-4078-908c-a09718f869a5 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:04.947090 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b977a8d9-03cc-4078-908c-a09718f869a5 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:04.963690 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-f5695bbd-620b-4d4e-a816-68c9ffe0ee83 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:04.965811 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-f5695bbd-620b-4d4e-a816-68c9ffe0ee83 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:04.982741 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f5695bbd-620b-4d4e-a816-68c9ffe0ee83 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:04.984082 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f5695bbd-620b-4d4e-a816-68c9ffe0ee83 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:04.985606 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f5695bbd-620b-4d4e-a816-68c9ffe0ee83 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:04.987449 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f5695bbd-620b-4d4e-a816-68c9ffe0ee83 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:04.989544 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f5695bbd-620b-4d4e-a816-68c9ffe0ee83 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:04.990801 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f5695bbd-620b-4d4e-a816-68c9ffe0ee83 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:05.050511 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-b977a8d9-03cc-4078-908c-a09718f869a5 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.121575 Sep 21 16:24:05.061117 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 67/119] 10.222.0.64 () {58 vars in 1275 bytes} [Wed Sep 21 16:24:04 2022] GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77/os-interface => generated 285 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:24:05.540656 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-f5695bbd-620b-4d4e-a816-68c9ffe0ee83 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:05.555532 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-f5695bbd-620b-4d4e-a816-68c9ffe0ee83 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1522 microversion: 2.1 time: 0.602270 Sep 21 16:24:05.557872 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 53/120] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:04 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1522 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:05.613143 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-8ce1c185-154e-4431-9059-2bfb7812e879 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:05.615265 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-8ce1c185-154e-4431-9059-2bfb7812e879 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:05.619091 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_api:SELECT=97 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:05.632866 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8ce1c185-154e-4431-9059-2bfb7812e879 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:05.634556 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8ce1c185-154e-4431-9059-2bfb7812e879 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:05.635420 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8ce1c185-154e-4431-9059-2bfb7812e879 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:05.637802 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8ce1c185-154e-4431-9059-2bfb7812e879 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:05.638710 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8ce1c185-154e-4431-9059-2bfb7812e879 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:05.640933 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8ce1c185-154e-4431-9059-2bfb7812e879 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:06.004017 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-8ce1c185-154e-4431-9059-2bfb7812e879 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:06.016780 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-8ce1c185-154e-4431-9059-2bfb7812e879 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1364 microversion: 2.1 time: 0.412758 Sep 21 16:24:06.017681 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 68/121] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:05 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1364 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:06.581393 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-9a6a6979-8881-4649-943f-f5a9846e8bd4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:06.582370 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-9a6a6979-8881-4649-943f-f5a9846e8bd4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:06.594100 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9a6a6979-8881-4649-943f-f5a9846e8bd4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:06.594516 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9a6a6979-8881-4649-943f-f5a9846e8bd4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:06.594999 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9a6a6979-8881-4649-943f-f5a9846e8bd4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:06.595760 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9a6a6979-8881-4649-943f-f5a9846e8bd4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:06.596402 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9a6a6979-8881-4649-943f-f5a9846e8bd4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:06.596841 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9a6a6979-8881-4649-943f-f5a9846e8bd4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:07.048718 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-49fe475a-6040-486e-9f3a-8570259e0360 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:07.052386 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-49fe475a-6040-486e-9f3a-8570259e0360 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:07.069109 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-49fe475a-6040-486e-9f3a-8570259e0360 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:07.070577 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-49fe475a-6040-486e-9f3a-8570259e0360 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:07.071852 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-49fe475a-6040-486e-9f3a-8570259e0360 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:07.073507 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-49fe475a-6040-486e-9f3a-8570259e0360 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:07.074781 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-49fe475a-6040-486e-9f3a-8570259e0360 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:07.075859 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-49fe475a-6040-486e-9f3a-8570259e0360 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:07.328921 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-49fe475a-6040-486e-9f3a-8570259e0360 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:07.342208 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-49fe475a-6040-486e-9f3a-8570259e0360 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1364 microversion: 2.1 time: 0.303076 Sep 21 16:24:07.344114 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 69/122] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:07 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1364 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:07.348163 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-9a6a6979-8881-4649-943f-f5a9846e8bd4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:07.368941 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-9a6a6979-8881-4649-943f-f5a9846e8bd4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1522 microversion: 2.1 time: 0.790551 Sep 21 16:24:07.370359 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 54/123] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:06 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1522 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:07.695807 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-cc5c9708-ce8c-4a01-929b-bde1451fecd4 req-026c66e2-ba68-4355-9c7b-76d7ec93cea2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72c89a30-cc9f-472e-9fa3-8ad2f7c36b77", "tag": "be058d27-ec10-484e-9f81-e51deac36522"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:24:07.713394 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-a4a3201b-4f61-4687-a55f-6974c89d33d9 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:07.715192 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-a4a3201b-4f61-4687-a55f-6974c89d33d9 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] [instance: 62a18317-e115-4326-b942-b6bc791a882a] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:07.717545 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-cc5c9708-ce8c-4a01-929b-bde1451fecd4 req-026c66e2-ba68-4355-9c7b-76d7ec93cea2 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:07.719090 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-cc5c9708-ce8c-4a01-929b-bde1451fecd4 req-026c66e2-ba68-4355-9c7b-76d7ec93cea2 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:07.720128 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-cc5c9708-ce8c-4a01-929b-bde1451fecd4 req-026c66e2-ba68-4355-9c7b-76d7ec93cea2 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:07.741970 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a4a3201b-4f61-4687-a55f-6974c89d33d9 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:07.743190 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a4a3201b-4f61-4687-a55f-6974c89d33d9 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:07.750952 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-cc5c9708-ce8c-4a01-929b-bde1451fecd4 req-026c66e2-ba68-4355-9c7b-76d7ec93cea2 service nova] Creating event network-changed:be058d27-ec10-484e-9f81-e51deac36522 for instance 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 on hv-cinder-85862 Sep 21 16:24:07.751653 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a4a3201b-4f61-4687-a55f-6974c89d33d9 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:07.754273 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a4a3201b-4f61-4687-a55f-6974c89d33d9 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:07.755104 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a4a3201b-4f61-4687-a55f-6974c89d33d9 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:07.758073 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a4a3201b-4f61-4687-a55f-6974c89d33d9 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:07.764385 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-cc5c9708-ce8c-4a01-929b-bde1451fecd4 req-026c66e2-ba68-4355-9c7b-76d7ec93cea2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076957 Sep 21 16:24:07.766131 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 70/124] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:24:07.833776 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-a4a3201b-4f61-4687-a55f-6974c89d33d9 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] [instance: 62a18317-e115-4326-b942-b6bc791a882a] Going to try to terminate instance {{(pid=120531) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 16:24:08.000941 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-a4a3201b-4f61-4687-a55f-6974c89d33d9 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] 10.222.0.64 "DELETE /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a" status: 204 len: 0 microversion: 2.1 time: 0.294140 Sep 21 16:24:08.003116 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 55/125] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Sep 21 16:24:07 2022] DELETE /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 21 16:24:08.013135 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-fae155a6-a026-404b-8094-273f2c2b8219 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:08.014285 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-fae155a6-a026-404b-8094-273f2c2b8219 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] [instance: 62a18317-e115-4326-b942-b6bc791a882a] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:08.024762 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fae155a6-a026-404b-8094-273f2c2b8219 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:08.025676 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fae155a6-a026-404b-8094-273f2c2b8219 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:08.027393 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fae155a6-a026-404b-8094-273f2c2b8219 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:08.028455 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fae155a6-a026-404b-8094-273f2c2b8219 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:08.029106 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fae155a6-a026-404b-8094-273f2c2b8219 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:08.029745 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fae155a6-a026-404b-8094-273f2c2b8219 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:08.287992 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-fae155a6-a026-404b-8094-273f2c2b8219 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f83757d3484a58b89ec39d46effaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94ef89f42ce4bc9920e9ac5f1c573e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:08.312492 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-fae155a6-a026-404b-8094-273f2c2b8219 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] 10.222.0.64 "GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a" status: 200 len: 1553 microversion: 2.1 time: 0.304318 Sep 21 16:24:08.314312 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 71/126] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:08 2022] GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a => generated 1553 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:24:08.377108 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-4144c720-7ca4-4c05-9abd-da433ae4b7a9 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:08.414720 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-4144c720-7ca4-4c05-9abd-da433ae4b7a9 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:08.416028 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-3b9f00e0-fe6c-4042-b9b4-510679801c97 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:08.420169 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-3b9f00e0-fe6c-4042-b9b4-510679801c97 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:08.441660 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4144c720-7ca4-4c05-9abd-da433ae4b7a9 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:08.442608 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4144c720-7ca4-4c05-9abd-da433ae4b7a9 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:08.443279 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4144c720-7ca4-4c05-9abd-da433ae4b7a9 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:08.448424 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3b9f00e0-fe6c-4042-b9b4-510679801c97 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:08.450593 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4144c720-7ca4-4c05-9abd-da433ae4b7a9 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:08.451854 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3b9f00e0-fe6c-4042-b9b4-510679801c97 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:08.452641 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4144c720-7ca4-4c05-9abd-da433ae4b7a9 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:08.454007 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3b9f00e0-fe6c-4042-b9b4-510679801c97 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:08.454630 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4144c720-7ca4-4c05-9abd-da433ae4b7a9 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:08.457832 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3b9f00e0-fe6c-4042-b9b4-510679801c97 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:08.458607 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3b9f00e0-fe6c-4042-b9b4-510679801c97 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:08.461464 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3b9f00e0-fe6c-4042-b9b4-510679801c97 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:08.521983 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:08.881008 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-4144c720-7ca4-4c05-9abd-da433ae4b7a9 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:08.885434 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:08.905588 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-4144c720-7ca4-4c05-9abd-da433ae4b7a9 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1550 microversion: 2.1 time: 0.536873 Sep 21 16:24:08.919138 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 56/127] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:08 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1550 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:08.925875 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-3b9f00e0-fe6c-4042-b9b4-510679801c97 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:08.933496 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-ab8ebd37-349b-4b71-8855-341f7e7cbc10 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:08.934515 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-ab8ebd37-349b-4b71-8855-341f7e7cbc10 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:08.939452 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-3b9f00e0-fe6c-4042-b9b4-510679801c97 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1522 microversion: 2.1 time: 0.549079 Sep 21 16:24:08.944020 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ab8ebd37-349b-4b71-8855-341f7e7cbc10 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:08.945146 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ab8ebd37-349b-4b71-8855-341f7e7cbc10 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:08.946432 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ab8ebd37-349b-4b71-8855-341f7e7cbc10 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:08.947422 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ab8ebd37-349b-4b71-8855-341f7e7cbc10 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:08.948132 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ab8ebd37-349b-4b71-8855-341f7e7cbc10 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:08.949085 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ab8ebd37-349b-4b71-8855-341f7e7cbc10 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:08.949384 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 72/128] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:08 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1522 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:09.084519 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-ab8ebd37-349b-4b71-8855-341f7e7cbc10 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.155861 Sep 21 16:24:09.085366 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 57/129] 10.222.0.64 () {58 vars in 1275 bytes} [Wed Sep 21 16:24:08 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021/os-interface => generated 284 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:24:09.340354 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-8142f426-2447-473c-a185-e6cb613e1da8 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:09.340977 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-8142f426-2447-473c-a185-e6cb613e1da8 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] [instance: 62a18317-e115-4326-b942-b6bc791a882a] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:09.350024 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8142f426-2447-473c-a185-e6cb613e1da8 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:09.350738 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8142f426-2447-473c-a185-e6cb613e1da8 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:09.351323 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8142f426-2447-473c-a185-e6cb613e1da8 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:09.352233 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8142f426-2447-473c-a185-e6cb613e1da8 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:09.355849 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8142f426-2447-473c-a185-e6cb613e1da8 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:09.356664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8142f426-2447-473c-a185-e6cb613e1da8 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:09.641657 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-8142f426-2447-473c-a185-e6cb613e1da8 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f83757d3484a58b89ec39d46effaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94ef89f42ce4bc9920e9ac5f1c573e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:09.654423 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-8142f426-2447-473c-a185-e6cb613e1da8 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] 10.222.0.64 "GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a" status: 200 len: 1553 microversion: 2.1 time: 0.320005 Sep 21 16:24:09.655975 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 73/130] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:09 2022] GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a => generated 1553 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:09.988780 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d51944a0-139a-411f-8270-6e5676c88ad1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:09.989889 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d51944a0-139a-411f-8270-6e5676c88ad1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:10.005660 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:10.008717 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d51944a0-139a-411f-8270-6e5676c88ad1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:10.010698 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d51944a0-139a-411f-8270-6e5676c88ad1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:10.012252 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d51944a0-139a-411f-8270-6e5676c88ad1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:10.014002 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d51944a0-139a-411f-8270-6e5676c88ad1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:10.015037 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d51944a0-139a-411f-8270-6e5676c88ad1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:10.015966 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d51944a0-139a-411f-8270-6e5676c88ad1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:10.718603 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-546a7753-47e6-467f-948f-27ccb01498c9 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:10.719921 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-546a7753-47e6-467f-948f-27ccb01498c9 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] [instance: 62a18317-e115-4326-b942-b6bc791a882a] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:10.735861 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-546a7753-47e6-467f-948f-27ccb01498c9 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:10.736397 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-546a7753-47e6-467f-948f-27ccb01498c9 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:10.736891 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-546a7753-47e6-467f-948f-27ccb01498c9 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:10.745636 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-546a7753-47e6-467f-948f-27ccb01498c9 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:10.746963 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-546a7753-47e6-467f-948f-27ccb01498c9 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:10.747165 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-546a7753-47e6-467f-948f-27ccb01498c9 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:10.954417 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-546a7753-47e6-467f-948f-27ccb01498c9 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f83757d3484a58b89ec39d46effaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94ef89f42ce4bc9920e9ac5f1c573e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:10.974404 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-546a7753-47e6-467f-948f-27ccb01498c9 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] 10.222.0.64 "GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a" status: 200 len: 1553 microversion: 2.1 time: 0.260623 Sep 21 16:24:10.975734 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 74/131] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:10 2022] GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a => generated 1553 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:24:11.390491 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d51944a0-139a-411f-8270-6e5676c88ad1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:11.439731 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d51944a0-139a-411f-8270-6e5676c88ad1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1522 microversion: 2.1 time: 1.456906 Sep 21 16:24:11.442533 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 58/132] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:09 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1522 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:12.017214 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-67557a2b-a8ca-4f74-b4af-b43c783cf7b3 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:12.017977 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-67557a2b-a8ca-4f74-b4af-b43c783cf7b3 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] [instance: 62a18317-e115-4326-b942-b6bc791a882a] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:12.024467 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-67557a2b-a8ca-4f74-b4af-b43c783cf7b3 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:12.024980 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-67557a2b-a8ca-4f74-b4af-b43c783cf7b3 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:12.025414 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-67557a2b-a8ca-4f74-b4af-b43c783cf7b3 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:12.026181 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-67557a2b-a8ca-4f74-b4af-b43c783cf7b3 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:12.026643 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-67557a2b-a8ca-4f74-b4af-b43c783cf7b3 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:12.027056 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-67557a2b-a8ca-4f74-b4af-b43c783cf7b3 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:12.204078 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-67557a2b-a8ca-4f74-b4af-b43c783cf7b3 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f83757d3484a58b89ec39d46effaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94ef89f42ce4bc9920e9ac5f1c573e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:12.222843 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-67557a2b-a8ca-4f74-b4af-b43c783cf7b3 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] 10.222.0.64 "GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a" status: 200 len: 1553 microversion: 2.1 time: 0.209292 Sep 21 16:24:12.224278 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 75/133] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:12 2022] GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a => generated 1553 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:12.472860 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-0c6aa47c-b616-4800-8fd2-4edf3ae9261e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:12.473944 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-0c6aa47c-b616-4800-8fd2-4edf3ae9261e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:12.497607 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0c6aa47c-b616-4800-8fd2-4edf3ae9261e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:12.498776 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0c6aa47c-b616-4800-8fd2-4edf3ae9261e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:12.500024 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0c6aa47c-b616-4800-8fd2-4edf3ae9261e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:12.501849 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0c6aa47c-b616-4800-8fd2-4edf3ae9261e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:12.502698 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0c6aa47c-b616-4800-8fd2-4edf3ae9261e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:12.503439 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0c6aa47c-b616-4800-8fd2-4edf3ae9261e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:12.853850 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-1e96ee5d-435c-481f-9bcc-3546b58d4805 req-d643de61-7e57-4cb2-ac8d-c875b86cec5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62a18317-e115-4326-b942-b6bc791a882a", "name": "network-vif-deleted", "tag": "2f918381-0144-4a84-9f9f-e5a972f31ab9"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:24:12.866388 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-1e96ee5d-435c-481f-9bcc-3546b58d4805 req-d643de61-7e57-4cb2-ac8d-c875b86cec5c service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:12.866871 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-1e96ee5d-435c-481f-9bcc-3546b58d4805 req-d643de61-7e57-4cb2-ac8d-c875b86cec5c service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:12.867501 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-1e96ee5d-435c-481f-9bcc-3546b58d4805 req-d643de61-7e57-4cb2-ac8d-c875b86cec5c service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:12.898799 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-1e96ee5d-435c-481f-9bcc-3546b58d4805 req-d643de61-7e57-4cb2-ac8d-c875b86cec5c service nova] Creating event network-vif-deleted:2f918381-0144-4a84-9f9f-e5a972f31ab9 for instance 62a18317-e115-4326-b942-b6bc791a882a on hv-cinder-85862 Sep 21 16:24:12.915548 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-1e96ee5d-435c-481f-9bcc-3546b58d4805 req-d643de61-7e57-4cb2-ac8d-c875b86cec5c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065048 Sep 21 16:24:12.918748 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 76/134] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:24:12.976234 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-0c6aa47c-b616-4800-8fd2-4edf3ae9261e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:12.991299 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-0c6aa47c-b616-4800-8fd2-4edf3ae9261e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1522 microversion: 2.1 time: 0.527437 Sep 21 16:24:12.993984 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 59/135] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:12 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1522 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:13.251397 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-28eefd1b-711a-4882-8d10-800f8fda207a tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:13.253637 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-28eefd1b-711a-4882-8d10-800f8fda207a tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] [instance: 62a18317-e115-4326-b942-b6bc791a882a] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:13.263074 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-28eefd1b-711a-4882-8d10-800f8fda207a tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:13.263855 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-28eefd1b-711a-4882-8d10-800f8fda207a tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:13.264472 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-28eefd1b-711a-4882-8d10-800f8fda207a tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:13.265703 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-28eefd1b-711a-4882-8d10-800f8fda207a tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:13.266672 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-28eefd1b-711a-4882-8d10-800f8fda207a tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:13.267467 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-28eefd1b-711a-4882-8d10-800f8fda207a tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:13.373301 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-28eefd1b-711a-4882-8d10-800f8fda207a tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f83757d3484a58b89ec39d46effaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94ef89f42ce4bc9920e9ac5f1c573e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:13.390859 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-28eefd1b-711a-4882-8d10-800f8fda207a tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] 10.222.0.64 "GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a" status: 200 len: 1511 microversion: 2.1 time: 0.146209 Sep 21 16:24:13.392368 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 77/136] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:13 2022] GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a => generated 1511 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:24:14.054264 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-dcab179c-b1f4-4ec2-ab45-9a26d31d1fcb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:14.059931 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-dcab179c-b1f4-4ec2-ab45-9a26d31d1fcb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:14.074122 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dcab179c-b1f4-4ec2-ab45-9a26d31d1fcb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:14.075227 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dcab179c-b1f4-4ec2-ab45-9a26d31d1fcb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:14.076179 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dcab179c-b1f4-4ec2-ab45-9a26d31d1fcb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:14.077625 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dcab179c-b1f4-4ec2-ab45-9a26d31d1fcb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:14.078538 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dcab179c-b1f4-4ec2-ab45-9a26d31d1fcb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:14.079285 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dcab179c-b1f4-4ec2-ab45-9a26d31d1fcb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:14.301950 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-dcab179c-b1f4-4ec2-ab45-9a26d31d1fcb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:14.316911 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-dcab179c-b1f4-4ec2-ab45-9a26d31d1fcb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1522 microversion: 2.1 time: 0.286664 Sep 21 16:24:14.317934 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 60/137] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:14 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:24:14.431384 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c29c3790-a19d-4550-ab89-3a30a8479b90 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:14.432719 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-c29c3790-a19d-4550-ab89-3a30a8479b90 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] [instance: 62a18317-e115-4326-b942-b6bc791a882a] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:14.439841 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c29c3790-a19d-4550-ab89-3a30a8479b90 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:14.440429 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c29c3790-a19d-4550-ab89-3a30a8479b90 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:14.441099 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c29c3790-a19d-4550-ab89-3a30a8479b90 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:14.441899 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c29c3790-a19d-4550-ab89-3a30a8479b90 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:14.442674 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c29c3790-a19d-4550-ab89-3a30a8479b90 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:14.443323 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c29c3790-a19d-4550-ab89-3a30a8479b90 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:14.540806 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-c29c3790-a19d-4550-ab89-3a30a8479b90 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f83757d3484a58b89ec39d46effaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94ef89f42ce4bc9920e9ac5f1c573e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:14.553330 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-c29c3790-a19d-4550-ab89-3a30a8479b90 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] 10.222.0.64 "GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a" status: 200 len: 1345 microversion: 2.1 time: 0.126635 Sep 21 16:24:14.555559 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 78/138] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:14 2022] GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a => generated 1345 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:14.959318 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-4940ff8a-a91e-49ba-a375-59d418d697fe req-286aa823-e972-4154-83e1-82f032b959b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c1436cc-a3f6-4683-abf2-e8835aa53021", "tag": "2b416c16-2f39-4d35-bf8a-8301720a840d"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:24:14.971997 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-4940ff8a-a91e-49ba-a375-59d418d697fe req-286aa823-e972-4154-83e1-82f032b959b1 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:14.971997 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-4940ff8a-a91e-49ba-a375-59d418d697fe req-286aa823-e972-4154-83e1-82f032b959b1 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:14.972375 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-4940ff8a-a91e-49ba-a375-59d418d697fe req-286aa823-e972-4154-83e1-82f032b959b1 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:14.990405 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-4940ff8a-a91e-49ba-a375-59d418d697fe req-286aa823-e972-4154-83e1-82f032b959b1 service nova] Creating event network-changed:2b416c16-2f39-4d35-bf8a-8301720a840d for instance 1c1436cc-a3f6-4683-abf2-e8835aa53021 on hv-cinder-85862 Sep 21 16:24:14.996259 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-4940ff8a-a91e-49ba-a375-59d418d697fe req-286aa823-e972-4154-83e1-82f032b959b1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044858 Sep 21 16:24:14.996988 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 61/139] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:24:15.366393 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-39450906-594f-4e3e-9017-61e60dc2262d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:15.378635 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-39450906-594f-4e3e-9017-61e60dc2262d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:15.399297 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-39450906-594f-4e3e-9017-61e60dc2262d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:15.400331 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-39450906-594f-4e3e-9017-61e60dc2262d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:15.401269 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-39450906-594f-4e3e-9017-61e60dc2262d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:15.404123 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-39450906-594f-4e3e-9017-61e60dc2262d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:15.409421 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-39450906-594f-4e3e-9017-61e60dc2262d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:15.410520 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-39450906-594f-4e3e-9017-61e60dc2262d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:15.605545 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-b4fd9cfe-d284-429d-b8dd-2f87426a40a5 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:15.609455 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-b4fd9cfe-d284-429d-b8dd-2f87426a40a5 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] [instance: 62a18317-e115-4326-b942-b6bc791a882a] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:15.638259 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b4fd9cfe-d284-429d-b8dd-2f87426a40a5 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:15.639338 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b4fd9cfe-d284-429d-b8dd-2f87426a40a5 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:15.640084 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b4fd9cfe-d284-429d-b8dd-2f87426a40a5 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:15.641175 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b4fd9cfe-d284-429d-b8dd-2f87426a40a5 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:15.641993 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b4fd9cfe-d284-429d-b8dd-2f87426a40a5 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:15.642726 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b4fd9cfe-d284-429d-b8dd-2f87426a40a5 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:15.781595 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-39450906-594f-4e3e-9017-61e60dc2262d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:15.805431 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-39450906-594f-4e3e-9017-61e60dc2262d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1522 microversion: 2.1 time: 0.453083 Sep 21 16:24:15.811884 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 79/140] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:15 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1522 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:15.824300 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-b4fd9cfe-d284-429d-b8dd-2f87426a40a5 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f83757d3484a58b89ec39d46effaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94ef89f42ce4bc9920e9ac5f1c573e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:15.846233 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-b4fd9cfe-d284-429d-b8dd-2f87426a40a5 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] 10.222.0.64 "GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a" status: 200 len: 1345 microversion: 2.1 time: 0.258000 Sep 21 16:24:15.858767 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 62/141] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:15 2022] GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a => generated 1345 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:24:16.850280 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-58f7d8a8-5e75-4ffa-b20a-5103c962bfc4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:16.850280 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-58f7d8a8-5e75-4ffa-b20a-5103c962bfc4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:16.879490 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-58f7d8a8-5e75-4ffa-b20a-5103c962bfc4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:16.880372 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-58f7d8a8-5e75-4ffa-b20a-5103c962bfc4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:16.884903 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-58f7d8a8-5e75-4ffa-b20a-5103c962bfc4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:16.897692 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-902021f3-8af9-4ff7-94ac-f8634a7d5537 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:16.901024 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-902021f3-8af9-4ff7-94ac-f8634a7d5537 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] [instance: 62a18317-e115-4326-b942-b6bc791a882a] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:16.903184 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-58f7d8a8-5e75-4ffa-b20a-5103c962bfc4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:16.905514 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-58f7d8a8-5e75-4ffa-b20a-5103c962bfc4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:16.928029 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-58f7d8a8-5e75-4ffa-b20a-5103c962bfc4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:16.942762 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-902021f3-8af9-4ff7-94ac-f8634a7d5537 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:16.946965 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-902021f3-8af9-4ff7-94ac-f8634a7d5537 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:16.951163 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-902021f3-8af9-4ff7-94ac-f8634a7d5537 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:16.956643 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-902021f3-8af9-4ff7-94ac-f8634a7d5537 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:16.957578 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-902021f3-8af9-4ff7-94ac-f8634a7d5537 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:16.958317 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-902021f3-8af9-4ff7-94ac-f8634a7d5537 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:17.114894 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-902021f3-8af9-4ff7-94ac-f8634a7d5537 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:17.115393 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-902021f3-8af9-4ff7-94ac-f8634a7d5537 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:17.116153 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-902021f3-8af9-4ff7-94ac-f8634a7d5537 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:17.117404 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.objects.instance [None req-902021f3-8af9-4ff7-94ac-f8634a7d5537 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lazy-loading 'fault' on Instance uuid 62a18317-e115-4326-b942-b6bc791a882a {{(pid=120531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 16:24:17.210441 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-902021f3-8af9-4ff7-94ac-f8634a7d5537 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f83757d3484a58b89ec39d46effaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94ef89f42ce4bc9920e9ac5f1c573e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:17.232808 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-902021f3-8af9-4ff7-94ac-f8634a7d5537 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] 10.222.0.64 "GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a" status: 200 len: 1304 microversion: 2.1 time: 0.342625 Sep 21 16:24:17.236365 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 63/142] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:16 2022] GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a => generated 1304 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:17.343952 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-58f7d8a8-5e75-4ffa-b20a-5103c962bfc4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:17.358473 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-58f7d8a8-5e75-4ffa-b20a-5103c962bfc4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1522 microversion: 2.1 time: 0.516605 Sep 21 16:24:17.359810 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 80/143] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:16 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1522 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:18.284618 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-9a77d029-decc-4ac2-b180-204ef1484d48 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:18.286690 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-9a77d029-decc-4ac2-b180-204ef1484d48 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] [instance: 62a18317-e115-4326-b942-b6bc791a882a] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:18.296498 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9a77d029-decc-4ac2-b180-204ef1484d48 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:18.297378 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9a77d029-decc-4ac2-b180-204ef1484d48 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:18.298022 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9a77d029-decc-4ac2-b180-204ef1484d48 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:18.298825 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9a77d029-decc-4ac2-b180-204ef1484d48 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:18.299345 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9a77d029-decc-4ac2-b180-204ef1484d48 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:18.299980 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9a77d029-decc-4ac2-b180-204ef1484d48 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:18.316815 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.wsgi [None req-9a77d029-decc-4ac2-b180-204ef1484d48 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] HTTP exception thrown: Instance 62a18317-e115-4326-b942-b6bc791a882a could not be found. Sep 21 16:24:18.322531 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-9a77d029-decc-4ac2-b180-204ef1484d48 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Request method failure captured: Sep 21 16:24:18.322531 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: request: GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a HTTP/1.1 Sep 21 16:24:18.322531 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept: application/json Sep 21 16:24:18.322531 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept-Encoding: identity Sep 21 16:24:18.322531 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Connection: close Sep 21 16:24:18.322531 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Length: 0 Sep 21 16:24:18.322531 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Type: application/json Sep 21 16:24:18.322531 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Host: 10.222.0.64 Sep 21 16:24:18.322531 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Openstack-System-Scope: None Sep 21 16:24:18.322531 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: User-Agent: python-urllib3/1.26.12 Sep 21 16:24:18.322531 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Auth-Token: gAAAAABjKzprQOEN-LCRolENnSuQ2vGIvaShDhCyCQfJfYR24rye91bJtTCj4a2PaYpaq_zAuRE55ii98qPHiM21iRs4nig44oEcY-c9eUz9PErL4NJl-VMTQQc3wS5zDpjBsKx1KFILD6EcAV7A7SS8ndmEvrF7L6QZsT4AZGP5fH5RL1sAcGI Sep 21 16:24:18.322531 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Id: None Sep 21 16:24:18.322531 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Name: None Sep 21 16:24:18.322531 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Identity-Status: Confirmed Sep 21 16:24:18.322531 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Is-Admin-Project: True Sep 21 16:24:18.322531 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Id: default Sep 21 16:24:18.322531 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Name: Default Sep 21 16:24:18.322531 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Id: b94ef89f42ce4bc9920e9ac5f1c573e4 Sep 21 16:24:18.322531 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Name: tempest-DeleteServersTestJSON-788561472 Sep 21 16:24:18.322531 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Role: member,reader Sep 21 16:24:18.322531 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Roles: member,reader Sep 21 16:24:18.325277 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/b94ef89f42ce4bc9920e9ac5f1c573e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b94ef89f42ce4bc9920e9ac5f1c573e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_b94ef89f42ce4bc9920e9ac5f1c573e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b94ef89f42ce4bc9920e9ac5f1c573e4"}]}] Sep 21 16:24:18.325277 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant: tempest-DeleteServersTestJSON-788561472 Sep 21 16:24:18.325277 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Id: b94ef89f42ce4bc9920e9ac5f1c573e4 Sep 21 16:24:18.325277 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Name: tempest-DeleteServersTestJSON-788561472 Sep 21 16:24:18.325277 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User: tempest-DeleteServersTestJSON-788561472-project Sep 21 16:24:18.325277 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Id: default Sep 21 16:24:18.325277 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Name: Default Sep 21 16:24:18.325277 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Id: a4f83757d3484a58b89ec39d46effaab Sep 21 16:24:18.325277 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Name: tempest-DeleteServersTestJSON-788561472-project Sep 21 16:24:18.325277 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: method: > Sep 21 16:24:18.325277 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: exception: Instance 62a18317-e115-4326-b942-b6bc791a882a could not be found. Sep 21 16:24:18.325277 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: action_args: {'id': '62a18317-e115-4326-b942-b6bc791a882a'} Sep 21 16:24:18.327986 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:24:18.327986 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:24:18.327986 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 16:24:18.327986 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 16:24:18.327986 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 16:24:18.327986 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 16:24:18.327986 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 16:24:18.327986 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 16:24:18.327986 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 16:24:18.327986 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 16:24:18.327986 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62a18317-e115-4326-b942-b6bc791a882a could not be found. Sep 21 16:24:18.327986 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:24:18.327986 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:24:18.327986 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:24:18.327986 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:24:18.327986 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:24:18.327986 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:24:18.327986 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:24:18.327986 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:24:18.327986 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:24:18.331524 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:24:18.331524 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 16:24:18.331524 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 16:24:18.331524 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 16:24:18.331524 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 16:24:18.331524 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 16:24:18.331524 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:24:18.331524 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62a18317-e115-4326-b942-b6bc791a882a could not be found. Sep 21 16:24:18.331524 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:24:18.331524 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:24:18.331524 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:24:18.331524 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:24:18.331524 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:24:18.331524 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:24:18.331524 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:24:18.331524 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:24:18.331524 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62a18317-e115-4326-b942-b6bc791a882a could not be found. Sep 21 16:24:18.331524 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:24:18.335986 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-9a77d029-decc-4ac2-b180-204ef1484d48 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Returning 404 to user: Instance 62a18317-e115-4326-b942-b6bc791a882a could not be found. {{(pid=120531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:24:18.335986 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-9a77d029-decc-4ac2-b180-204ef1484d48 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] 10.222.0.64 "GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a" status: 404 len: 111 microversion: 2.1 time: 0.044828 Sep 21 16:24:18.335986 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 64/144] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:18 2022] GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 16:24:18.392981 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-0e0c4aa6-68b8-42ad-8e2b-3402f3211b53 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:18.393866 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-0e0c4aa6-68b8-42ad-8e2b-3402f3211b53 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:18.402648 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0e0c4aa6-68b8-42ad-8e2b-3402f3211b53 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:18.403073 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0e0c4aa6-68b8-42ad-8e2b-3402f3211b53 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:18.403411 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0e0c4aa6-68b8-42ad-8e2b-3402f3211b53 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:18.404328 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0e0c4aa6-68b8-42ad-8e2b-3402f3211b53 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:18.405082 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0e0c4aa6-68b8-42ad-8e2b-3402f3211b53 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:18.405481 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0e0c4aa6-68b8-42ad-8e2b-3402f3211b53 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:18.530919 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-74df07dc-0b5b-4eb6-86ed-653693665644 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:18.533977 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-74df07dc-0b5b-4eb6-86ed-653693665644 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] [instance: 62a18317-e115-4326-b942-b6bc791a882a] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:18.544420 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-74df07dc-0b5b-4eb6-86ed-653693665644 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:18.544993 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-74df07dc-0b5b-4eb6-86ed-653693665644 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:18.545605 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-74df07dc-0b5b-4eb6-86ed-653693665644 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:18.546212 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-74df07dc-0b5b-4eb6-86ed-653693665644 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:18.546761 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-74df07dc-0b5b-4eb6-86ed-653693665644 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:18.547198 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-74df07dc-0b5b-4eb6-86ed-653693665644 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:18.563593 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.wsgi [None req-74df07dc-0b5b-4eb6-86ed-653693665644 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] HTTP exception thrown: Instance 62a18317-e115-4326-b942-b6bc791a882a could not be found. Sep 21 16:24:18.566377 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-74df07dc-0b5b-4eb6-86ed-653693665644 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Request method failure captured: Sep 21 16:24:18.566377 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: request: GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a/os-volume_attachments HTTP/1.1 Sep 21 16:24:18.566377 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept: application/json Sep 21 16:24:18.566377 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept-Encoding: identity Sep 21 16:24:18.566377 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Connection: close Sep 21 16:24:18.566377 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Length: 0 Sep 21 16:24:18.566377 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Type: application/json Sep 21 16:24:18.566377 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Host: 10.222.0.64 Sep 21 16:24:18.566377 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Openstack-System-Scope: None Sep 21 16:24:18.566377 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: User-Agent: python-urllib3/1.26.12 Sep 21 16:24:18.566377 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Auth-Token: gAAAAABjKzprQOEN-LCRolENnSuQ2vGIvaShDhCyCQfJfYR24rye91bJtTCj4a2PaYpaq_zAuRE55ii98qPHiM21iRs4nig44oEcY-c9eUz9PErL4NJl-VMTQQc3wS5zDpjBsKx1KFILD6EcAV7A7SS8ndmEvrF7L6QZsT4AZGP5fH5RL1sAcGI Sep 21 16:24:18.566377 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Id: None Sep 21 16:24:18.566377 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Name: None Sep 21 16:24:18.566377 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Identity-Status: Confirmed Sep 21 16:24:18.566377 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Is-Admin-Project: True Sep 21 16:24:18.566377 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Id: default Sep 21 16:24:18.566377 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Name: Default Sep 21 16:24:18.566377 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Id: b94ef89f42ce4bc9920e9ac5f1c573e4 Sep 21 16:24:18.566377 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Name: tempest-DeleteServersTestJSON-788561472 Sep 21 16:24:18.566377 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Role: member,reader Sep 21 16:24:18.566377 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Roles: member,reader Sep 21 16:24:18.574860 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/b94ef89f42ce4bc9920e9ac5f1c573e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b94ef89f42ce4bc9920e9ac5f1c573e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_b94ef89f42ce4bc9920e9ac5f1c573e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b94ef89f42ce4bc9920e9ac5f1c573e4"}]}] Sep 21 16:24:18.574860 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant: tempest-DeleteServersTestJSON-788561472 Sep 21 16:24:18.574860 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Id: b94ef89f42ce4bc9920e9ac5f1c573e4 Sep 21 16:24:18.574860 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Name: tempest-DeleteServersTestJSON-788561472 Sep 21 16:24:18.574860 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User: tempest-DeleteServersTestJSON-788561472-project Sep 21 16:24:18.574860 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Id: default Sep 21 16:24:18.574860 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Name: Default Sep 21 16:24:18.574860 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Id: a4f83757d3484a58b89ec39d46effaab Sep 21 16:24:18.574860 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Name: tempest-DeleteServersTestJSON-788561472-project Sep 21 16:24:18.574860 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: method: > Sep 21 16:24:18.574860 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: exception: Instance 62a18317-e115-4326-b942-b6bc791a882a could not be found. Sep 21 16:24:18.574860 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: action_args: {'server_id': '62a18317-e115-4326-b942-b6bc791a882a'} Sep 21 16:24:18.576369 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:24:18.576369 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:24:18.576369 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 16:24:18.576369 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 16:24:18.576369 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 16:24:18.576369 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 16:24:18.576369 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 16:24:18.576369 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 16:24:18.576369 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 16:24:18.576369 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 16:24:18.576369 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62a18317-e115-4326-b942-b6bc791a882a could not be found. Sep 21 16:24:18.576369 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:24:18.576369 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:24:18.576369 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:24:18.576369 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:24:18.576369 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:24:18.576369 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:24:18.576369 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:24:18.576369 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:24:18.576369 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:24:18.578907 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:24:18.578907 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 21 16:24:18.578907 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 21 16:24:18.578907 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 21 16:24:18.578907 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 21 16:24:18.578907 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 21 16:24:18.578907 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 21 16:24:18.578907 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 16:24:18.578907 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:24:18.578907 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62a18317-e115-4326-b942-b6bc791a882a could not be found. Sep 21 16:24:18.578907 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:24:18.578907 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:24:18.578907 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:24:18.578907 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:24:18.578907 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:24:18.578907 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:24:18.578907 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:24:18.578907 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:24:18.578907 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62a18317-e115-4326-b942-b6bc791a882a could not be found. Sep 21 16:24:18.578907 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:24:18.581311 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-74df07dc-0b5b-4eb6-86ed-653693665644 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Returning 404 to user: Instance 62a18317-e115-4326-b942-b6bc791a882a could not be found. {{(pid=120531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:24:18.581311 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-74df07dc-0b5b-4eb6-86ed-653693665644 tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] 10.222.0.64 "GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.041770 Sep 21 16:24:18.581311 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 65/145] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Sep 21 16:24:18 2022] GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a/os-volume_attachments => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 21 16:24:18.784783 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-0e0c4aa6-68b8-42ad-8e2b-3402f3211b53 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:18.800710 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-0e0c4aa6-68b8-42ad-8e2b-3402f3211b53 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1522 microversion: 2.1 time: 0.412083 Sep 21 16:24:18.801578 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 81/146] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:18 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1522 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:19.829430 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-89e2c918-e2a9-4b3f-a3a6-c2d4ba4bae3b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:19.830273 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-89e2c918-e2a9-4b3f-a3a6-c2d4ba4bae3b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:19.841430 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-89e2c918-e2a9-4b3f-a3a6-c2d4ba4bae3b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:19.842097 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-89e2c918-e2a9-4b3f-a3a6-c2d4ba4bae3b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:19.842669 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-89e2c918-e2a9-4b3f-a3a6-c2d4ba4bae3b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:19.843810 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-89e2c918-e2a9-4b3f-a3a6-c2d4ba4bae3b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:19.844597 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-89e2c918-e2a9-4b3f-a3a6-c2d4ba4bae3b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:19.845023 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-89e2c918-e2a9-4b3f-a3a6-c2d4ba4bae3b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:19.878212 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-447719d4-b685-49f9-ab96-d2a2f539df9a tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:19.879080 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-447719d4-b685-49f9-ab96-d2a2f539df9a tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] [instance: 62a18317-e115-4326-b942-b6bc791a882a] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:19.903745 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-447719d4-b685-49f9-ab96-d2a2f539df9a tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:19.910560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-447719d4-b685-49f9-ab96-d2a2f539df9a tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:19.910560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-447719d4-b685-49f9-ab96-d2a2f539df9a tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:19.911749 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-447719d4-b685-49f9-ab96-d2a2f539df9a tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:19.912695 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-447719d4-b685-49f9-ab96-d2a2f539df9a tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:19.912695 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-447719d4-b685-49f9-ab96-d2a2f539df9a tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:19.949451 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.wsgi [None req-447719d4-b685-49f9-ab96-d2a2f539df9a tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] HTTP exception thrown: Instance 62a18317-e115-4326-b942-b6bc791a882a could not be found. Sep 21 16:24:19.958530 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-447719d4-b685-49f9-ab96-d2a2f539df9a tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Request method failure captured: Sep 21 16:24:19.958530 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: request: DELETE /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a HTTP/1.1 Sep 21 16:24:19.958530 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept: application/json Sep 21 16:24:19.958530 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept-Encoding: identity Sep 21 16:24:19.958530 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Connection: close Sep 21 16:24:19.958530 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Length: 0 Sep 21 16:24:19.958530 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Type: application/json Sep 21 16:24:19.958530 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Host: 10.222.0.64 Sep 21 16:24:19.958530 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Openstack-System-Scope: None Sep 21 16:24:19.958530 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: User-Agent: python-urllib3/1.26.12 Sep 21 16:24:19.958530 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Auth-Token: gAAAAABjKzprQOEN-LCRolENnSuQ2vGIvaShDhCyCQfJfYR24rye91bJtTCj4a2PaYpaq_zAuRE55ii98qPHiM21iRs4nig44oEcY-c9eUz9PErL4NJl-VMTQQc3wS5zDpjBsKx1KFILD6EcAV7A7SS8ndmEvrF7L6QZsT4AZGP5fH5RL1sAcGI Sep 21 16:24:19.958530 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Id: None Sep 21 16:24:19.958530 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Name: None Sep 21 16:24:19.958530 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Identity-Status: Confirmed Sep 21 16:24:19.958530 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Is-Admin-Project: True Sep 21 16:24:19.958530 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Id: default Sep 21 16:24:19.958530 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Name: Default Sep 21 16:24:19.958530 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Id: b94ef89f42ce4bc9920e9ac5f1c573e4 Sep 21 16:24:19.958530 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Name: tempest-DeleteServersTestJSON-788561472 Sep 21 16:24:19.958530 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Role: member,reader Sep 21 16:24:19.958530 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Roles: member,reader Sep 21 16:24:19.960368 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/b94ef89f42ce4bc9920e9ac5f1c573e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b94ef89f42ce4bc9920e9ac5f1c573e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_b94ef89f42ce4bc9920e9ac5f1c573e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b94ef89f42ce4bc9920e9ac5f1c573e4"}]}] Sep 21 16:24:19.960368 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant: tempest-DeleteServersTestJSON-788561472 Sep 21 16:24:19.960368 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Id: b94ef89f42ce4bc9920e9ac5f1c573e4 Sep 21 16:24:19.960368 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Name: tempest-DeleteServersTestJSON-788561472 Sep 21 16:24:19.960368 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User: tempest-DeleteServersTestJSON-788561472-project Sep 21 16:24:19.960368 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Id: default Sep 21 16:24:19.960368 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Name: Default Sep 21 16:24:19.960368 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Id: a4f83757d3484a58b89ec39d46effaab Sep 21 16:24:19.960368 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Name: tempest-DeleteServersTestJSON-788561472-project Sep 21 16:24:19.960368 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: method: > Sep 21 16:24:19.960368 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: exception: Instance 62a18317-e115-4326-b942-b6bc791a882a could not be found. Sep 21 16:24:19.960368 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: action_args: {'id': '62a18317-e115-4326-b942-b6bc791a882a'} Sep 21 16:24:19.961164 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:24:19.961164 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:24:19.961164 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 16:24:19.961164 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 16:24:19.961164 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 16:24:19.961164 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 16:24:19.961164 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 16:24:19.961164 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 16:24:19.961164 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 16:24:19.961164 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 16:24:19.961164 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62a18317-e115-4326-b942-b6bc791a882a could not be found. Sep 21 16:24:19.961164 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:24:19.961164 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:24:19.961164 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:24:19.961164 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:24:19.961164 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:24:19.961164 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:24:19.961164 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:24:19.961164 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:24:19.961164 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:24:19.962796 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:24:19.962796 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 21 16:24:19.962796 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 21 16:24:19.962796 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 21 16:24:19.962796 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 21 16:24:19.962796 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 16:24:19.962796 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 16:24:19.962796 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 16:24:19.962796 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:24:19.962796 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62a18317-e115-4326-b942-b6bc791a882a could not be found. Sep 21 16:24:19.962796 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:24:19.962796 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:24:19.962796 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:24:19.962796 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:24:19.962796 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:24:19.962796 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:24:19.962796 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:24:19.962796 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:24:19.962796 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62a18317-e115-4326-b942-b6bc791a882a could not be found. Sep 21 16:24:19.962796 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:24:19.964127 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-447719d4-b685-49f9-ab96-d2a2f539df9a tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Returning 404 to user: Instance 62a18317-e115-4326-b942-b6bc791a882a could not be found. {{(pid=120532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:24:19.964127 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-447719d4-b685-49f9-ab96-d2a2f539df9a tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] 10.222.0.64 "DELETE /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a" status: 404 len: 111 microversion: 2.1 time: 0.091658 Sep 21 16:24:19.967351 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 82/147] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Sep 21 16:24:19 2022] DELETE /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 16:24:19.977765 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-df4e87b9-07b5-4fee-844b-9bb48622782c tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:19.978958 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-df4e87b9-07b5-4fee-844b-9bb48622782c tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] [instance: 62a18317-e115-4326-b942-b6bc791a882a] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:19.991278 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-df4e87b9-07b5-4fee-844b-9bb48622782c tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:19.992744 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-df4e87b9-07b5-4fee-844b-9bb48622782c tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:19.993418 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-df4e87b9-07b5-4fee-844b-9bb48622782c tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:19.994787 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-df4e87b9-07b5-4fee-844b-9bb48622782c tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:19.995631 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-df4e87b9-07b5-4fee-844b-9bb48622782c tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:19.996418 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-df4e87b9-07b5-4fee-844b-9bb48622782c tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:20.020560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.wsgi [None req-df4e87b9-07b5-4fee-844b-9bb48622782c tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] HTTP exception thrown: Instance 62a18317-e115-4326-b942-b6bc791a882a could not be found. Sep 21 16:24:20.023062 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-df4e87b9-07b5-4fee-844b-9bb48622782c tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Request method failure captured: Sep 21 16:24:20.023062 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: request: GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a HTTP/1.1 Sep 21 16:24:20.023062 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept: application/json Sep 21 16:24:20.023062 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept-Encoding: identity Sep 21 16:24:20.023062 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Connection: close Sep 21 16:24:20.023062 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Length: 0 Sep 21 16:24:20.023062 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Type: application/json Sep 21 16:24:20.023062 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Host: 10.222.0.64 Sep 21 16:24:20.023062 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Openstack-System-Scope: None Sep 21 16:24:20.023062 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: User-Agent: python-urllib3/1.26.12 Sep 21 16:24:20.023062 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Auth-Token: gAAAAABjKzprQOEN-LCRolENnSuQ2vGIvaShDhCyCQfJfYR24rye91bJtTCj4a2PaYpaq_zAuRE55ii98qPHiM21iRs4nig44oEcY-c9eUz9PErL4NJl-VMTQQc3wS5zDpjBsKx1KFILD6EcAV7A7SS8ndmEvrF7L6QZsT4AZGP5fH5RL1sAcGI Sep 21 16:24:20.023062 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Id: None Sep 21 16:24:20.023062 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Name: None Sep 21 16:24:20.023062 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Identity-Status: Confirmed Sep 21 16:24:20.023062 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Is-Admin-Project: True Sep 21 16:24:20.023062 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Id: default Sep 21 16:24:20.023062 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Name: Default Sep 21 16:24:20.023062 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Id: b94ef89f42ce4bc9920e9ac5f1c573e4 Sep 21 16:24:20.023062 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Name: tempest-DeleteServersTestJSON-788561472 Sep 21 16:24:20.023062 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Role: member,reader Sep 21 16:24:20.023062 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Roles: member,reader Sep 21 16:24:20.026133 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/b94ef89f42ce4bc9920e9ac5f1c573e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b94ef89f42ce4bc9920e9ac5f1c573e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_b94ef89f42ce4bc9920e9ac5f1c573e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b94ef89f42ce4bc9920e9ac5f1c573e4"}]}] Sep 21 16:24:20.026133 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant: tempest-DeleteServersTestJSON-788561472 Sep 21 16:24:20.026133 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Id: b94ef89f42ce4bc9920e9ac5f1c573e4 Sep 21 16:24:20.026133 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Name: tempest-DeleteServersTestJSON-788561472 Sep 21 16:24:20.026133 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User: tempest-DeleteServersTestJSON-788561472-project Sep 21 16:24:20.026133 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Id: default Sep 21 16:24:20.026133 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Name: Default Sep 21 16:24:20.026133 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Id: a4f83757d3484a58b89ec39d46effaab Sep 21 16:24:20.026133 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Name: tempest-DeleteServersTestJSON-788561472-project Sep 21 16:24:20.026133 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: method: > Sep 21 16:24:20.026133 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: exception: Instance 62a18317-e115-4326-b942-b6bc791a882a could not be found. Sep 21 16:24:20.026133 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: action_args: {'id': '62a18317-e115-4326-b942-b6bc791a882a'} Sep 21 16:24:20.027365 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:24:20.027365 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:24:20.027365 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 16:24:20.027365 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 16:24:20.027365 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 16:24:20.027365 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 16:24:20.027365 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 16:24:20.027365 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 16:24:20.027365 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 16:24:20.027365 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 16:24:20.027365 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62a18317-e115-4326-b942-b6bc791a882a could not be found. Sep 21 16:24:20.027365 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:24:20.027365 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:24:20.027365 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:24:20.027365 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:24:20.027365 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:24:20.027365 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:24:20.027365 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:24:20.027365 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:24:20.027365 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:24:20.029334 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:24:20.029334 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 16:24:20.029334 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 16:24:20.029334 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 16:24:20.029334 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 16:24:20.029334 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 16:24:20.029334 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:24:20.029334 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62a18317-e115-4326-b942-b6bc791a882a could not be found. Sep 21 16:24:20.029334 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:24:20.029334 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:24:20.029334 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:24:20.029334 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:24:20.029334 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:24:20.029334 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:24:20.029334 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:24:20.029334 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:24:20.029334 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62a18317-e115-4326-b942-b6bc791a882a could not be found. Sep 21 16:24:20.029334 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:24:20.031538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-df4e87b9-07b5-4fee-844b-9bb48622782c tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] Returning 404 to user: Instance 62a18317-e115-4326-b942-b6bc791a882a could not be found. {{(pid=120532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:24:20.031538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-df4e87b9-07b5-4fee-844b-9bb48622782c tempest-DeleteServersTestJSON-788561472 tempest-DeleteServersTestJSON-788561472-project] 10.222.0.64 "GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a" status: 404 len: 111 microversion: 2.1 time: 0.055495 Sep 21 16:24:20.031538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 83/148] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:19 2022] GET /compute/v2.1/servers/62a18317-e115-4326-b942-b6bc791a882a => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 16:24:20.073049 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-89e2c918-e2a9-4b3f-a3a6-c2d4ba4bae3b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:20.083999 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-89e2c918-e2a9-4b3f-a3a6-c2d4ba4bae3b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1522 microversion: 2.1 time: 0.259246 Sep 21 16:24:20.084696 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 66/149] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:19 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:24:21.125864 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-9277311a-f87d-4f93-b42b-2e9ab7b156b9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:21.127028 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-9277311a-f87d-4f93-b42b-2e9ab7b156b9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:21.138815 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9277311a-f87d-4f93-b42b-2e9ab7b156b9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:21.139955 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9277311a-f87d-4f93-b42b-2e9ab7b156b9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:21.140994 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9277311a-f87d-4f93-b42b-2e9ab7b156b9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:21.142752 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9277311a-f87d-4f93-b42b-2e9ab7b156b9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:21.143866 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9277311a-f87d-4f93-b42b-2e9ab7b156b9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:21.144792 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9277311a-f87d-4f93-b42b-2e9ab7b156b9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:21.581710 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-9277311a-f87d-4f93-b42b-2e9ab7b156b9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:21.595850 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-9277311a-f87d-4f93-b42b-2e9ab7b156b9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1522 microversion: 2.1 time: 0.478332 Sep 21 16:24:21.596833 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 84/150] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:21 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1522 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:22.633153 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-91772804-8d22-4090-b01c-aef266a78ff3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:22.634685 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-91772804-8d22-4090-b01c-aef266a78ff3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:22.645714 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-91772804-8d22-4090-b01c-aef266a78ff3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:22.651508 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-91772804-8d22-4090-b01c-aef266a78ff3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:22.656187 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-91772804-8d22-4090-b01c-aef266a78ff3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:22.658748 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-91772804-8d22-4090-b01c-aef266a78ff3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:22.659785 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-91772804-8d22-4090-b01c-aef266a78ff3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:22.660590 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-91772804-8d22-4090-b01c-aef266a78ff3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:23.173914 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-91772804-8d22-4090-b01c-aef266a78ff3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:23.189180 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-91772804-8d22-4090-b01c-aef266a78ff3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1522 microversion: 2.1 time: 0.563551 Sep 21 16:24:23.202394 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 67/151] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:22 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1522 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:24.216084 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ccb070e1-7e94-4372-b777-a9fbe2d49087 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:24.217010 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ccb070e1-7e94-4372-b777-a9fbe2d49087 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:24.226418 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ccb070e1-7e94-4372-b777-a9fbe2d49087 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:24.226914 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ccb070e1-7e94-4372-b777-a9fbe2d49087 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:24.227554 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ccb070e1-7e94-4372-b777-a9fbe2d49087 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:24.228451 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ccb070e1-7e94-4372-b777-a9fbe2d49087 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:24.229305 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ccb070e1-7e94-4372-b777-a9fbe2d49087 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:24.229903 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ccb070e1-7e94-4372-b777-a9fbe2d49087 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:24.677387 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ccb070e1-7e94-4372-b777-a9fbe2d49087 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:24.709623 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ccb070e1-7e94-4372-b777-a9fbe2d49087 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1522 microversion: 2.1 time: 0.496645 Sep 21 16:24:24.727554 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 85/152] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:24 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1522 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:25.744142 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-4d067a97-9ff9-4be4-a373-4c93fda5ccd1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:25.744756 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-4d067a97-9ff9-4be4-a373-4c93fda5ccd1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:25.755387 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4d067a97-9ff9-4be4-a373-4c93fda5ccd1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:25.755875 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4d067a97-9ff9-4be4-a373-4c93fda5ccd1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:25.756562 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4d067a97-9ff9-4be4-a373-4c93fda5ccd1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:25.763491 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4d067a97-9ff9-4be4-a373-4c93fda5ccd1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:25.771844 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4d067a97-9ff9-4be4-a373-4c93fda5ccd1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:25.773620 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4d067a97-9ff9-4be4-a373-4c93fda5ccd1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:26.287601 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-4d067a97-9ff9-4be4-a373-4c93fda5ccd1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:26.309844 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-4d067a97-9ff9-4be4-a373-4c93fda5ccd1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1522 microversion: 2.1 time: 0.570663 Sep 21 16:24:26.310878 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 68/153] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:25 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1522 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:27.337813 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-3111a64b-4628-4aaf-b113-018e70aa8478 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:27.339087 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-3111a64b-4628-4aaf-b113-018e70aa8478 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:27.355257 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3111a64b-4628-4aaf-b113-018e70aa8478 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:27.356215 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3111a64b-4628-4aaf-b113-018e70aa8478 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:27.357388 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3111a64b-4628-4aaf-b113-018e70aa8478 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:27.359075 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3111a64b-4628-4aaf-b113-018e70aa8478 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:27.360219 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3111a64b-4628-4aaf-b113-018e70aa8478 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:27.361108 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3111a64b-4628-4aaf-b113-018e70aa8478 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:27.651947 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-3111a64b-4628-4aaf-b113-018e70aa8478 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:27.669145 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-3111a64b-4628-4aaf-b113-018e70aa8478 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1522 microversion: 2.1 time: 0.337493 Sep 21 16:24:27.670514 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 86/154] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:27 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1522 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:28.720571 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-25ceb81b-41e8-4c7a-8b52-0f0883a3bb1e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:28.721564 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-25ceb81b-41e8-4c7a-8b52-0f0883a3bb1e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:28.758992 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-25ceb81b-41e8-4c7a-8b52-0f0883a3bb1e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:28.759597 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-25ceb81b-41e8-4c7a-8b52-0f0883a3bb1e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:28.760131 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-25ceb81b-41e8-4c7a-8b52-0f0883a3bb1e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:28.761016 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-25ceb81b-41e8-4c7a-8b52-0f0883a3bb1e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:28.761708 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-25ceb81b-41e8-4c7a-8b52-0f0883a3bb1e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:28.762434 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-25ceb81b-41e8-4c7a-8b52-0f0883a3bb1e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:28.974169 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-25ceb81b-41e8-4c7a-8b52-0f0883a3bb1e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:28.991917 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-25ceb81b-41e8-4c7a-8b52-0f0883a3bb1e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1522 microversion: 2.1 time: 0.278042 Sep 21 16:24:28.993725 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 69/155] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:28 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:24:29.590770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-f4d159e4-835e-4cf8-a1b6-38bbfe782ff9 tempest-VolumesNegativeTest-1330262200 tempest-VolumesNegativeTest-1330262200-project] Action: 'create', calling method: .version_select at 0x7fdb88d44f70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1218890625", "metadata": {"Type": "work"}}} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:24:29.603197 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-f4d159e4-835e-4cf8-a1b6-38bbfe782ff9 tempest-VolumesNegativeTest-1330262200 tempest-VolumesNegativeTest-1330262200-project] Request method failure captured: Sep 21 16:24:29.603197 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 21 16:24:29.603197 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept: application/json Sep 21 16:24:29.603197 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept-Encoding: identity Sep 21 16:24:29.603197 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Connection: close Sep 21 16:24:29.603197 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Length: 122 Sep 21 16:24:29.603197 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Type: application/json Sep 21 16:24:29.603197 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Host: 10.222.0.64 Sep 21 16:24:29.603197 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Openstack-System-Scope: None Sep 21 16:24:29.603197 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: User-Agent: python-urllib3/1.26.12 Sep 21 16:24:29.603197 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Auth-Token: gAAAAABjKzq9qGKy2A0VyIEIok9bLHUPS3dIP21BvVYOZWlc7BxEQEdyXmcRqBMBKzRj3jD_yEpGPJOka41fvIIygQgmCAyE1eBFI8KQvPYVC_vw6catCpnrfBYCkM630ygfqzCUutaQBbReocF4snjBoCgxau8FqLCrbpG7DxTFcs6FQVcb9gs Sep 21 16:24:29.603197 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Id: None Sep 21 16:24:29.603197 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Name: None Sep 21 16:24:29.603197 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Identity-Status: Confirmed Sep 21 16:24:29.603197 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Is-Admin-Project: True Sep 21 16:24:29.603197 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Id: default Sep 21 16:24:29.603197 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Name: Default Sep 21 16:24:29.603197 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Id: 93a17d42b4214148a5417741adc02198 Sep 21 16:24:29.603197 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Name: tempest-VolumesNegativeTest-1330262200 Sep 21 16:24:29.603197 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Role: member,reader Sep 21 16:24:29.603197 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Roles: member,reader Sep 21 16:24:29.604582 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/93a17d42b4214148a5417741adc02198"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/93a17d42b4214148a5417741adc02198"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_93a17d42b4214148a5417741adc02198"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/93a17d42b4214148a5417741adc02198"}]}] Sep 21 16:24:29.604582 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant: tempest-VolumesNegativeTest-1330262200 Sep 21 16:24:29.604582 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Id: 93a17d42b4214148a5417741adc02198 Sep 21 16:24:29.604582 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Name: tempest-VolumesNegativeTest-1330262200 Sep 21 16:24:29.604582 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User: tempest-VolumesNegativeTest-1330262200-project Sep 21 16:24:29.604582 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Id: default Sep 21 16:24:29.604582 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Name: Default Sep 21 16:24:29.604582 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Id: 9aa93530363f4f28a2c437773dd25fea Sep 21 16:24:29.604582 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Name: tempest-VolumesNegativeTest-1330262200-project Sep 21 16:24:29.604582 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Sep 21 16:24:29.604582 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1218890625", "metadata": {"Type": "work"}}} Sep 21 16:24:29.604582 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: method: Sep 21 16:24:29.604582 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 21 16:24:29.605335 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1218890625', 'metadata': {'Type': 'work'}}}} Sep 21 16:24:29.605335 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:24:29.605335 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:24:29.605335 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 21 16:24:29.605335 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 21 16:24:29.605335 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 21 16:24:29.605335 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise error Sep 21 16:24:29.605335 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 21 16:24:29.605335 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.605335 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 21 16:24:29.605335 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 21 16:24:29.605335 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.605335 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 21 16:24:29.605335 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi '#$%' Sep 21 16:24:29.605335 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.605335 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:24:29.605335 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.605335 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:24:29.605335 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:24:29.605335 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:24:29.605335 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:24:29.605335 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:24:29.606633 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 21 16:24:29.606633 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 21 16:24:29.606633 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:24:29.606633 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:24:29.606633 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 21 16:24:29.606633 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 21 16:24:29.606633 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 21 16:24:29.606633 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 21 16:24:29.606633 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 21 16:24:29.606633 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 21 16:24:29.606633 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 21 16:24:29.606633 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.606633 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:24:29.606633 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.606633 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:24:29.606633 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:24:29.606633 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:24:29.606633 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 21 16:24:29.606633 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 21 16:24:29.607674 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 21 16:24:29.607674 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.607674 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-f4d159e4-835e-4cf8-a1b6-38bbfe782ff9 tempest-VolumesNegativeTest-1330262200 tempest-VolumesNegativeTest-1330262200-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:24:29.607674 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-f4d159e4-835e-4cf8-a1b6-38bbfe782ff9 tempest-VolumesNegativeTest-1330262200 tempest-VolumesNegativeTest-1330262200-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.480526 Sep 21 16:24:29.607674 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 87/156] 10.222.0.64 () {60 vars in 1156 bytes} [Wed Sep 21 16:24:29 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 483 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 21 16:24:29.619142 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-1f114d7c-a898-4af3-91ac-21c0a7890808 tempest-VolumesNegativeTest-1330262200 tempest-VolumesNegativeTest-1330262200-project] Action: 'create', calling method: .version_select at 0x7fdb88d93b80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1737304750", "metadata": {"Type": "work"}}} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:24:29.624450 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-1f114d7c-a898-4af3-91ac-21c0a7890808 tempest-VolumesNegativeTest-1330262200 tempest-VolumesNegativeTest-1330262200-project] Request method failure captured: Sep 21 16:24:29.624450 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 21 16:24:29.624450 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept: application/json Sep 21 16:24:29.624450 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept-Encoding: identity Sep 21 16:24:29.624450 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Connection: close Sep 21 16:24:29.624450 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Length: 120 Sep 21 16:24:29.624450 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Type: application/json Sep 21 16:24:29.624450 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Host: 10.222.0.64 Sep 21 16:24:29.624450 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Openstack-System-Scope: None Sep 21 16:24:29.624450 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: User-Agent: python-urllib3/1.26.12 Sep 21 16:24:29.624450 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Auth-Token: gAAAAABjKzq9qGKy2A0VyIEIok9bLHUPS3dIP21BvVYOZWlc7BxEQEdyXmcRqBMBKzRj3jD_yEpGPJOka41fvIIygQgmCAyE1eBFI8KQvPYVC_vw6catCpnrfBYCkM630ygfqzCUutaQBbReocF4snjBoCgxau8FqLCrbpG7DxTFcs6FQVcb9gs Sep 21 16:24:29.624450 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Id: None Sep 21 16:24:29.624450 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Name: None Sep 21 16:24:29.624450 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Identity-Status: Confirmed Sep 21 16:24:29.624450 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Is-Admin-Project: True Sep 21 16:24:29.624450 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Id: default Sep 21 16:24:29.624450 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Name: Default Sep 21 16:24:29.624450 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Id: 93a17d42b4214148a5417741adc02198 Sep 21 16:24:29.624450 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Name: tempest-VolumesNegativeTest-1330262200 Sep 21 16:24:29.624450 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Role: member,reader Sep 21 16:24:29.624450 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Roles: member,reader Sep 21 16:24:29.625655 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/93a17d42b4214148a5417741adc02198"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/93a17d42b4214148a5417741adc02198"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_93a17d42b4214148a5417741adc02198"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/93a17d42b4214148a5417741adc02198"}]}] Sep 21 16:24:29.625655 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant: tempest-VolumesNegativeTest-1330262200 Sep 21 16:24:29.625655 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Id: 93a17d42b4214148a5417741adc02198 Sep 21 16:24:29.625655 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Name: tempest-VolumesNegativeTest-1330262200 Sep 21 16:24:29.625655 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User: tempest-VolumesNegativeTest-1330262200-project Sep 21 16:24:29.625655 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Id: default Sep 21 16:24:29.625655 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Name: Default Sep 21 16:24:29.625655 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Id: 9aa93530363f4f28a2c437773dd25fea Sep 21 16:24:29.625655 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Name: tempest-VolumesNegativeTest-1330262200-project Sep 21 16:24:29.625655 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Sep 21 16:24:29.625655 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1737304750", "metadata": {"Type": "work"}}} Sep 21 16:24:29.625655 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: method: Sep 21 16:24:29.625655 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 21 16:24:29.626856 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1737304750', 'metadata': {'Type': 'work'}}}} Sep 21 16:24:29.626856 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:24:29.626856 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:24:29.626856 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 21 16:24:29.626856 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 21 16:24:29.626856 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 21 16:24:29.626856 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise error Sep 21 16:24:29.626856 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 21 16:24:29.626856 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.626856 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 21 16:24:29.626856 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 21 16:24:29.626856 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.626856 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 21 16:24:29.626856 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi '0' Sep 21 16:24:29.626856 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.626856 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:24:29.626856 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.626856 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:24:29.626856 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:24:29.626856 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:24:29.626856 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:24:29.626856 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:24:29.628063 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 21 16:24:29.628063 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 21 16:24:29.628063 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:24:29.628063 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:24:29.628063 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 21 16:24:29.628063 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 21 16:24:29.628063 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 21 16:24:29.628063 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 21 16:24:29.628063 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 21 16:24:29.628063 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 21 16:24:29.628063 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 21 16:24:29.628063 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.628063 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:24:29.628063 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.628063 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:24:29.628063 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:24:29.628063 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:24:29.628063 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 21 16:24:29.628063 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 21 16:24:29.629158 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 21 16:24:29.629158 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.630791 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-1f114d7c-a898-4af3-91ac-21c0a7890808 tempest-VolumesNegativeTest-1330262200 tempest-VolumesNegativeTest-1330262200-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:24:29.631682 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-1f114d7c-a898-4af3-91ac-21c0a7890808 tempest-VolumesNegativeTest-1330262200 tempest-VolumesNegativeTest-1330262200-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.016676 Sep 21 16:24:29.632272 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 70/157] 10.222.0.64 () {60 vars in 1156 bytes} [Wed Sep 21 16:24:29 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 21 16:24:29.646174 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-65262df8-7add-4648-a2e2-e505d2f37f9f tempest-VolumesNegativeTest-1330262200 tempest-VolumesNegativeTest-1330262200-project] Action: 'create', calling method: .version_select at 0x7fdb88d623a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-754451184", "metadata": {"Type": "work"}}} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:24:29.653140 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-65262df8-7add-4648-a2e2-e505d2f37f9f tempest-VolumesNegativeTest-1330262200 tempest-VolumesNegativeTest-1330262200-project] Request method failure captured: Sep 21 16:24:29.653140 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 21 16:24:29.653140 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept: application/json Sep 21 16:24:29.653140 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept-Encoding: identity Sep 21 16:24:29.653140 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Connection: close Sep 21 16:24:29.653140 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Length: 118 Sep 21 16:24:29.653140 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Type: application/json Sep 21 16:24:29.653140 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Host: 10.222.0.64 Sep 21 16:24:29.653140 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Openstack-System-Scope: None Sep 21 16:24:29.653140 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: User-Agent: python-urllib3/1.26.12 Sep 21 16:24:29.653140 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Auth-Token: gAAAAABjKzq9qGKy2A0VyIEIok9bLHUPS3dIP21BvVYOZWlc7BxEQEdyXmcRqBMBKzRj3jD_yEpGPJOka41fvIIygQgmCAyE1eBFI8KQvPYVC_vw6catCpnrfBYCkM630ygfqzCUutaQBbReocF4snjBoCgxau8FqLCrbpG7DxTFcs6FQVcb9gs Sep 21 16:24:29.653140 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Id: None Sep 21 16:24:29.653140 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Name: None Sep 21 16:24:29.653140 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Identity-Status: Confirmed Sep 21 16:24:29.653140 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Is-Admin-Project: True Sep 21 16:24:29.653140 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Id: default Sep 21 16:24:29.653140 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Name: Default Sep 21 16:24:29.653140 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Id: 93a17d42b4214148a5417741adc02198 Sep 21 16:24:29.653140 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Name: tempest-VolumesNegativeTest-1330262200 Sep 21 16:24:29.653140 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Role: member,reader Sep 21 16:24:29.653140 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Roles: member,reader Sep 21 16:24:29.655992 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/93a17d42b4214148a5417741adc02198"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/93a17d42b4214148a5417741adc02198"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_93a17d42b4214148a5417741adc02198"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/93a17d42b4214148a5417741adc02198"}]}] Sep 21 16:24:29.655992 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant: tempest-VolumesNegativeTest-1330262200 Sep 21 16:24:29.655992 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Id: 93a17d42b4214148a5417741adc02198 Sep 21 16:24:29.655992 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Name: tempest-VolumesNegativeTest-1330262200 Sep 21 16:24:29.655992 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User: tempest-VolumesNegativeTest-1330262200-project Sep 21 16:24:29.655992 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Id: default Sep 21 16:24:29.655992 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Name: Default Sep 21 16:24:29.655992 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Id: 9aa93530363f4f28a2c437773dd25fea Sep 21 16:24:29.655992 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Name: tempest-VolumesNegativeTest-1330262200-project Sep 21 16:24:29.655992 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Sep 21 16:24:29.655992 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-754451184", "metadata": {"Type": "work"}}} Sep 21 16:24:29.655992 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: method: Sep 21 16:24:29.655992 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 21 16:24:29.657831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-754451184', 'metadata': {'Type': 'work'}}}} Sep 21 16:24:29.657831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:24:29.657831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:24:29.657831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 21 16:24:29.657831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 21 16:24:29.657831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 21 16:24:29.657831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise error Sep 21 16:24:29.657831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 21 16:24:29.657831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.657831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 21 16:24:29.657831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 21 16:24:29.657831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.657831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 21 16:24:29.657831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi '' Sep 21 16:24:29.657831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.657831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:24:29.657831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.657831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:24:29.657831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:24:29.657831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:24:29.657831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:24:29.657831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:24:29.660525 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 21 16:24:29.660525 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 21 16:24:29.660525 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:24:29.660525 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:24:29.660525 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 21 16:24:29.660525 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 21 16:24:29.660525 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 21 16:24:29.660525 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 21 16:24:29.660525 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 21 16:24:29.660525 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 21 16:24:29.660525 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 21 16:24:29.660525 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.660525 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:24:29.660525 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.660525 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:24:29.660525 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:24:29.660525 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:24:29.660525 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 21 16:24:29.660525 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 21 16:24:29.663866 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 21 16:24:29.663866 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.663866 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-65262df8-7add-4648-a2e2-e505d2f37f9f tempest-VolumesNegativeTest-1330262200 tempest-VolumesNegativeTest-1330262200-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:24:29.663866 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-65262df8-7add-4648-a2e2-e505d2f37f9f tempest-VolumesNegativeTest-1330262200 tempest-VolumesNegativeTest-1330262200-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017432 Sep 21 16:24:29.663866 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 88/158] 10.222.0.64 () {60 vars in 1156 bytes} [Wed Sep 21 16:24:29 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 21 16:24:29.678627 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-5c22bbe3-49a3-495b-8a23-40ec065bf0f4 tempest-VolumesNegativeTest-1330262200 tempest-VolumesNegativeTest-1330262200-project] Calling method '.version_select at 0x7fdb88d91940>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:29.731928 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.wsgi [None req-5c22bbe3-49a3-495b-8a23-40ec065bf0f4 tempest-VolumesNegativeTest-1330262200 tempest-VolumesNegativeTest-1330262200-project] HTTP exception thrown: Volume tempest-invalid-1154229036 could not be found. Sep 21 16:24:29.737348 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-5c22bbe3-49a3-495b-8a23-40ec065bf0f4 tempest-VolumesNegativeTest-1330262200 tempest-VolumesNegativeTest-1330262200-project] Request method failure captured: Sep 21 16:24:29.737348 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1154229036 HTTP/1.1 Sep 21 16:24:29.737348 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept: application/json Sep 21 16:24:29.737348 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept-Encoding: identity Sep 21 16:24:29.737348 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Connection: close Sep 21 16:24:29.737348 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Length: 0 Sep 21 16:24:29.737348 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Type: application/json Sep 21 16:24:29.737348 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Host: 10.222.0.64 Sep 21 16:24:29.737348 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Openstack-System-Scope: None Sep 21 16:24:29.737348 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: User-Agent: python-urllib3/1.26.12 Sep 21 16:24:29.737348 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Auth-Token: gAAAAABjKzq9qGKy2A0VyIEIok9bLHUPS3dIP21BvVYOZWlc7BxEQEdyXmcRqBMBKzRj3jD_yEpGPJOka41fvIIygQgmCAyE1eBFI8KQvPYVC_vw6catCpnrfBYCkM630ygfqzCUutaQBbReocF4snjBoCgxau8FqLCrbpG7DxTFcs6FQVcb9gs Sep 21 16:24:29.737348 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Id: None Sep 21 16:24:29.737348 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Name: None Sep 21 16:24:29.737348 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Identity-Status: Confirmed Sep 21 16:24:29.737348 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Is-Admin-Project: True Sep 21 16:24:29.737348 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Id: default Sep 21 16:24:29.737348 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Name: Default Sep 21 16:24:29.737348 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Id: 93a17d42b4214148a5417741adc02198 Sep 21 16:24:29.737348 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Name: tempest-VolumesNegativeTest-1330262200 Sep 21 16:24:29.737348 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Role: member,reader Sep 21 16:24:29.737348 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Roles: member,reader Sep 21 16:24:29.738877 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/93a17d42b4214148a5417741adc02198"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/93a17d42b4214148a5417741adc02198"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_93a17d42b4214148a5417741adc02198"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/93a17d42b4214148a5417741adc02198"}]}] Sep 21 16:24:29.738877 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant: tempest-VolumesNegativeTest-1330262200 Sep 21 16:24:29.738877 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Id: 93a17d42b4214148a5417741adc02198 Sep 21 16:24:29.738877 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Name: tempest-VolumesNegativeTest-1330262200 Sep 21 16:24:29.738877 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User: tempest-VolumesNegativeTest-1330262200-project Sep 21 16:24:29.738877 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Id: default Sep 21 16:24:29.738877 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Name: Default Sep 21 16:24:29.738877 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Id: 9aa93530363f4f28a2c437773dd25fea Sep 21 16:24:29.738877 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Name: tempest-VolumesNegativeTest-1330262200-project Sep 21 16:24:29.738877 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: method: Sep 21 16:24:29.738877 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: exception: Volume tempest-invalid-1154229036 could not be found. Sep 21 16:24:29.738877 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: action_args: {'id': 'tempest-invalid-1154229036'} Sep 21 16:24:29.738877 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:24:29.739990 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:24:29.739990 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 21 16:24:29.739990 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 21 16:24:29.739990 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 21 16:24:29.739990 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 21 16:24:29.739990 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 21 16:24:29.739990 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 21 16:24:29.739990 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 21 16:24:29.739990 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 21 16:24:29.739990 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 21 16:24:29.739990 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 21 16:24:29.739990 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 21 16:24:29.739990 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 21 16:24:29.739990 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 21 16:24:29.739990 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 21 16:24:29.739990 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1154229036 could not be found. (HTTP 404) (Request-ID: req-1b9199a7-4c52-4bb4-b0a2-0c816bed23f0) Sep 21 16:24:29.739990 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.739990 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:24:29.739990 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.741821 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:24:29.741821 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 21 16:24:29.741821 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 21 16:24:29.741821 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 21 16:24:29.741821 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 21 16:24:29.741821 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 21 16:24:29.741821 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 21 16:24:29.741821 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 21 16:24:29.741821 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 21 16:24:29.741821 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 21 16:24:29.741821 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 21 16:24:29.741821 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 21 16:24:29.741821 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 21 16:24:29.741821 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 21 16:24:29.741821 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 21 16:24:29.741821 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 21 16:24:29.741821 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 21 16:24:29.741821 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 21 16:24:29.741821 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 21 16:24:29.744301 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 21 16:24:29.744301 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 21 16:24:29.744301 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 21 16:24:29.744301 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 21 16:24:29.744301 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1154229036 could not be found. Sep 21 16:24:29.744301 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.744301 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:24:29.744301 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.744301 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:24:29.744301 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:24:29.744301 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:24:29.744301 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:24:29.744301 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:24:29.744301 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 21 16:24:29.744301 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 21 16:24:29.744301 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:24:29.744301 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:24:29.744301 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 21 16:24:29.744301 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:24:29.744301 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1154229036 could not be found. Sep 21 16:24:29.746203 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.746203 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:24:29.746203 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.746203 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:24:29.746203 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:24:29.746203 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:24:29.746203 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:24:29.746203 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:24:29.746203 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1154229036 could not be found. Sep 21 16:24:29.746203 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.746203 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-5c22bbe3-49a3-495b-8a23-40ec065bf0f4 tempest-VolumesNegativeTest-1330262200 tempest-VolumesNegativeTest-1330262200-project] Returning 404 to user: Volume tempest-invalid-1154229036 could not be found. {{(pid=120531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:24:29.746203 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-5c22bbe3-49a3-495b-8a23-40ec065bf0f4 tempest-VolumesNegativeTest-1330262200 tempest-VolumesNegativeTest-1330262200-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1154229036" status: 404 len: 99 microversion: 2.1 time: 0.067595 Sep 21 16:24:29.748404 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 71/159] 10.222.0.64 () {58 vars in 1218 bytes} [Wed Sep 21 16:24:29 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1154229036 => generated 99 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 21 16:24:29.753794 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-3e5bf015-5c66-433d-aa6f-d70f5a150cc1 tempest-VolumesNegativeTest-1330262200 tempest-VolumesNegativeTest-1330262200-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003821 Sep 21 16:24:29.754616 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 89/160] 10.222.0.64 () {58 vars in 1140 bytes} [Wed Sep 21 16:24:29 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 21 16:24:29.767884 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-2895f4c3-5d09-408a-b748-ada63a62cd5c tempest-VolumesNegativeTest-1330262200 tempest-VolumesNegativeTest-1330262200-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005314 Sep 21 16:24:29.768565 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 72/161] 10.222.0.64 () {58 vars in 1137 bytes} [Wed Sep 21 16:24:29 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 21 16:24:29.784536 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c8a115cf-facc-4aa9-9d66-b86c92d56354 tempest-VolumesNegativeTest-1330262200 tempest-VolumesNegativeTest-1330262200-project] Calling method '.version_select at 0x7fdb88d5c820>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:29.823105 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.wsgi [None req-c8a115cf-facc-4aa9-9d66-b86c92d56354 tempest-VolumesNegativeTest-1330262200 tempest-VolumesNegativeTest-1330262200-project] HTTP exception thrown: Volume f98322f8-f15e-4275-83fe-47d942b80ba1 could not be found. Sep 21 16:24:29.825212 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c8a115cf-facc-4aa9-9d66-b86c92d56354 tempest-VolumesNegativeTest-1330262200 tempest-VolumesNegativeTest-1330262200-project] Request method failure captured: Sep 21 16:24:29.825212 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: request: DELETE /compute/v2.1/os-volumes/f98322f8-f15e-4275-83fe-47d942b80ba1 HTTP/1.1 Sep 21 16:24:29.825212 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept: application/json Sep 21 16:24:29.825212 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept-Encoding: identity Sep 21 16:24:29.825212 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Connection: close Sep 21 16:24:29.825212 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Length: 0 Sep 21 16:24:29.825212 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Type: application/json Sep 21 16:24:29.825212 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Host: 10.222.0.64 Sep 21 16:24:29.825212 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Openstack-System-Scope: None Sep 21 16:24:29.825212 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: User-Agent: python-urllib3/1.26.12 Sep 21 16:24:29.825212 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Auth-Token: gAAAAABjKzq9qGKy2A0VyIEIok9bLHUPS3dIP21BvVYOZWlc7BxEQEdyXmcRqBMBKzRj3jD_yEpGPJOka41fvIIygQgmCAyE1eBFI8KQvPYVC_vw6catCpnrfBYCkM630ygfqzCUutaQBbReocF4snjBoCgxau8FqLCrbpG7DxTFcs6FQVcb9gs Sep 21 16:24:29.825212 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Id: None Sep 21 16:24:29.825212 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Name: None Sep 21 16:24:29.825212 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Identity-Status: Confirmed Sep 21 16:24:29.825212 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Is-Admin-Project: True Sep 21 16:24:29.825212 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Id: default Sep 21 16:24:29.825212 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Name: Default Sep 21 16:24:29.825212 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Id: 93a17d42b4214148a5417741adc02198 Sep 21 16:24:29.825212 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Name: tempest-VolumesNegativeTest-1330262200 Sep 21 16:24:29.825212 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Role: member,reader Sep 21 16:24:29.825212 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Roles: member,reader Sep 21 16:24:29.827034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/93a17d42b4214148a5417741adc02198"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/93a17d42b4214148a5417741adc02198"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_93a17d42b4214148a5417741adc02198"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/93a17d42b4214148a5417741adc02198"}]}] Sep 21 16:24:29.827034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant: tempest-VolumesNegativeTest-1330262200 Sep 21 16:24:29.827034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Id: 93a17d42b4214148a5417741adc02198 Sep 21 16:24:29.827034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Name: tempest-VolumesNegativeTest-1330262200 Sep 21 16:24:29.827034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User: tempest-VolumesNegativeTest-1330262200-project Sep 21 16:24:29.827034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Id: default Sep 21 16:24:29.827034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Name: Default Sep 21 16:24:29.827034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Id: 9aa93530363f4f28a2c437773dd25fea Sep 21 16:24:29.827034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Name: tempest-VolumesNegativeTest-1330262200-project Sep 21 16:24:29.827034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: method: Sep 21 16:24:29.827034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: exception: Volume f98322f8-f15e-4275-83fe-47d942b80ba1 could not be found. Sep 21 16:24:29.827034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: action_args: {'id': 'f98322f8-f15e-4275-83fe-47d942b80ba1'} Sep 21 16:24:29.827034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:24:29.828217 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:24:29.828217 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 21 16:24:29.828217 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 21 16:24:29.828217 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 21 16:24:29.828217 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 21 16:24:29.828217 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 21 16:24:29.828217 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 21 16:24:29.828217 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 21 16:24:29.828217 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 21 16:24:29.828217 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 21 16:24:29.828217 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 21 16:24:29.828217 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 21 16:24:29.828217 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 21 16:24:29.828217 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 21 16:24:29.828217 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 21 16:24:29.828217 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f98322f8-f15e-4275-83fe-47d942b80ba1 could not be found. (HTTP 404) (Request-ID: req-333b4e85-da9f-45fe-87e1-62ff655347c8) Sep 21 16:24:29.828217 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.828217 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:24:29.828217 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.829505 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:24:29.829505 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 21 16:24:29.829505 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 21 16:24:29.829505 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 21 16:24:29.829505 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 21 16:24:29.829505 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 21 16:24:29.829505 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 21 16:24:29.829505 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 21 16:24:29.829505 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 21 16:24:29.829505 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 21 16:24:29.829505 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 21 16:24:29.829505 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 21 16:24:29.829505 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 21 16:24:29.829505 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 21 16:24:29.829505 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 21 16:24:29.829505 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 21 16:24:29.829505 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 21 16:24:29.829505 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 21 16:24:29.829505 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 21 16:24:29.830800 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 21 16:24:29.830800 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 21 16:24:29.830800 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 21 16:24:29.830800 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 21 16:24:29.830800 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f98322f8-f15e-4275-83fe-47d942b80ba1 could not be found. Sep 21 16:24:29.830800 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.830800 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:24:29.830800 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.830800 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:24:29.830800 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:24:29.830800 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:24:29.830800 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:24:29.830800 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:24:29.830800 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 21 16:24:29.830800 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 21 16:24:29.830800 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:24:29.830800 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:24:29.830800 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 21 16:24:29.830800 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:24:29.832426 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f98322f8-f15e-4275-83fe-47d942b80ba1 could not be found. Sep 21 16:24:29.832426 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.832426 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:24:29.832426 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.832426 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:24:29.832426 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:24:29.832426 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:24:29.832426 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:24:29.832426 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:24:29.832426 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f98322f8-f15e-4275-83fe-47d942b80ba1 could not be found. Sep 21 16:24:29.832426 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.832426 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c8a115cf-facc-4aa9-9d66-b86c92d56354 tempest-VolumesNegativeTest-1330262200 tempest-VolumesNegativeTest-1330262200-project] Returning 404 to user: Volume f98322f8-f15e-4275-83fe-47d942b80ba1 could not be found. {{(pid=120532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:24:29.832426 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-c8a115cf-facc-4aa9-9d66-b86c92d56354 tempest-VolumesNegativeTest-1330262200 tempest-VolumesNegativeTest-1330262200-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/f98322f8-f15e-4275-83fe-47d942b80ba1" status: 404 len: 109 microversion: 2.1 time: 0.049156 Sep 21 16:24:29.832426 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 90/162] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Sep 21 16:24:29 2022] DELETE /compute/v2.1/os-volumes/f98322f8-f15e-4275-83fe-47d942b80ba1 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 16:24:29.838291 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-79f26027-5bd0-4f09-9c7e-6bfe89f2fe3f tempest-VolumesNegativeTest-1330262200 tempest-VolumesNegativeTest-1330262200-project] Calling method '.version_select at 0x7fdb88d931f0>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:29.877737 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.wsgi [None req-79f26027-5bd0-4f09-9c7e-6bfe89f2fe3f tempest-VolumesNegativeTest-1330262200 tempest-VolumesNegativeTest-1330262200-project] HTTP exception thrown: Volume 3aeca340-6ba1-4ff2-a08b-3f55750bd7d4 could not be found. Sep 21 16:24:29.886258 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-79f26027-5bd0-4f09-9c7e-6bfe89f2fe3f tempest-VolumesNegativeTest-1330262200 tempest-VolumesNegativeTest-1330262200-project] Request method failure captured: Sep 21 16:24:29.886258 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: request: GET /compute/v2.1/os-volumes/3aeca340-6ba1-4ff2-a08b-3f55750bd7d4 HTTP/1.1 Sep 21 16:24:29.886258 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept: application/json Sep 21 16:24:29.886258 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept-Encoding: identity Sep 21 16:24:29.886258 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Connection: close Sep 21 16:24:29.886258 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Length: 0 Sep 21 16:24:29.886258 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Type: application/json Sep 21 16:24:29.886258 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Host: 10.222.0.64 Sep 21 16:24:29.886258 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Openstack-System-Scope: None Sep 21 16:24:29.886258 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: User-Agent: python-urllib3/1.26.12 Sep 21 16:24:29.886258 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Auth-Token: gAAAAABjKzq9qGKy2A0VyIEIok9bLHUPS3dIP21BvVYOZWlc7BxEQEdyXmcRqBMBKzRj3jD_yEpGPJOka41fvIIygQgmCAyE1eBFI8KQvPYVC_vw6catCpnrfBYCkM630ygfqzCUutaQBbReocF4snjBoCgxau8FqLCrbpG7DxTFcs6FQVcb9gs Sep 21 16:24:29.886258 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Id: None Sep 21 16:24:29.886258 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Name: None Sep 21 16:24:29.886258 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Identity-Status: Confirmed Sep 21 16:24:29.886258 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Is-Admin-Project: True Sep 21 16:24:29.886258 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Id: default Sep 21 16:24:29.886258 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Name: Default Sep 21 16:24:29.886258 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Id: 93a17d42b4214148a5417741adc02198 Sep 21 16:24:29.886258 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Name: tempest-VolumesNegativeTest-1330262200 Sep 21 16:24:29.886258 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Role: member,reader Sep 21 16:24:29.886258 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Roles: member,reader Sep 21 16:24:29.887553 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/93a17d42b4214148a5417741adc02198"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/93a17d42b4214148a5417741adc02198"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_93a17d42b4214148a5417741adc02198"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/93a17d42b4214148a5417741adc02198"}]}] Sep 21 16:24:29.887553 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant: tempest-VolumesNegativeTest-1330262200 Sep 21 16:24:29.887553 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Id: 93a17d42b4214148a5417741adc02198 Sep 21 16:24:29.887553 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Name: tempest-VolumesNegativeTest-1330262200 Sep 21 16:24:29.887553 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User: tempest-VolumesNegativeTest-1330262200-project Sep 21 16:24:29.887553 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Id: default Sep 21 16:24:29.887553 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Name: Default Sep 21 16:24:29.887553 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Id: 9aa93530363f4f28a2c437773dd25fea Sep 21 16:24:29.887553 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Name: tempest-VolumesNegativeTest-1330262200-project Sep 21 16:24:29.887553 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: method: Sep 21 16:24:29.887553 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: exception: Volume 3aeca340-6ba1-4ff2-a08b-3f55750bd7d4 could not be found. Sep 21 16:24:29.887553 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: action_args: {'id': '3aeca340-6ba1-4ff2-a08b-3f55750bd7d4'} Sep 21 16:24:29.887553 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:24:29.888299 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:24:29.888299 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 21 16:24:29.888299 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 21 16:24:29.888299 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 21 16:24:29.888299 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 21 16:24:29.888299 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 21 16:24:29.888299 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 21 16:24:29.888299 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 21 16:24:29.888299 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 21 16:24:29.888299 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 21 16:24:29.888299 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 21 16:24:29.888299 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 21 16:24:29.888299 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 21 16:24:29.888299 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 21 16:24:29.888299 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 21 16:24:29.888299 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3aeca340-6ba1-4ff2-a08b-3f55750bd7d4 could not be found. (HTTP 404) (Request-ID: req-3f6a4167-a8ab-4c4c-8f29-5999eb6e832f) Sep 21 16:24:29.888299 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.888299 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:24:29.888299 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.889296 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:24:29.889296 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 21 16:24:29.889296 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 21 16:24:29.889296 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 21 16:24:29.889296 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 21 16:24:29.889296 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 21 16:24:29.889296 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 21 16:24:29.889296 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 21 16:24:29.889296 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 21 16:24:29.889296 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 21 16:24:29.889296 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 21 16:24:29.889296 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 21 16:24:29.889296 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 21 16:24:29.889296 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 21 16:24:29.889296 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 21 16:24:29.889296 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 21 16:24:29.889296 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 21 16:24:29.889296 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 21 16:24:29.889296 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 21 16:24:29.890362 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 21 16:24:29.890362 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 21 16:24:29.890362 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 21 16:24:29.890362 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 21 16:24:29.890362 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3aeca340-6ba1-4ff2-a08b-3f55750bd7d4 could not be found. Sep 21 16:24:29.890362 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.890362 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:24:29.890362 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.890362 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:24:29.890362 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:24:29.890362 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:24:29.890362 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:24:29.890362 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:24:29.890362 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 21 16:24:29.890362 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 21 16:24:29.890362 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:24:29.890362 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:24:29.890362 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 21 16:24:29.890362 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:24:29.892644 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3aeca340-6ba1-4ff2-a08b-3f55750bd7d4 could not be found. Sep 21 16:24:29.892644 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.892644 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:24:29.892644 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.892644 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:24:29.892644 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:24:29.892644 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:24:29.892644 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:24:29.892644 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:24:29.892644 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3aeca340-6ba1-4ff2-a08b-3f55750bd7d4 could not be found. Sep 21 16:24:29.892644 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:24:29.892644 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-79f26027-5bd0-4f09-9c7e-6bfe89f2fe3f tempest-VolumesNegativeTest-1330262200 tempest-VolumesNegativeTest-1330262200-project] Returning 404 to user: Volume 3aeca340-6ba1-4ff2-a08b-3f55750bd7d4 could not be found. {{(pid=120531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:24:29.892644 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-79f26027-5bd0-4f09-9c7e-6bfe89f2fe3f tempest-VolumesNegativeTest-1330262200 tempest-VolumesNegativeTest-1330262200-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/3aeca340-6ba1-4ff2-a08b-3f55750bd7d4" status: 404 len: 109 microversion: 2.1 time: 0.055826 Sep 21 16:24:29.892644 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 73/163] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Sep 21 16:24:29 2022] GET /compute/v2.1/os-volumes/3aeca340-6ba1-4ff2-a08b-3f55750bd7d4 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 16:24:30.031547 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-b4caf014-2e0d-4e61-bafb-db989bfc99e3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:30.032746 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-b4caf014-2e0d-4e61-bafb-db989bfc99e3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:30.046579 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b4caf014-2e0d-4e61-bafb-db989bfc99e3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:30.047384 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b4caf014-2e0d-4e61-bafb-db989bfc99e3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:30.048188 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b4caf014-2e0d-4e61-bafb-db989bfc99e3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:30.049746 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b4caf014-2e0d-4e61-bafb-db989bfc99e3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:30.051046 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b4caf014-2e0d-4e61-bafb-db989bfc99e3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:30.051750 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b4caf014-2e0d-4e61-bafb-db989bfc99e3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:30.393661 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-b4caf014-2e0d-4e61-bafb-db989bfc99e3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:30.433825 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-b4caf014-2e0d-4e61-bafb-db989bfc99e3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1522 microversion: 2.1 time: 0.408207 Sep 21 16:24:30.434674 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 91/164] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:30 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1522 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:31.473259 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-84e63756-6fc8-4448-b9f5-fe00aeb75b15 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:31.477362 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-84e63756-6fc8-4448-b9f5-fe00aeb75b15 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:31.486024 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-84e63756-6fc8-4448-b9f5-fe00aeb75b15 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:31.486759 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-84e63756-6fc8-4448-b9f5-fe00aeb75b15 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:31.487466 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-84e63756-6fc8-4448-b9f5-fe00aeb75b15 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:31.488502 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-84e63756-6fc8-4448-b9f5-fe00aeb75b15 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:31.489118 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-84e63756-6fc8-4448-b9f5-fe00aeb75b15 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:31.489775 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-84e63756-6fc8-4448-b9f5-fe00aeb75b15 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:31.730981 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-84e63756-6fc8-4448-b9f5-fe00aeb75b15 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:31.743087 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-84e63756-6fc8-4448-b9f5-fe00aeb75b15 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1522 microversion: 2.1 time: 0.273988 Sep 21 16:24:31.744231 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 74/165] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:31 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:32.508203 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-91b003c8-0213-4a03-b39a-86d96d7ff7de tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-20972618", "imageRef": "600db436-ed6c-41b7-89f7-7dd31852a1a7", "flavorRef": "452", "networks": [{"uuid": "d2e36dbb-5f75-4421-bbca-e70cadec4d4c"}]}} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:24:32.600932 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.network.neutron [None req-91b003c8-0213-4a03-b39a-86d96d7ff7de tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] validate_networks() for [('d2e36dbb-5f75-4421-bbca-e70cadec4d4c', None, None, None, None, None)] {{(pid=120532) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 16:24:32.786642 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-606f822b-e80b-425b-8b2e-1e6ae7d8dada tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:32.787234 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-606f822b-e80b-425b-8b2e-1e6ae7d8dada tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:32.798467 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-606f822b-e80b-425b-8b2e-1e6ae7d8dada tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:32.799411 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-606f822b-e80b-425b-8b2e-1e6ae7d8dada tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:32.799848 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-606f822b-e80b-425b-8b2e-1e6ae7d8dada tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:32.800769 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-606f822b-e80b-425b-8b2e-1e6ae7d8dada tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:32.801397 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-606f822b-e80b-425b-8b2e-1e6ae7d8dada tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:32.802138 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-606f822b-e80b-425b-8b2e-1e6ae7d8dada tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:33.073566 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-606f822b-e80b-425b-8b2e-1e6ae7d8dada tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:33.094729 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-606f822b-e80b-425b-8b2e-1e6ae7d8dada tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1522 microversion: 2.1 time: 0.312799 Sep 21 16:24:33.096855 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 75/166] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:32 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:33.249092 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-91b003c8-0213-4a03-b39a-86d96d7ff7de tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Flavor limits 0:0:0 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 16:24:33.249825 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-91b003c8-0213-4a03-b39a-86d96d7ff7de tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Image limits 0:0:0 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 16:24:33.250787 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-91b003c8-0213-4a03-b39a-86d96d7ff7de tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Flavor pref 0:0:0 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 16:24:33.251698 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-91b003c8-0213-4a03-b39a-86d96d7ff7de tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Image pref 0:0:0 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 16:24:33.252785 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-91b003c8-0213-4a03-b39a-86d96d7ff7de tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 16:24:33.273525 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-91b003c8-0213-4a03-b39a-86d96d7ff7de tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:33.274675 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-91b003c8-0213-4a03-b39a-86d96d7ff7de tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:33.275553 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-91b003c8-0213-4a03-b39a-86d96d7ff7de tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:33.276819 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-91b003c8-0213-4a03-b39a-86d96d7ff7de tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:33.277866 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-91b003c8-0213-4a03-b39a-86d96d7ff7de tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:33.279325 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-91b003c8-0213-4a03-b39a-86d96d7ff7de tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:33.335453 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.quota [None req-91b003c8-0213-4a03-b39a-86d96d7ff7de tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Getting quotas for project 97c0b8a086b046ddb2b2d475124dc692. Resources: {'cores', 'ram', 'instances'} {{(pid=120532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 16:24:33.344401 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.quota [None req-91b003c8-0213-4a03-b39a-86d96d7ff7de tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Getting quotas for user 415e8845ba8d46cc9dc939ef4556e865 and project 97c0b8a086b046ddb2b2d475124dc692. Resources: {'cores', 'ram', 'instances'} {{(pid=120532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 16:24:33.396257 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-91b003c8-0213-4a03-b39a-86d96d7ff7de tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Going to run 1 instances... {{(pid=120532) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 16:24:33.400244 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-91b003c8-0213-4a03-b39a-86d96d7ff7de tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 712ad5b4-0827-418a-befc-644766bc899f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='600db436-ed6c-41b7-89f7-7dd31852a1a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120532) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 16:24:33.511637 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-91b003c8-0213-4a03-b39a-86d96d7ff7de tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.008131 Sep 21 16:24:33.519055 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 92/167] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Sep 21 16:24:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 21 16:24:33.524975 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-7482cc88-4250-4e62-8043-265e9666d9ca tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:33.525600 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-7482cc88-4250-4e62-8043-265e9666d9ca tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 712ad5b4-0827-418a-befc-644766bc899f] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:33.623541 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-7482cc88-4250-4e62-8043-265e9666d9ca tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:33.637072 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-7482cc88-4250-4e62-8043-265e9666d9ca tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f" status: 200 len: 1212 microversion: 2.1 time: 0.116244 Sep 21 16:24:33.638109 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 76/168] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:33 2022] GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f => generated 1212 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:34.126777 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-b02a9a96-9048-4299-ba3e-1538391bfa94 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:34.128190 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-b02a9a96-9048-4299-ba3e-1538391bfa94 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:34.143508 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b02a9a96-9048-4299-ba3e-1538391bfa94 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:34.144966 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b02a9a96-9048-4299-ba3e-1538391bfa94 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:34.147121 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b02a9a96-9048-4299-ba3e-1538391bfa94 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:34.148059 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b02a9a96-9048-4299-ba3e-1538391bfa94 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:34.148910 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b02a9a96-9048-4299-ba3e-1538391bfa94 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:34.149754 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b02a9a96-9048-4299-ba3e-1538391bfa94 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:34.374466 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-b02a9a96-9048-4299-ba3e-1538391bfa94 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:34.383736 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-b02a9a96-9048-4299-ba3e-1538391bfa94 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1522 microversion: 2.1 time: 0.264952 Sep 21 16:24:34.384320 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 93/169] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:34 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:34.669866 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-11af0559-472e-4fb8-8997-7e80f5161376 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:34.671288 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-11af0559-472e-4fb8-8997-7e80f5161376 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 712ad5b4-0827-418a-befc-644766bc899f] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:34.684804 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-11af0559-472e-4fb8-8997-7e80f5161376 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:34.685756 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-11af0559-472e-4fb8-8997-7e80f5161376 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:34.686651 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-11af0559-472e-4fb8-8997-7e80f5161376 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:34.688122 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-11af0559-472e-4fb8-8997-7e80f5161376 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:34.688870 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-11af0559-472e-4fb8-8997-7e80f5161376 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:34.689918 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-11af0559-472e-4fb8-8997-7e80f5161376 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:34.842982 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-11af0559-472e-4fb8-8997-7e80f5161376 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:34.875268 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-11af0559-472e-4fb8-8997-7e80f5161376 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f" status: 200 len: 1264 microversion: 2.1 time: 0.216408 Sep 21 16:24:34.877726 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 77/170] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:34 2022] GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f => generated 1264 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:35.429938 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-1d3e5916-3aa2-436d-9664-8814ccf8dcfb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:35.431125 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-1d3e5916-3aa2-436d-9664-8814ccf8dcfb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:35.443024 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1d3e5916-3aa2-436d-9664-8814ccf8dcfb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:35.444496 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1d3e5916-3aa2-436d-9664-8814ccf8dcfb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:35.445199 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1d3e5916-3aa2-436d-9664-8814ccf8dcfb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:35.446352 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1d3e5916-3aa2-436d-9664-8814ccf8dcfb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:35.447381 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1d3e5916-3aa2-436d-9664-8814ccf8dcfb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:35.448326 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1d3e5916-3aa2-436d-9664-8814ccf8dcfb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:35.715755 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-1d3e5916-3aa2-436d-9664-8814ccf8dcfb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:35.727686 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-1d3e5916-3aa2-436d-9664-8814ccf8dcfb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1522 microversion: 2.1 time: 0.305951 Sep 21 16:24:35.728438 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 94/171] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:35 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:35.903341 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-21a9f23e-9069-4e0f-8372-433daa4cbed0 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:35.905875 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-21a9f23e-9069-4e0f-8372-433daa4cbed0 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 712ad5b4-0827-418a-befc-644766bc899f] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:35.915880 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-21a9f23e-9069-4e0f-8372-433daa4cbed0 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:35.916893 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-21a9f23e-9069-4e0f-8372-433daa4cbed0 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:35.918250 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-21a9f23e-9069-4e0f-8372-433daa4cbed0 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:35.920381 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-21a9f23e-9069-4e0f-8372-433daa4cbed0 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:35.920609 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-21a9f23e-9069-4e0f-8372-433daa4cbed0 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:35.921446 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-21a9f23e-9069-4e0f-8372-433daa4cbed0 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:36.038396 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-21a9f23e-9069-4e0f-8372-433daa4cbed0 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:36.057930 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-21a9f23e-9069-4e0f-8372-433daa4cbed0 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f" status: 200 len: 1270 microversion: 2.1 time: 0.159307 Sep 21 16:24:36.058688 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 78/172] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:35 2022] GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:24:36.769360 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-bd8fe75f-7d3d-46ec-a502-f756962b8c12 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:36.770306 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-bd8fe75f-7d3d-46ec-a502-f756962b8c12 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:36.773483 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:36.781384 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bd8fe75f-7d3d-46ec-a502-f756962b8c12 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:36.782482 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bd8fe75f-7d3d-46ec-a502-f756962b8c12 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:36.783057 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bd8fe75f-7d3d-46ec-a502-f756962b8c12 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:36.784060 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bd8fe75f-7d3d-46ec-a502-f756962b8c12 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:36.784674 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bd8fe75f-7d3d-46ec-a502-f756962b8c12 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:36.785330 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bd8fe75f-7d3d-46ec-a502-f756962b8c12 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:36.994484 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-bd8fe75f-7d3d-46ec-a502-f756962b8c12 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:37.001197 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=100 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:37.017960 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-bd8fe75f-7d3d-46ec-a502-f756962b8c12 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1522 microversion: 2.1 time: 0.253472 Sep 21 16:24:37.019313 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 95/173] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:36 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:37.087260 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-1cc2cfcd-5934-4aa6-81db-de4b2594d0ea tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:37.089426 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-1cc2cfcd-5934-4aa6-81db-de4b2594d0ea tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 712ad5b4-0827-418a-befc-644766bc899f] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:37.096419 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1cc2cfcd-5934-4aa6-81db-de4b2594d0ea tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:37.096888 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1cc2cfcd-5934-4aa6-81db-de4b2594d0ea tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:37.097318 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1cc2cfcd-5934-4aa6-81db-de4b2594d0ea tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:37.098120 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1cc2cfcd-5934-4aa6-81db-de4b2594d0ea tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:37.098578 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1cc2cfcd-5934-4aa6-81db-de4b2594d0ea tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:37.098993 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1cc2cfcd-5934-4aa6-81db-de4b2594d0ea tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:37.284969 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-1cc2cfcd-5934-4aa6-81db-de4b2594d0ea tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:37.293554 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-1cc2cfcd-5934-4aa6-81db-de4b2594d0ea tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f" status: 200 len: 1312 microversion: 2.1 time: 0.211131 Sep 21 16:24:37.294294 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 79/174] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:37 2022] GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f => generated 1312 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:24:38.049005 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-316ee2af-4661-4d83-ba62-43fb8390f609 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:38.050332 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-316ee2af-4661-4d83-ba62-43fb8390f609 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:38.058528 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-316ee2af-4661-4d83-ba62-43fb8390f609 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:38.059097 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-316ee2af-4661-4d83-ba62-43fb8390f609 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:38.059589 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-316ee2af-4661-4d83-ba62-43fb8390f609 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:38.060486 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-316ee2af-4661-4d83-ba62-43fb8390f609 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:38.061065 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-316ee2af-4661-4d83-ba62-43fb8390f609 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:38.061589 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-316ee2af-4661-4d83-ba62-43fb8390f609 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:38.225707 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-316ee2af-4661-4d83-ba62-43fb8390f609 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:38.238777 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-316ee2af-4661-4d83-ba62-43fb8390f609 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1522 microversion: 2.1 time: 0.194642 Sep 21 16:24:38.239759 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 96/175] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:38 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:38.317231 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-2b158112-e83a-45f6-afa1-02663a3e66d0 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:38.317821 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-2b158112-e83a-45f6-afa1-02663a3e66d0 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 712ad5b4-0827-418a-befc-644766bc899f] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:38.324225 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2b158112-e83a-45f6-afa1-02663a3e66d0 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:38.324718 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2b158112-e83a-45f6-afa1-02663a3e66d0 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:38.325187 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2b158112-e83a-45f6-afa1-02663a3e66d0 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:38.325902 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2b158112-e83a-45f6-afa1-02663a3e66d0 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:38.326400 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2b158112-e83a-45f6-afa1-02663a3e66d0 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:38.326848 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2b158112-e83a-45f6-afa1-02663a3e66d0 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:38.346633 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=100 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:38.477590 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-2b158112-e83a-45f6-afa1-02663a3e66d0 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:38.485988 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-2b158112-e83a-45f6-afa1-02663a3e66d0 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f" status: 200 len: 1312 microversion: 2.1 time: 0.172731 Sep 21 16:24:38.486614 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 80/176] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:38 2022] GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f => generated 1312 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:39.293836 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-e587ea2d-7e27-422d-b2ad-87d24660ea9f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:39.305475 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-e587ea2d-7e27-422d-b2ad-87d24660ea9f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:39.315310 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e587ea2d-7e27-422d-b2ad-87d24660ea9f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:39.316008 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e587ea2d-7e27-422d-b2ad-87d24660ea9f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:39.316469 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e587ea2d-7e27-422d-b2ad-87d24660ea9f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:39.317460 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e587ea2d-7e27-422d-b2ad-87d24660ea9f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:39.318023 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e587ea2d-7e27-422d-b2ad-87d24660ea9f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:39.318965 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e587ea2d-7e27-422d-b2ad-87d24660ea9f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:39.528499 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-a04000b7-de4a-4a2d-ad68-376cb0e411e1 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:39.530629 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-a04000b7-de4a-4a2d-ad68-376cb0e411e1 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 712ad5b4-0827-418a-befc-644766bc899f] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:39.550680 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a04000b7-de4a-4a2d-ad68-376cb0e411e1 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:39.554325 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a04000b7-de4a-4a2d-ad68-376cb0e411e1 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:39.554861 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a04000b7-de4a-4a2d-ad68-376cb0e411e1 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:39.559087 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a04000b7-de4a-4a2d-ad68-376cb0e411e1 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:39.563081 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a04000b7-de4a-4a2d-ad68-376cb0e411e1 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:39.563890 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a04000b7-de4a-4a2d-ad68-376cb0e411e1 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:39.622375 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-e587ea2d-7e27-422d-b2ad-87d24660ea9f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:39.637192 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-e587ea2d-7e27-422d-b2ad-87d24660ea9f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1522 microversion: 2.1 time: 0.361800 Sep 21 16:24:39.638156 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 97/177] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:39 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:39.848849 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-a04000b7-de4a-4a2d-ad68-376cb0e411e1 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:39.867508 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-a04000b7-de4a-4a2d-ad68-376cb0e411e1 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f" status: 200 len: 1312 microversion: 2.1 time: 0.346549 Sep 21 16:24:39.869038 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 81/178] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:39 2022] GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f => generated 1312 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:40.000223 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-ca0aa6d0-38a3-49ae-b9b4-7533566784b7 req-de7ec50a-e332-4053-9ef1-8714ea353a52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "712ad5b4-0827-418a-befc-644766bc899f", "tag": "07c1f951-0669-47c3-888c-b2247337d8d1"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:24:40.024147 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-ca0aa6d0-38a3-49ae-b9b4-7533566784b7 req-de7ec50a-e332-4053-9ef1-8714ea353a52 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:40.024993 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-ca0aa6d0-38a3-49ae-b9b4-7533566784b7 req-de7ec50a-e332-4053-9ef1-8714ea353a52 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:40.025757 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-ca0aa6d0-38a3-49ae-b9b4-7533566784b7 req-de7ec50a-e332-4053-9ef1-8714ea353a52 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:40.047075 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-ca0aa6d0-38a3-49ae-b9b4-7533566784b7 req-de7ec50a-e332-4053-9ef1-8714ea353a52 service nova] Creating event network-changed:07c1f951-0669-47c3-888c-b2247337d8d1 for instance 712ad5b4-0827-418a-befc-644766bc899f on hv-cinder-85862 Sep 21 16:24:40.056007 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-ca0aa6d0-38a3-49ae-b9b4-7533566784b7 req-de7ec50a-e332-4053-9ef1-8714ea353a52 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066759 Sep 21 16:24:40.057156 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 98/179] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:24:40.685857 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d6de8df4-da91-46a7-b1ae-a98240562fc0 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:40.687035 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d6de8df4-da91-46a7-b1ae-a98240562fc0 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:40.692204 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_api:SELECT=44 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:40.703185 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d6de8df4-da91-46a7-b1ae-a98240562fc0 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:40.704055 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d6de8df4-da91-46a7-b1ae-a98240562fc0 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:40.704843 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d6de8df4-da91-46a7-b1ae-a98240562fc0 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:40.706195 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d6de8df4-da91-46a7-b1ae-a98240562fc0 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:40.707032 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d6de8df4-da91-46a7-b1ae-a98240562fc0 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:40.707853 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d6de8df4-da91-46a7-b1ae-a98240562fc0 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:40.895719 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-01e07a16-170e-4ae3-a9c7-c74e8ced1c3e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:40.898995 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-01e07a16-170e-4ae3-a9c7-c74e8ced1c3e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 712ad5b4-0827-418a-befc-644766bc899f] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:40.909656 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-01e07a16-170e-4ae3-a9c7-c74e8ced1c3e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:40.910320 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-01e07a16-170e-4ae3-a9c7-c74e8ced1c3e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:40.910830 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-01e07a16-170e-4ae3-a9c7-c74e8ced1c3e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:40.912132 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-01e07a16-170e-4ae3-a9c7-c74e8ced1c3e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:40.912911 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-01e07a16-170e-4ae3-a9c7-c74e8ced1c3e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:40.914281 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-01e07a16-170e-4ae3-a9c7-c74e8ced1c3e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:40.955755 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d6de8df4-da91-46a7-b1ae-a98240562fc0 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:40.976234 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d6de8df4-da91-46a7-b1ae-a98240562fc0 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1522 microversion: 2.1 time: 0.296496 Sep 21 16:24:40.976234 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 82/180] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:40 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:41.162244 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-01e07a16-170e-4ae3-a9c7-c74e8ced1c3e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:41.170793 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-01e07a16-170e-4ae3-a9c7-c74e8ced1c3e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f" status: 200 len: 1312 microversion: 2.1 time: 0.281989 Sep 21 16:24:41.171715 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 99/181] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:40 2022] GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f => generated 1312 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:24:42.008851 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-8a54ccfa-adde-4f67-b039-f162154a5d2e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:42.009468 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-8a54ccfa-adde-4f67-b039-f162154a5d2e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:42.016752 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8a54ccfa-adde-4f67-b039-f162154a5d2e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:42.017251 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8a54ccfa-adde-4f67-b039-f162154a5d2e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:42.017689 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8a54ccfa-adde-4f67-b039-f162154a5d2e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:42.018608 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8a54ccfa-adde-4f67-b039-f162154a5d2e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:42.019214 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8a54ccfa-adde-4f67-b039-f162154a5d2e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:42.019642 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8a54ccfa-adde-4f67-b039-f162154a5d2e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:42.199906 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-4255b5be-ea55-4180-9b83-ff69d7df5a55 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:42.201690 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-4255b5be-ea55-4180-9b83-ff69d7df5a55 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 712ad5b4-0827-418a-befc-644766bc899f] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:42.215625 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-8a54ccfa-adde-4f67-b039-f162154a5d2e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:42.218127 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4255b5be-ea55-4180-9b83-ff69d7df5a55 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:42.219270 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4255b5be-ea55-4180-9b83-ff69d7df5a55 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:42.219988 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4255b5be-ea55-4180-9b83-ff69d7df5a55 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:42.221165 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4255b5be-ea55-4180-9b83-ff69d7df5a55 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:42.221996 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4255b5be-ea55-4180-9b83-ff69d7df5a55 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:42.222728 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4255b5be-ea55-4180-9b83-ff69d7df5a55 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:42.234369 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-8a54ccfa-adde-4f67-b039-f162154a5d2e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1522 microversion: 2.1 time: 0.227906 Sep 21 16:24:42.234369 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 83/182] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:42 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:42.464232 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-4255b5be-ea55-4180-9b83-ff69d7df5a55 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:42.473139 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-4255b5be-ea55-4180-9b83-ff69d7df5a55 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f" status: 200 len: 1312 microversion: 2.1 time: 0.280412 Sep 21 16:24:42.473835 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 100/183] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:42 2022] GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f => generated 1312 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:43.278205 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-fa6d2b1d-53b3-4a19-8d92-b5e9d9495b7f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:43.280590 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-fa6d2b1d-53b3-4a19-8d92-b5e9d9495b7f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:43.293424 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fa6d2b1d-53b3-4a19-8d92-b5e9d9495b7f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:43.294634 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fa6d2b1d-53b3-4a19-8d92-b5e9d9495b7f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:43.295574 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fa6d2b1d-53b3-4a19-8d92-b5e9d9495b7f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:43.296865 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fa6d2b1d-53b3-4a19-8d92-b5e9d9495b7f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:43.298351 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fa6d2b1d-53b3-4a19-8d92-b5e9d9495b7f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:43.299101 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fa6d2b1d-53b3-4a19-8d92-b5e9d9495b7f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:43.502489 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-59aedb36-1603-4113-bce3-4e2bc656d485 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:43.503947 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-59aedb36-1603-4113-bce3-4e2bc656d485 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 712ad5b4-0827-418a-befc-644766bc899f] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:43.511978 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell0:SELECT=2 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:43.513849 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell0:SELECT=6 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:43.516991 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-59aedb36-1603-4113-bce3-4e2bc656d485 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:43.517931 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-59aedb36-1603-4113-bce3-4e2bc656d485 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:43.518615 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-59aedb36-1603-4113-bce3-4e2bc656d485 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:43.519661 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-59aedb36-1603-4113-bce3-4e2bc656d485 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:43.520428 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-59aedb36-1603-4113-bce3-4e2bc656d485 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:43.520956 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-59aedb36-1603-4113-bce3-4e2bc656d485 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:43.630995 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell0:SELECT=2 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:43.696371 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-fa6d2b1d-53b3-4a19-8d92-b5e9d9495b7f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:43.719103 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-fa6d2b1d-53b3-4a19-8d92-b5e9d9495b7f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1522 microversion: 2.1 time: 0.445618 Sep 21 16:24:43.719917 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 84/184] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:43 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1522 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:24:43.799011 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-59aedb36-1603-4113-bce3-4e2bc656d485 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:43.817691 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-59aedb36-1603-4113-bce3-4e2bc656d485 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f" status: 200 len: 1312 microversion: 2.1 time: 0.323305 Sep 21 16:24:43.819068 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 101/185] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:43 2022] GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f => generated 1312 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:24:44.745741 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-6bb3b401-2620-4d2f-b148-12b088cfe887 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:44.746459 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-6bb3b401-2620-4d2f-b148-12b088cfe887 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:44.753235 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6bb3b401-2620-4d2f-b148-12b088cfe887 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:44.753839 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6bb3b401-2620-4d2f-b148-12b088cfe887 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:44.754302 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6bb3b401-2620-4d2f-b148-12b088cfe887 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:44.755004 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6bb3b401-2620-4d2f-b148-12b088cfe887 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:44.755487 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6bb3b401-2620-4d2f-b148-12b088cfe887 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:44.755909 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6bb3b401-2620-4d2f-b148-12b088cfe887 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:44.860208 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-3e7ff586-6a68-4b70-9c45-3614e35a3e12 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:44.863811 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-3e7ff586-6a68-4b70-9c45-3614e35a3e12 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 712ad5b4-0827-418a-befc-644766bc899f] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:44.877531 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3e7ff586-6a68-4b70-9c45-3614e35a3e12 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:44.878571 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3e7ff586-6a68-4b70-9c45-3614e35a3e12 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:44.879634 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3e7ff586-6a68-4b70-9c45-3614e35a3e12 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:44.880941 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3e7ff586-6a68-4b70-9c45-3614e35a3e12 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:44.881762 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3e7ff586-6a68-4b70-9c45-3614e35a3e12 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:44.882777 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3e7ff586-6a68-4b70-9c45-3614e35a3e12 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:44.956206 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-6bb3b401-2620-4d2f-b148-12b088cfe887 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:44.967995 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-6bb3b401-2620-4d2f-b148-12b088cfe887 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1522 microversion: 2.1 time: 0.227317 Sep 21 16:24:44.968640 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 85/186] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:44 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:45.149247 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-3e7ff586-6a68-4b70-9c45-3614e35a3e12 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:45.161015 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-3e7ff586-6a68-4b70-9c45-3614e35a3e12 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f" status: 200 len: 1312 microversion: 2.1 time: 0.319165 Sep 21 16:24:45.162943 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 102/187] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:44 2022] GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f => generated 1312 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:46.001721 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-86309fe5-53b8-4dc6-9ca3-49b69b1dea5a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:46.002374 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-86309fe5-53b8-4dc6-9ca3-49b69b1dea5a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:46.009566 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-86309fe5-53b8-4dc6-9ca3-49b69b1dea5a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:46.010077 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-86309fe5-53b8-4dc6-9ca3-49b69b1dea5a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:46.010525 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-86309fe5-53b8-4dc6-9ca3-49b69b1dea5a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:46.011432 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-86309fe5-53b8-4dc6-9ca3-49b69b1dea5a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:46.011898 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-86309fe5-53b8-4dc6-9ca3-49b69b1dea5a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:46.012319 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-86309fe5-53b8-4dc6-9ca3-49b69b1dea5a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:46.189486 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-2b5816c6-6027-46f6-a8eb-885e1bfc8ba9 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:46.196226 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-2b5816c6-6027-46f6-a8eb-885e1bfc8ba9 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 712ad5b4-0827-418a-befc-644766bc899f] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:46.210152 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2b5816c6-6027-46f6-a8eb-885e1bfc8ba9 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:46.211499 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2b5816c6-6027-46f6-a8eb-885e1bfc8ba9 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:46.212928 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2b5816c6-6027-46f6-a8eb-885e1bfc8ba9 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:46.214499 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2b5816c6-6027-46f6-a8eb-885e1bfc8ba9 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:46.215681 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2b5816c6-6027-46f6-a8eb-885e1bfc8ba9 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:46.217492 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2b5816c6-6027-46f6-a8eb-885e1bfc8ba9 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:46.297986 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-86309fe5-53b8-4dc6-9ca3-49b69b1dea5a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:46.312925 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-86309fe5-53b8-4dc6-9ca3-49b69b1dea5a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1522 microversion: 2.1 time: 0.315048 Sep 21 16:24:46.314593 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 86/188] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:45 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:46.429091 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-2b5816c6-6027-46f6-a8eb-885e1bfc8ba9 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:46.437546 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-2b5816c6-6027-46f6-a8eb-885e1bfc8ba9 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f" status: 200 len: 1312 microversion: 2.1 time: 0.255619 Sep 21 16:24:46.454085 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 103/189] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:46 2022] GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f => generated 1312 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:47.337050 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-c1dbf0ba-858a-4018-969e-b025a18a978a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:47.337825 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-c1dbf0ba-858a-4018-969e-b025a18a978a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:47.344272 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c1dbf0ba-858a-4018-969e-b025a18a978a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:47.344848 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c1dbf0ba-858a-4018-969e-b025a18a978a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:47.345382 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c1dbf0ba-858a-4018-969e-b025a18a978a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:47.346218 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c1dbf0ba-858a-4018-969e-b025a18a978a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:47.346762 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c1dbf0ba-858a-4018-969e-b025a18a978a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:47.347260 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c1dbf0ba-858a-4018-969e-b025a18a978a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:47.474733 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-dbe8b8a6-60fa-4100-9953-24f377fb452c tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:47.475620 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-dbe8b8a6-60fa-4100-9953-24f377fb452c tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 712ad5b4-0827-418a-befc-644766bc899f] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:47.483683 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dbe8b8a6-60fa-4100-9953-24f377fb452c tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:47.484536 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dbe8b8a6-60fa-4100-9953-24f377fb452c tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:47.485503 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dbe8b8a6-60fa-4100-9953-24f377fb452c tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:47.486871 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dbe8b8a6-60fa-4100-9953-24f377fb452c tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:47.487569 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dbe8b8a6-60fa-4100-9953-24f377fb452c tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:47.488060 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dbe8b8a6-60fa-4100-9953-24f377fb452c tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:47.528188 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-c1dbf0ba-858a-4018-969e-b025a18a978a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:47.544293 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-c1dbf0ba-858a-4018-969e-b025a18a978a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1522 microversion: 2.1 time: 0.210787 Sep 21 16:24:47.546204 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 87/190] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:47 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:47.655711 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-dbe8b8a6-60fa-4100-9953-24f377fb452c tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:47.664627 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-dbe8b8a6-60fa-4100-9953-24f377fb452c tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f" status: 200 len: 1312 microversion: 2.1 time: 0.195299 Sep 21 16:24:47.665350 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 104/191] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:47 2022] GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f => generated 1312 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:24:48.585588 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-e32fa882-ccd5-4538-9942-8e9cf140fb40 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:48.586428 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-e32fa882-ccd5-4538-9942-8e9cf140fb40 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:48.592900 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e32fa882-ccd5-4538-9942-8e9cf140fb40 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:48.593527 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e32fa882-ccd5-4538-9942-8e9cf140fb40 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:48.594082 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e32fa882-ccd5-4538-9942-8e9cf140fb40 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:48.594883 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e32fa882-ccd5-4538-9942-8e9cf140fb40 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:48.595426 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e32fa882-ccd5-4538-9942-8e9cf140fb40 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:48.595998 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e32fa882-ccd5-4538-9942-8e9cf140fb40 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:48.691662 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-e575fe4f-07a5-4708-96c7-2a228464f188 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:48.692271 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-e575fe4f-07a5-4708-96c7-2a228464f188 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 712ad5b4-0827-418a-befc-644766bc899f] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:48.699978 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e575fe4f-07a5-4708-96c7-2a228464f188 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:48.700857 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e575fe4f-07a5-4708-96c7-2a228464f188 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:48.701369 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e575fe4f-07a5-4708-96c7-2a228464f188 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:48.702224 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e575fe4f-07a5-4708-96c7-2a228464f188 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:48.702759 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e575fe4f-07a5-4708-96c7-2a228464f188 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:48.703294 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e575fe4f-07a5-4708-96c7-2a228464f188 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:48.766488 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-e32fa882-ccd5-4538-9942-8e9cf140fb40 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:48.780917 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-e32fa882-ccd5-4538-9942-8e9cf140fb40 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1522 microversion: 2.1 time: 0.199331 Sep 21 16:24:48.782096 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 88/192] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:48 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:24:48.870274 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-e575fe4f-07a5-4708-96c7-2a228464f188 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:48.878751 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-e575fe4f-07a5-4708-96c7-2a228464f188 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f" status: 200 len: 1312 microversion: 2.1 time: 0.191051 Sep 21 16:24:48.879350 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 105/193] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:48 2022] GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f => generated 1312 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:24:49.812527 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-047e0af0-f6f4-4d3f-a232-aaf449121815 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:49.813069 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-047e0af0-f6f4-4d3f-a232-aaf449121815 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:49.820183 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-047e0af0-f6f4-4d3f-a232-aaf449121815 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:49.820675 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-047e0af0-f6f4-4d3f-a232-aaf449121815 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:49.821115 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-047e0af0-f6f4-4d3f-a232-aaf449121815 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:49.821840 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-047e0af0-f6f4-4d3f-a232-aaf449121815 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:49.822410 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-047e0af0-f6f4-4d3f-a232-aaf449121815 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:49.822837 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-047e0af0-f6f4-4d3f-a232-aaf449121815 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:49.906339 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c00223d4-3dfd-415b-8418-088fd01b0f24 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:49.907876 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-c00223d4-3dfd-415b-8418-088fd01b0f24 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 712ad5b4-0827-418a-befc-644766bc899f] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:49.919073 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c00223d4-3dfd-415b-8418-088fd01b0f24 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:49.919926 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c00223d4-3dfd-415b-8418-088fd01b0f24 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:49.920655 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c00223d4-3dfd-415b-8418-088fd01b0f24 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:49.921863 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c00223d4-3dfd-415b-8418-088fd01b0f24 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:49.922695 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c00223d4-3dfd-415b-8418-088fd01b0f24 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:49.923645 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c00223d4-3dfd-415b-8418-088fd01b0f24 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:50.040140 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-047e0af0-f6f4-4d3f-a232-aaf449121815 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:50.059310 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-047e0af0-f6f4-4d3f-a232-aaf449121815 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1522 microversion: 2.1 time: 0.250875 Sep 21 16:24:50.059965 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 89/194] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:49 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:50.116379 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-c00223d4-3dfd-415b-8418-088fd01b0f24 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:50.124702 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-c00223d4-3dfd-415b-8418-088fd01b0f24 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f" status: 200 len: 1312 microversion: 2.1 time: 0.225273 Sep 21 16:24:50.125299 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 106/195] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:49 2022] GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f => generated 1312 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:50.491462 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-b00c5945-02d4-44e5-b88f-c9547b9d20c0 req-50fcad15-6096-4deb-a42d-d5cbd5b8fac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "712ad5b4-0827-418a-befc-644766bc899f", "name": "network-vif-plugged", "status": "completed", "tag": "07c1f951-0669-47c3-888c-b2247337d8d1"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:24:50.501720 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-b00c5945-02d4-44e5-b88f-c9547b9d20c0 req-50fcad15-6096-4deb-a42d-d5cbd5b8fac8 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:50.502245 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-b00c5945-02d4-44e5-b88f-c9547b9d20c0 req-50fcad15-6096-4deb-a42d-d5cbd5b8fac8 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:50.502675 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-b00c5945-02d4-44e5-b88f-c9547b9d20c0 req-50fcad15-6096-4deb-a42d-d5cbd5b8fac8 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:50.515673 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-b00c5945-02d4-44e5-b88f-c9547b9d20c0 req-50fcad15-6096-4deb-a42d-d5cbd5b8fac8 service nova] Creating event network-vif-plugged:07c1f951-0669-47c3-888c-b2247337d8d1 for instance 712ad5b4-0827-418a-befc-644766bc899f on hv-cinder-85862 Sep 21 16:24:50.521571 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-b00c5945-02d4-44e5-b88f-c9547b9d20c0 req-50fcad15-6096-4deb-a42d-d5cbd5b8fac8 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034118 Sep 21 16:24:50.522218 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 90/196] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:24:51.086262 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-e1bf0cda-0d11-4181-a4e7-468865880d8c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:51.087982 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-e1bf0cda-0d11-4181-a4e7-468865880d8c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:51.094378 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e1bf0cda-0d11-4181-a4e7-468865880d8c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:51.094883 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e1bf0cda-0d11-4181-a4e7-468865880d8c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:51.095317 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e1bf0cda-0d11-4181-a4e7-468865880d8c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:51.096536 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e1bf0cda-0d11-4181-a4e7-468865880d8c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:51.097288 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e1bf0cda-0d11-4181-a4e7-468865880d8c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:51.097653 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e1bf0cda-0d11-4181-a4e7-468865880d8c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:51.150248 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d7f80ed7-a3fc-4e3d-a8ef-1eb06bca293d tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:51.151141 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d7f80ed7-a3fc-4e3d-a8ef-1eb06bca293d tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 712ad5b4-0827-418a-befc-644766bc899f] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:51.159881 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d7f80ed7-a3fc-4e3d-a8ef-1eb06bca293d tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:51.160370 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d7f80ed7-a3fc-4e3d-a8ef-1eb06bca293d tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:51.162030 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d7f80ed7-a3fc-4e3d-a8ef-1eb06bca293d tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:51.162897 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d7f80ed7-a3fc-4e3d-a8ef-1eb06bca293d tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:51.164773 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d7f80ed7-a3fc-4e3d-a8ef-1eb06bca293d tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:51.165210 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d7f80ed7-a3fc-4e3d-a8ef-1eb06bca293d tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:51.301388 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-e1bf0cda-0d11-4181-a4e7-468865880d8c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:51.326116 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-e1bf0cda-0d11-4181-a4e7-468865880d8c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1522 microversion: 2.1 time: 0.244676 Sep 21 16:24:51.328250 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 107/197] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:51 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:51.368393 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d7f80ed7-a3fc-4e3d-a8ef-1eb06bca293d tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:51.381460 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d7f80ed7-a3fc-4e3d-a8ef-1eb06bca293d tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f" status: 200 len: 1312 microversion: 2.1 time: 0.237496 Sep 21 16:24:51.388315 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 91/198] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:51 2022] GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f => generated 1312 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:24:52.353517 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-65d04da7-98c6-448f-af1e-a3d645add51c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:52.354109 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-65d04da7-98c6-448f-af1e-a3d645add51c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:52.361117 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-65d04da7-98c6-448f-af1e-a3d645add51c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:52.361593 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-65d04da7-98c6-448f-af1e-a3d645add51c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:52.362066 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-65d04da7-98c6-448f-af1e-a3d645add51c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:52.362777 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-65d04da7-98c6-448f-af1e-a3d645add51c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:52.363247 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-65d04da7-98c6-448f-af1e-a3d645add51c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:52.364058 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-65d04da7-98c6-448f-af1e-a3d645add51c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:52.419119 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d136333a-17ea-442b-a231-6d3aacf0b849 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:52.419725 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d136333a-17ea-442b-a231-6d3aacf0b849 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 712ad5b4-0827-418a-befc-644766bc899f] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:52.426072 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d136333a-17ea-442b-a231-6d3aacf0b849 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:52.426595 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d136333a-17ea-442b-a231-6d3aacf0b849 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:52.427031 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d136333a-17ea-442b-a231-6d3aacf0b849 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:52.427751 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d136333a-17ea-442b-a231-6d3aacf0b849 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:52.428213 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d136333a-17ea-442b-a231-6d3aacf0b849 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:52.428630 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d136333a-17ea-442b-a231-6d3aacf0b849 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:52.520998 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-65d04da7-98c6-448f-af1e-a3d645add51c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:52.529973 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-65d04da7-98c6-448f-af1e-a3d645add51c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1522 microversion: 2.1 time: 0.181099 Sep 21 16:24:52.530600 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 108/199] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:52 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:52.576400 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d136333a-17ea-442b-a231-6d3aacf0b849 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:52.585235 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d136333a-17ea-442b-a231-6d3aacf0b849 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f" status: 200 len: 1312 microversion: 2.1 time: 0.169945 Sep 21 16:24:52.585820 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 92/200] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:52 2022] GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f => generated 1312 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:24:53.556630 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-acf59d47-c14a-4fea-a22b-39fd81ff6e16 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:53.557386 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-acf59d47-c14a-4fea-a22b-39fd81ff6e16 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:53.565370 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-acf59d47-c14a-4fea-a22b-39fd81ff6e16 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:53.565859 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-acf59d47-c14a-4fea-a22b-39fd81ff6e16 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:53.566404 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-acf59d47-c14a-4fea-a22b-39fd81ff6e16 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:53.567704 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-acf59d47-c14a-4fea-a22b-39fd81ff6e16 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:53.568176 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-acf59d47-c14a-4fea-a22b-39fd81ff6e16 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:53.568682 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-acf59d47-c14a-4fea-a22b-39fd81ff6e16 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:53.615275 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-cadc3f85-182e-4761-98a3-92f303d2dec6 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:53.616621 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-cadc3f85-182e-4761-98a3-92f303d2dec6 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 712ad5b4-0827-418a-befc-644766bc899f] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:53.627960 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cadc3f85-182e-4761-98a3-92f303d2dec6 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:53.630016 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cadc3f85-182e-4761-98a3-92f303d2dec6 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:53.630921 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cadc3f85-182e-4761-98a3-92f303d2dec6 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:53.631965 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cadc3f85-182e-4761-98a3-92f303d2dec6 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:53.632632 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cadc3f85-182e-4761-98a3-92f303d2dec6 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:53.633285 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cadc3f85-182e-4761-98a3-92f303d2dec6 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:53.777177 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-acf59d47-c14a-4fea-a22b-39fd81ff6e16 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:53.788175 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-acf59d47-c14a-4fea-a22b-39fd81ff6e16 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1522 microversion: 2.1 time: 0.236033 Sep 21 16:24:53.788958 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 109/201] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:53 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:53.811701 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-cadc3f85-182e-4761-98a3-92f303d2dec6 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:53.821667 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-cadc3f85-182e-4761-98a3-92f303d2dec6 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f" status: 200 len: 1312 microversion: 2.1 time: 0.210392 Sep 21 16:24:53.822391 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 93/202] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:53 2022] GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f => generated 1312 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:24:54.817478 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c23acf8c-b712-40ac-8945-cd0a2f8678b1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:54.820085 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-c23acf8c-b712-40ac-8945-cd0a2f8678b1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:54.831579 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c23acf8c-b712-40ac-8945-cd0a2f8678b1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:54.833318 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c23acf8c-b712-40ac-8945-cd0a2f8678b1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:54.834383 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c23acf8c-b712-40ac-8945-cd0a2f8678b1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:54.835947 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c23acf8c-b712-40ac-8945-cd0a2f8678b1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:54.837161 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c23acf8c-b712-40ac-8945-cd0a2f8678b1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:54.837956 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c23acf8c-b712-40ac-8945-cd0a2f8678b1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:54.855345 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-e8e43db0-04b2-4730-92a4-7b9ad2ac818e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:54.856168 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-e8e43db0-04b2-4730-92a4-7b9ad2ac818e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 712ad5b4-0827-418a-befc-644766bc899f] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:54.862766 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e8e43db0-04b2-4730-92a4-7b9ad2ac818e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:54.863568 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e8e43db0-04b2-4730-92a4-7b9ad2ac818e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:54.864014 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e8e43db0-04b2-4730-92a4-7b9ad2ac818e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:54.864730 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e8e43db0-04b2-4730-92a4-7b9ad2ac818e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:54.865179 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e8e43db0-04b2-4730-92a4-7b9ad2ac818e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:54.865593 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e8e43db0-04b2-4730-92a4-7b9ad2ac818e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:55.023793 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-c23acf8c-b712-40ac-8945-cd0a2f8678b1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:55.034341 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-c23acf8c-b712-40ac-8945-cd0a2f8678b1 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1522 microversion: 2.1 time: 0.223129 Sep 21 16:24:55.035326 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 110/203] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:54 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:55.044699 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-e8e43db0-04b2-4730-92a4-7b9ad2ac818e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:55.053878 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-e8e43db0-04b2-4730-92a4-7b9ad2ac818e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f" status: 200 len: 1312 microversion: 2.1 time: 0.202204 Sep 21 16:24:55.054543 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 94/204] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:54 2022] GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f => generated 1312 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:56.081899 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-4abf5368-2042-4744-ab24-088247acf37e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:56.081899 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-4abf5368-2042-4744-ab24-088247acf37e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:56.090144 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-cfa21f8d-6b76-4ad6-9a8c-98a18090aeae tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:56.092153 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-cfa21f8d-6b76-4ad6-9a8c-98a18090aeae tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 712ad5b4-0827-418a-befc-644766bc899f] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:56.093065 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4abf5368-2042-4744-ab24-088247acf37e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:56.093876 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4abf5368-2042-4744-ab24-088247acf37e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:56.094984 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4abf5368-2042-4744-ab24-088247acf37e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:56.096886 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4abf5368-2042-4744-ab24-088247acf37e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:56.099211 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4abf5368-2042-4744-ab24-088247acf37e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:56.099610 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4abf5368-2042-4744-ab24-088247acf37e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:56.105961 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cfa21f8d-6b76-4ad6-9a8c-98a18090aeae tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:56.107225 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cfa21f8d-6b76-4ad6-9a8c-98a18090aeae tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:56.108438 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cfa21f8d-6b76-4ad6-9a8c-98a18090aeae tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:56.109955 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cfa21f8d-6b76-4ad6-9a8c-98a18090aeae tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:56.111158 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cfa21f8d-6b76-4ad6-9a8c-98a18090aeae tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:56.112171 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cfa21f8d-6b76-4ad6-9a8c-98a18090aeae tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:56.362327 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-4abf5368-2042-4744-ab24-088247acf37e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:56.382768 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-4abf5368-2042-4744-ab24-088247acf37e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1522 microversion: 2.1 time: 0.310213 Sep 21 16:24:56.394099 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 111/205] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:56 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:56.394609 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-cfa21f8d-6b76-4ad6-9a8c-98a18090aeae tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:56.404147 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-cfa21f8d-6b76-4ad6-9a8c-98a18090aeae tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f" status: 200 len: 1495 microversion: 2.1 time: 0.328240 Sep 21 16:24:56.405045 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 95/206] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:56 2022] GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f => generated 1495 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:57.131053 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-9b7488aa-9b2f-4067-9bed-6852ee889190 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:57.131929 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-9b7488aa-9b2f-4067-9bed-6852ee889190 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 712ad5b4-0827-418a-befc-644766bc899f] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:57.142834 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9b7488aa-9b2f-4067-9bed-6852ee889190 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:57.143957 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9b7488aa-9b2f-4067-9bed-6852ee889190 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:57.145729 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9b7488aa-9b2f-4067-9bed-6852ee889190 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:57.147250 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9b7488aa-9b2f-4067-9bed-6852ee889190 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:57.148227 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9b7488aa-9b2f-4067-9bed-6852ee889190 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:57.149059 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9b7488aa-9b2f-4067-9bed-6852ee889190 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:57.200445 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-9b7488aa-9b2f-4067-9bed-6852ee889190 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 712ad5b4-0827-418a-befc-644766bc899f] Going to try to terminate instance {{(pid=120532) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 16:24:57.232086 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=100 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:57.329857 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-9b7488aa-9b2f-4067-9bed-6852ee889190 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "DELETE /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f" status: 204 len: 0 microversion: 2.1 time: 0.203771 Sep 21 16:24:57.330335 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 112/207] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Sep 21 16:24:57 2022] DELETE /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 21 16:24:57.343821 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-b969ea10-059a-4776-9cd7-9a20e6a93c0d tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:57.344899 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-b969ea10-059a-4776-9cd7-9a20e6a93c0d tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 712ad5b4-0827-418a-befc-644766bc899f] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:57.357577 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b969ea10-059a-4776-9cd7-9a20e6a93c0d tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:57.359228 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b969ea10-059a-4776-9cd7-9a20e6a93c0d tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:57.359803 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b969ea10-059a-4776-9cd7-9a20e6a93c0d tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:57.360835 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b969ea10-059a-4776-9cd7-9a20e6a93c0d tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:57.361534 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b969ea10-059a-4776-9cd7-9a20e6a93c0d tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:57.362252 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b969ea10-059a-4776-9cd7-9a20e6a93c0d tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:57.432576 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-e9e0377b-aac8-4048-a849-2d235ab1c59f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:57.434174 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-e9e0377b-aac8-4048-a849-2d235ab1c59f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:57.445916 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e9e0377b-aac8-4048-a849-2d235ab1c59f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:57.446557 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e9e0377b-aac8-4048-a849-2d235ab1c59f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:57.447123 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e9e0377b-aac8-4048-a849-2d235ab1c59f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:57.447954 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e9e0377b-aac8-4048-a849-2d235ab1c59f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:57.448599 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e9e0377b-aac8-4048-a849-2d235ab1c59f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:57.449355 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e9e0377b-aac8-4048-a849-2d235ab1c59f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:57.611610 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-b969ea10-059a-4776-9cd7-9a20e6a93c0d tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:57.628141 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-b969ea10-059a-4776-9cd7-9a20e6a93c0d tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f" status: 200 len: 1501 microversion: 2.1 time: 0.290605 Sep 21 16:24:57.630371 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 96/208] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:57 2022] GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f => generated 1501 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:24:57.671618 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-e9e0377b-aac8-4048-a849-2d235ab1c59f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:57.681919 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-e9e0377b-aac8-4048-a849-2d235ab1c59f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1502 microversion: 2.1 time: 0.256399 Sep 21 16:24:57.683229 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 113/209] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:57 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1502 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:24:57.722657 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-bbc860a2-8e78-40ba-a601-b754d5af678c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:57.723805 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-bbc860a2-8e78-40ba-a601-b754d5af678c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:57.758924 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bbc860a2-8e78-40ba-a601-b754d5af678c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:57.759435 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bbc860a2-8e78-40ba-a601-b754d5af678c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:57.760104 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bbc860a2-8e78-40ba-a601-b754d5af678c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:57.760970 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bbc860a2-8e78-40ba-a601-b754d5af678c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:57.761363 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bbc860a2-8e78-40ba-a601-b754d5af678c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:57.761786 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bbc860a2-8e78-40ba-a601-b754d5af678c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:57.975334 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-bbc860a2-8e78-40ba-a601-b754d5af678c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:57.978238 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=100 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:24:57.990753 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-bbc860a2-8e78-40ba-a601-b754d5af678c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 200 len: 1516 microversion: 2.1 time: 0.283652 Sep 21 16:24:57.992385 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 97/210] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:57 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 1516 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:24:58.668890 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-d3afd773-4bc2-49bb-8a74-a03084d2c612 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:58.669743 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-d3afd773-4bc2-49bb-8a74-a03084d2c612 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 712ad5b4-0827-418a-befc-644766bc899f] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:58.677345 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d3afd773-4bc2-49bb-8a74-a03084d2c612 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:58.677841 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d3afd773-4bc2-49bb-8a74-a03084d2c612 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:58.678302 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d3afd773-4bc2-49bb-8a74-a03084d2c612 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:58.679015 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d3afd773-4bc2-49bb-8a74-a03084d2c612 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:58.679467 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d3afd773-4bc2-49bb-8a74-a03084d2c612 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:58.679884 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d3afd773-4bc2-49bb-8a74-a03084d2c612 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:58.838340 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d3afd773-4bc2-49bb-8a74-a03084d2c612 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:24:58.850200 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-d3afd773-4bc2-49bb-8a74-a03084d2c612 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f" status: 200 len: 1501 microversion: 2.1 time: 0.183347 Sep 21 16:24:58.850200 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 114/211] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:58 2022] GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f => generated 1501 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:24:59.645923 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-0d598060-8903-44c8-a1ac-8551d4ca11e3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:24:59.649677 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-0d598060-8903-44c8-a1ac-8551d4ca11e3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:59.659717 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0d598060-8903-44c8-a1ac-8551d4ca11e3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:59.661401 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0d598060-8903-44c8-a1ac-8551d4ca11e3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:59.662389 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0d598060-8903-44c8-a1ac-8551d4ca11e3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:59.663869 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0d598060-8903-44c8-a1ac-8551d4ca11e3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:59.664637 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0d598060-8903-44c8-a1ac-8551d4ca11e3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:59.665566 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0d598060-8903-44c8-a1ac-8551d4ca11e3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:59.710583 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.objects.instance [None req-0d598060-8903-44c8-a1ac-8551d4ca11e3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lazy-loading 'flavor' on Instance uuid 0ece03bf-7582-46b8-8966-0f46577abe14 {{(pid=120531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 16:24:59.859028 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-0d598060-8903-44c8-a1ac-8551d4ca11e3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "POST /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14/action" status: 200 len: 32 microversion: 2.1 time: 0.218089 Sep 21 16:24:59.860914 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 98/212] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Sep 21 16:24:59 2022] POST /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14/action => generated 32 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 21 16:24:59.875498 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d3109401-36b9-45a6-a24a-340a75657def tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:59.876814 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d3109401-36b9-45a6-a24a-340a75657def tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 712ad5b4-0827-418a-befc-644766bc899f] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:59.883935 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-3a47db96-f166-473f-8499-ec781b5057fe tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:24:59.896333 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d3109401-36b9-45a6-a24a-340a75657def tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:59.896333 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d3109401-36b9-45a6-a24a-340a75657def tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:59.896333 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d3109401-36b9-45a6-a24a-340a75657def tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:59.896333 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d3109401-36b9-45a6-a24a-340a75657def tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:59.896870 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d3109401-36b9-45a6-a24a-340a75657def tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:59.896870 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d3109401-36b9-45a6-a24a-340a75657def tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:59.902768 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-3a47db96-f166-473f-8499-ec781b5057fe tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:24:59.924553 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3a47db96-f166-473f-8499-ec781b5057fe tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:59.925400 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3a47db96-f166-473f-8499-ec781b5057fe tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:59.926104 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3a47db96-f166-473f-8499-ec781b5057fe tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:24:59.927186 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3a47db96-f166-473f-8499-ec781b5057fe tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:24:59.930223 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3a47db96-f166-473f-8499-ec781b5057fe tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:24:59.932351 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3a47db96-f166-473f-8499-ec781b5057fe tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:00.139665 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-3a47db96-f166-473f-8499-ec781b5057fe tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:00.151116 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-3a47db96-f166-473f-8499-ec781b5057fe tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 200 len: 1522 microversion: 2.1 time: 0.281975 Sep 21 16:25:00.156324 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 115/213] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:59 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:00.397436 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d3109401-36b9-45a6-a24a-340a75657def tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:00.412221 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d3109401-36b9-45a6-a24a-340a75657def tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f" status: 200 len: 1501 microversion: 2.1 time: 0.543345 Sep 21 16:25:00.413452 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 99/214] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:24:59 2022] GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f => generated 1501 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:00.871932 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-8dbec0f7-04e7-4d55-bebd-714cf0b34507 req-c29c5d5f-d2d7-4757-9388-26a021b7e4eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "712ad5b4-0827-418a-befc-644766bc899f", "name": "network-vif-deleted", "tag": "07c1f951-0669-47c3-888c-b2247337d8d1"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:25:00.887315 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-8dbec0f7-04e7-4d55-bebd-714cf0b34507 req-c29c5d5f-d2d7-4757-9388-26a021b7e4eb service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:00.888567 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-8dbec0f7-04e7-4d55-bebd-714cf0b34507 req-c29c5d5f-d2d7-4757-9388-26a021b7e4eb service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:00.889248 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-8dbec0f7-04e7-4d55-bebd-714cf0b34507 req-c29c5d5f-d2d7-4757-9388-26a021b7e4eb service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:00.906452 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-8dbec0f7-04e7-4d55-bebd-714cf0b34507 req-c29c5d5f-d2d7-4757-9388-26a021b7e4eb service nova] Creating event network-vif-deleted:07c1f951-0669-47c3-888c-b2247337d8d1 for instance 712ad5b4-0827-418a-befc-644766bc899f on hv-cinder-85862 Sep 21 16:25:00.914439 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-8dbec0f7-04e7-4d55-bebd-714cf0b34507 req-c29c5d5f-d2d7-4757-9388-26a021b7e4eb service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046116 Sep 21 16:25:00.915813 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 116/215] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:25:01.196673 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-30b979bc-e453-4b37-a6cf-66cc0f10c0c9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:01.199250 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-30b979bc-e453-4b37-a6cf-66cc0f10c0c9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:01.234847 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-30b979bc-e453-4b37-a6cf-66cc0f10c0c9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:01.238641 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-30b979bc-e453-4b37-a6cf-66cc0f10c0c9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:01.240506 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-30b979bc-e453-4b37-a6cf-66cc0f10c0c9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:01.257175 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-30b979bc-e453-4b37-a6cf-66cc0f10c0c9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:01.258091 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-30b979bc-e453-4b37-a6cf-66cc0f10c0c9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:01.258869 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-30b979bc-e453-4b37-a6cf-66cc0f10c0c9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:01.460733 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-33da6b62-2378-4061-aace-20bcffb43c82 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:01.462229 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-33da6b62-2378-4061-aace-20bcffb43c82 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 712ad5b4-0827-418a-befc-644766bc899f] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:01.486096 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-33da6b62-2378-4061-aace-20bcffb43c82 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:01.487253 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-33da6b62-2378-4061-aace-20bcffb43c82 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:01.489019 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-33da6b62-2378-4061-aace-20bcffb43c82 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:01.490714 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-33da6b62-2378-4061-aace-20bcffb43c82 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:01.492115 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-33da6b62-2378-4061-aace-20bcffb43c82 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:01.493144 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-33da6b62-2378-4061-aace-20bcffb43c82 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:01.570706 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-33da6b62-2378-4061-aace-20bcffb43c82 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:01.571519 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-33da6b62-2378-4061-aace-20bcffb43c82 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:01.578568 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-33da6b62-2378-4061-aace-20bcffb43c82 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:01.581151 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.objects.instance [None req-33da6b62-2378-4061-aace-20bcffb43c82 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lazy-loading 'fault' on Instance uuid 712ad5b4-0827-418a-befc-644766bc899f {{(pid=120532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 16:25:01.607035 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-30b979bc-e453-4b37-a6cf-66cc0f10c0c9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:01.624978 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-30b979bc-e453-4b37-a6cf-66cc0f10c0c9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 200 len: 1522 microversion: 2.1 time: 0.435927 Sep 21 16:25:01.639946 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 100/216] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:01 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 1522 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:25:01.692285 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-33da6b62-2378-4061-aace-20bcffb43c82 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:01.704628 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-33da6b62-2378-4061-aace-20bcffb43c82 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f" status: 200 len: 1302 microversion: 2.1 time: 0.256127 Sep 21 16:25:01.705538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 117/217] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:01 2022] GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f => generated 1302 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:02.674668 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-7c36d84a-f05a-4603-9b14-b575a82bf3a2 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:02.676450 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-7c36d84a-f05a-4603-9b14-b575a82bf3a2 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:02.687707 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7c36d84a-f05a-4603-9b14-b575a82bf3a2 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:02.689148 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7c36d84a-f05a-4603-9b14-b575a82bf3a2 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:02.690317 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7c36d84a-f05a-4603-9b14-b575a82bf3a2 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:02.691651 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7c36d84a-f05a-4603-9b14-b575a82bf3a2 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:02.692458 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7c36d84a-f05a-4603-9b14-b575a82bf3a2 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:02.693459 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7c36d84a-f05a-4603-9b14-b575a82bf3a2 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:02.752968 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-0f940963-4f11-40e3-9500-82104befae0e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:02.754879 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-0f940963-4f11-40e3-9500-82104befae0e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 712ad5b4-0827-418a-befc-644766bc899f] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:02.768965 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0f940963-4f11-40e3-9500-82104befae0e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:02.783518 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0f940963-4f11-40e3-9500-82104befae0e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:02.785822 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0f940963-4f11-40e3-9500-82104befae0e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:02.788727 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0f940963-4f11-40e3-9500-82104befae0e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:02.790268 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0f940963-4f11-40e3-9500-82104befae0e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:02.791045 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0f940963-4f11-40e3-9500-82104befae0e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:02.819390 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.wsgi [None req-0f940963-4f11-40e3-9500-82104befae0e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] HTTP exception thrown: Instance 712ad5b4-0827-418a-befc-644766bc899f could not be found. Sep 21 16:25:02.823399 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-0f940963-4f11-40e3-9500-82104befae0e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Request method failure captured: Sep 21 16:25:02.823399 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: request: GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f HTTP/1.1 Sep 21 16:25:02.823399 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept: application/json Sep 21 16:25:02.823399 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept-Encoding: identity Sep 21 16:25:02.823399 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Connection: close Sep 21 16:25:02.823399 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Length: 0 Sep 21 16:25:02.823399 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Type: application/json Sep 21 16:25:02.823399 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Host: 10.222.0.64 Sep 21 16:25:02.823399 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Openstack-System-Scope: None Sep 21 16:25:02.823399 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: User-Agent: python-urllib3/1.26.12 Sep 21 16:25:02.823399 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Auth-Token: gAAAAABjKzq--G33FaFUyKLhKKEwxvN_9M6T__jBOIoQnwlPtjZrOScRW0J32PplQ1W23HmMWKoCyX3KYzuCl4SUVLXY_Wl_79O80qDzHhxDA6O3CFCU7vJPusiH-4AGl7gOmmwgOjmvK5HebeXqfO0PW2NOrqtb0Hav_bsAhblfH25H_4KZ1fM Sep 21 16:25:02.823399 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Id: None Sep 21 16:25:02.823399 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Name: None Sep 21 16:25:02.823399 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Identity-Status: Confirmed Sep 21 16:25:02.823399 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Is-Admin-Project: True Sep 21 16:25:02.823399 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Id: default Sep 21 16:25:02.823399 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Name: Default Sep 21 16:25:02.823399 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Id: 97c0b8a086b046ddb2b2d475124dc692 Sep 21 16:25:02.823399 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Name: tempest-VolumesActionsTest-181559012 Sep 21 16:25:02.823399 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Role: member,reader Sep 21 16:25:02.823399 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Roles: member,reader Sep 21 16:25:02.825550 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/97c0b8a086b046ddb2b2d475124dc692"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/97c0b8a086b046ddb2b2d475124dc692"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_97c0b8a086b046ddb2b2d475124dc692"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/97c0b8a086b046ddb2b2d475124dc692"}]}] Sep 21 16:25:02.825550 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant: tempest-VolumesActionsTest-181559012 Sep 21 16:25:02.825550 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Id: 97c0b8a086b046ddb2b2d475124dc692 Sep 21 16:25:02.825550 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Name: tempest-VolumesActionsTest-181559012 Sep 21 16:25:02.825550 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User: tempest-VolumesActionsTest-181559012-project Sep 21 16:25:02.825550 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Id: default Sep 21 16:25:02.825550 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Name: Default Sep 21 16:25:02.825550 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Id: 415e8845ba8d46cc9dc939ef4556e865 Sep 21 16:25:02.825550 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Name: tempest-VolumesActionsTest-181559012-project Sep 21 16:25:02.825550 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: method: > Sep 21 16:25:02.825550 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: exception: Instance 712ad5b4-0827-418a-befc-644766bc899f could not be found. Sep 21 16:25:02.825550 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: action_args: {'id': '712ad5b4-0827-418a-befc-644766bc899f'} Sep 21 16:25:02.827124 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:25:02.827124 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:25:02.827124 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 16:25:02.827124 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 16:25:02.827124 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 16:25:02.827124 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 16:25:02.827124 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 16:25:02.827124 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 16:25:02.827124 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 16:25:02.827124 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 16:25:02.827124 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 712ad5b4-0827-418a-befc-644766bc899f could not be found. Sep 21 16:25:02.827124 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:25:02.827124 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:25:02.827124 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:25:02.827124 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:25:02.827124 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:25:02.827124 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:25:02.827124 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:25:02.827124 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:25:02.827124 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:25:02.829621 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:25:02.829621 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 16:25:02.829621 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 16:25:02.829621 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 16:25:02.829621 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 16:25:02.829621 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 16:25:02.829621 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:25:02.829621 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 712ad5b4-0827-418a-befc-644766bc899f could not be found. Sep 21 16:25:02.829621 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:25:02.829621 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:25:02.829621 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:25:02.829621 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:25:02.829621 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:25:02.829621 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:25:02.829621 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:25:02.829621 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:25:02.829621 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 712ad5b4-0827-418a-befc-644766bc899f could not be found. Sep 21 16:25:02.829621 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:25:02.832392 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-0f940963-4f11-40e3-9500-82104befae0e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Returning 404 to user: Instance 712ad5b4-0827-418a-befc-644766bc899f could not be found. {{(pid=120532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:25:02.834493 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-0f940963-4f11-40e3-9500-82104befae0e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f" status: 404 len: 111 microversion: 2.1 time: 0.088223 Sep 21 16:25:02.836318 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 118/218] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:02 2022] GET /compute/v2.1/servers/712ad5b4-0827-418a-befc-644766bc899f => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 16:25:02.846592 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ef9bbbf8-0c76-48ad-87b4-02178b96e8b6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:02.848412 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ef9bbbf8-0c76-48ad-87b4-02178b96e8b6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:02.860639 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ef9bbbf8-0c76-48ad-87b4-02178b96e8b6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:02.861688 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ef9bbbf8-0c76-48ad-87b4-02178b96e8b6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:02.862689 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ef9bbbf8-0c76-48ad-87b4-02178b96e8b6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:02.864904 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ef9bbbf8-0c76-48ad-87b4-02178b96e8b6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:02.865926 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ef9bbbf8-0c76-48ad-87b4-02178b96e8b6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:02.866941 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ef9bbbf8-0c76-48ad-87b4-02178b96e8b6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:03.052526 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-7c36d84a-f05a-4603-9b14-b575a82bf3a2 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:03.073249 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-7c36d84a-f05a-4603-9b14-b575a82bf3a2 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 200 len: 1522 microversion: 2.1 time: 0.405804 Sep 21 16:25:03.074534 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 101/219] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:02 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 1522 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:03.184237 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-4f0f462c-0cbc-4f20-82a7-382e0f4f349b tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-312955963", "imageRef": "600db436-ed6c-41b7-89f7-7dd31852a1a7", "flavorRef": "452", "networks": [{"uuid": "d2e36dbb-5f75-4421-bbca-e70cadec4d4c"}]}} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:25:03.227914 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ef9bbbf8-0c76-48ad-87b4-02178b96e8b6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64/ips" status: 200 len: 153 microversion: 2.20 time: 0.388374 Sep 21 16:25:03.230227 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 119/220] 10.222.0.64 () {60 vars in 1289 bytes} [Wed Sep 21 16:25:02 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64/ips => generated 153 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 21 16:25:03.348220 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.network.neutron [None req-4f0f462c-0cbc-4f20-82a7-382e0f4f349b tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] validate_networks() for [('d2e36dbb-5f75-4421-bbca-e70cadec4d4c', None, None, None, None, None)] {{(pid=120531) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 16:25:03.393450 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c1b048fd-4b9a-48c9-93bc-361ee5c75a78 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1000243741", "imageRef": "600db436-ed6c-41b7-89f7-7dd31852a1a7", "flavorRef": "452"}} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:25:03.558276 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.network.neutron [None req-c1b048fd-4b9a-48c9-93bc-361ee5c75a78 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] validate_networks() for None {{(pid=120532) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 16:25:04.565302 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-4f0f462c-0cbc-4f20-82a7-382e0f4f349b tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Flavor limits 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 16:25:04.565872 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-4f0f462c-0cbc-4f20-82a7-382e0f4f349b tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Image limits 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 16:25:04.567071 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-4f0f462c-0cbc-4f20-82a7-382e0f4f349b tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Flavor pref 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 16:25:04.567585 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-4f0f462c-0cbc-4f20-82a7-382e0f4f349b tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Image pref 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 16:25:04.568165 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-4f0f462c-0cbc-4f20-82a7-382e0f4f349b tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 16:25:04.578898 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4f0f462c-0cbc-4f20-82a7-382e0f4f349b tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:04.579475 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4f0f462c-0cbc-4f20-82a7-382e0f4f349b tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:04.579850 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4f0f462c-0cbc-4f20-82a7-382e0f4f349b tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:04.580659 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4f0f462c-0cbc-4f20-82a7-382e0f4f349b tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:04.581154 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4f0f462c-0cbc-4f20-82a7-382e0f4f349b tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:04.581579 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4f0f462c-0cbc-4f20-82a7-382e0f4f349b tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:04.602679 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.quota [None req-4f0f462c-0cbc-4f20-82a7-382e0f4f349b tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Getting quotas for project 97c0b8a086b046ddb2b2d475124dc692. Resources: {'cores', 'ram', 'instances'} {{(pid=120531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 16:25:04.607602 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.quota [None req-4f0f462c-0cbc-4f20-82a7-382e0f4f349b tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Getting quotas for user 415e8845ba8d46cc9dc939ef4556e865 and project 97c0b8a086b046ddb2b2d475124dc692. Resources: {'cores', 'ram', 'instances'} {{(pid=120531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 16:25:04.621953 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-4f0f462c-0cbc-4f20-82a7-382e0f4f349b tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Going to run 1 instances... {{(pid=120531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 16:25:04.625094 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-4f0f462c-0cbc-4f20-82a7-382e0f4f349b tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 675b6625-928e-45e6-bb51-f9a0bdfe117e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='600db436-ed6c-41b7-89f7-7dd31852a1a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 16:25:04.655617 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-c1b048fd-4b9a-48c9-93bc-361ee5c75a78 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Flavor limits 0:0:0 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 16:25:04.656541 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-c1b048fd-4b9a-48c9-93bc-361ee5c75a78 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Image limits 0:0:0 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 16:25:04.657031 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-c1b048fd-4b9a-48c9-93bc-361ee5c75a78 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Flavor pref 0:0:0 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 16:25:04.657555 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-c1b048fd-4b9a-48c9-93bc-361ee5c75a78 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Image pref 0:0:0 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 16:25:04.658041 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-c1b048fd-4b9a-48c9-93bc-361ee5c75a78 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 16:25:04.673713 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c1b048fd-4b9a-48c9-93bc-361ee5c75a78 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:04.674762 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c1b048fd-4b9a-48c9-93bc-361ee5c75a78 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:04.675319 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c1b048fd-4b9a-48c9-93bc-361ee5c75a78 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:04.676222 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c1b048fd-4b9a-48c9-93bc-361ee5c75a78 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:04.676763 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c1b048fd-4b9a-48c9-93bc-361ee5c75a78 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:04.677269 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c1b048fd-4b9a-48c9-93bc-361ee5c75a78 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:04.692491 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-4f0f462c-0cbc-4f20-82a7-382e0f4f349b tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.512503 Sep 21 16:25:04.693157 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 102/221] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Sep 21 16:25:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 21 16:25:04.705615 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-682589a6-5b21-4e82-9b1b-bc45f86fbd1f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:04.706616 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-682589a6-5b21-4e82-9b1b-bc45f86fbd1f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:04.715116 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-682589a6-5b21-4e82-9b1b-bc45f86fbd1f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:04.715833 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-682589a6-5b21-4e82-9b1b-bc45f86fbd1f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:04.716358 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-682589a6-5b21-4e82-9b1b-bc45f86fbd1f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:04.717218 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-682589a6-5b21-4e82-9b1b-bc45f86fbd1f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:04.717760 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-682589a6-5b21-4e82-9b1b-bc45f86fbd1f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:04.718294 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-682589a6-5b21-4e82-9b1b-bc45f86fbd1f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:04.727407 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.quota [None req-c1b048fd-4b9a-48c9-93bc-361ee5c75a78 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Getting quotas for project de5ebe21fe434bc3ad5ab4354c52fcdb. Resources: {'cores', 'ram', 'instances'} {{(pid=120532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 16:25:04.733057 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.quota [None req-c1b048fd-4b9a-48c9-93bc-361ee5c75a78 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Getting quotas for user 22d1610491ba481e80f3e8cccfea3aa1 and project de5ebe21fe434bc3ad5ab4354c52fcdb. Resources: {'cores', 'ram', 'instances'} {{(pid=120532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 16:25:04.753434 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-c1b048fd-4b9a-48c9-93bc-361ee5c75a78 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Going to run 1 instances... {{(pid=120532) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 16:25:04.761985 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-c1b048fd-4b9a-48c9-93bc-361ee5c75a78 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] [instance: a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='600db436-ed6c-41b7-89f7-7dd31852a1a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120532) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 16:25:04.818159 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-c1b048fd-4b9a-48c9-93bc-361ee5c75a78 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.433625 Sep 21 16:25:04.818869 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 120/222] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Sep 21 16:25:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 21 16:25:04.824576 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ffda1b44-e0f5-457e-b6ab-7c6fdea6a700 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:04.827519 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ffda1b44-e0f5-457e-b6ab-7c6fdea6a700 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 675b6625-928e-45e6-bb51-f9a0bdfe117e] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:04.907156 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ffda1b44-e0f5-457e-b6ab-7c6fdea6a700 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:04.918226 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ffda1b44-e0f5-457e-b6ab-7c6fdea6a700 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e" status: 200 len: 1213 microversion: 2.1 time: 0.097526 Sep 21 16:25:04.918981 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 121/223] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:04 2022] GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e => generated 1213 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:04.926333 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-7fac96e4-617e-4926-8380-993ebc10ad67 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:04.927106 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-7fac96e4-617e-4926-8380-993ebc10ad67 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] [instance: a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:04.998014 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-7fac96e4-617e-4926-8380-993ebc10ad67 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d1610491ba481e80f3e8cccfea3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5ebe21fe434bc3ad5ab4354c52fcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:05.010585 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-7fac96e4-617e-4926-8380-993ebc10ad67 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] 10.222.0.64 "GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319" status: 200 len: 1215 microversion: 2.1 time: 0.088947 Sep 21 16:25:05.023707 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 122/224] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:04 2022] GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 => generated 1215 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:05.324269 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-682589a6-5b21-4e82-9b1b-bc45f86fbd1f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:05.338785 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-682589a6-5b21-4e82-9b1b-bc45f86fbd1f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 200 len: 1522 microversion: 2.1 time: 0.643846 Sep 21 16:25:05.339719 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 103/225] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:04 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 1522 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:05.849208 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-62bdc85f-2816-4012-8a45-ce83c15637c7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:25:05.849828 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-62bdc85f-2816-4012-8a45-ce83c15637c7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:05.857267 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-62bdc85f-2816-4012-8a45-ce83c15637c7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:05.857883 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-62bdc85f-2816-4012-8a45-ce83c15637c7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:05.858417 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-62bdc85f-2816-4012-8a45-ce83c15637c7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:05.859147 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-62bdc85f-2816-4012-8a45-ce83c15637c7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:05.859803 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-62bdc85f-2816-4012-8a45-ce83c15637c7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:05.860239 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-62bdc85f-2816-4012-8a45-ce83c15637c7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:05.886272 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.objects.instance [None req-62bdc85f-2816-4012-8a45-ce83c15637c7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lazy-loading 'flavor' on Instance uuid 5f563aac-6055-4b77-b3bb-894ed14c1f64 {{(pid=120532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 16:25:05.941731 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-f8b07984-960e-4f42-ab52-c3df754abe8e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:05.942456 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-f8b07984-960e-4f42-ab52-c3df754abe8e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 675b6625-928e-45e6-bb51-f9a0bdfe117e] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:05.951077 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f8b07984-960e-4f42-ab52-c3df754abe8e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:05.951872 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f8b07984-960e-4f42-ab52-c3df754abe8e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:05.952512 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f8b07984-960e-4f42-ab52-c3df754abe8e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:05.953799 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f8b07984-960e-4f42-ab52-c3df754abe8e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:05.954454 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f8b07984-960e-4f42-ab52-c3df754abe8e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:05.955246 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f8b07984-960e-4f42-ab52-c3df754abe8e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:06.090986 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-f8b07984-960e-4f42-ab52-c3df754abe8e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:06.104460 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-f8b07984-960e-4f42-ab52-c3df754abe8e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e" status: 200 len: 1265 microversion: 2.1 time: 0.166202 Sep 21 16:25:06.105102 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 104/226] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:05 2022] GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:06.111910 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-9c2a77c0-73cc-4908-aa3f-b3b8b71d80ce tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:06.112820 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-9c2a77c0-73cc-4908-aa3f-b3b8b71d80ce tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] [instance: a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:06.120808 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9c2a77c0-73cc-4908-aa3f-b3b8b71d80ce tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:06.121728 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9c2a77c0-73cc-4908-aa3f-b3b8b71d80ce tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:06.122549 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9c2a77c0-73cc-4908-aa3f-b3b8b71d80ce tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:06.123593 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9c2a77c0-73cc-4908-aa3f-b3b8b71d80ce tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:06.124340 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9c2a77c0-73cc-4908-aa3f-b3b8b71d80ce tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:06.125053 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9c2a77c0-73cc-4908-aa3f-b3b8b71d80ce tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:06.230987 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-9c2a77c0-73cc-4908-aa3f-b3b8b71d80ce tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d1610491ba481e80f3e8cccfea3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5ebe21fe434bc3ad5ab4354c52fcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:06.243012 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-9c2a77c0-73cc-4908-aa3f-b3b8b71d80ce tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] 10.222.0.64 "GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319" status: 200 len: 1211 microversion: 2.1 time: 0.134922 Sep 21 16:25:06.243782 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 105/227] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:06 2022] GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 => generated 1211 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:06.298979 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-62bdc85f-2816-4012-8a45-ce83c15637c7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "POST /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64/action" status: 202 len: 0 microversion: 2.20 time: 0.452841 Sep 21 16:25:06.300194 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 123/228] 10.222.0.64 () {62 vars in 1319 bytes} [Wed Sep 21 16:25:05 2022] POST /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 21 16:25:06.318188 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-09435e85-f962-4a33-8eba-35825c757e84 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:06.319388 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-09435e85-f962-4a33-8eba-35825c757e84 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:06.330324 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-09435e85-f962-4a33-8eba-35825c757e84 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:06.331081 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-09435e85-f962-4a33-8eba-35825c757e84 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:06.331794 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-09435e85-f962-4a33-8eba-35825c757e84 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:06.333358 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-09435e85-f962-4a33-8eba-35825c757e84 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:06.334340 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-09435e85-f962-4a33-8eba-35825c757e84 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:06.334891 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-09435e85-f962-4a33-8eba-35825c757e84 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:06.367113 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-366c7740-3dfd-47fc-b83d-600ef05d5960 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:06.368124 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-366c7740-3dfd-47fc-b83d-600ef05d5960 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:06.402948 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-366c7740-3dfd-47fc-b83d-600ef05d5960 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:06.403773 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-366c7740-3dfd-47fc-b83d-600ef05d5960 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:06.404510 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-366c7740-3dfd-47fc-b83d-600ef05d5960 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:06.405977 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-366c7740-3dfd-47fc-b83d-600ef05d5960 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:06.406777 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-366c7740-3dfd-47fc-b83d-600ef05d5960 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:06.407498 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-366c7740-3dfd-47fc-b83d-600ef05d5960 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:06.567412 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-09435e85-f962-4a33-8eba-35825c757e84 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:06.585172 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-09435e85-f962-4a33-8eba-35825c757e84 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:06.588222 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-09435e85-f962-4a33-8eba-35825c757e84 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:06.590645 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-09435e85-f962-4a33-8eba-35825c757e84 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1724 microversion: 2.20 time: 0.279293 Sep 21 16:25:06.591969 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 106/229] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:25:06 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1724 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:25:06.616852 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-366c7740-3dfd-47fc-b83d-600ef05d5960 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:06.629293 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-366c7740-3dfd-47fc-b83d-600ef05d5960 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 200 len: 1522 microversion: 2.1 time: 0.267795 Sep 21 16:25:06.629899 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 124/230] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:06 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:25:06.950811 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-f88ce136-55ac-4efe-ae37-bbbe7aeedf81 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:06.951948 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-f88ce136-55ac-4efe-ae37-bbbe7aeedf81 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:06.960719 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f88ce136-55ac-4efe-ae37-bbbe7aeedf81 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:06.961598 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f88ce136-55ac-4efe-ae37-bbbe7aeedf81 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:06.962208 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f88ce136-55ac-4efe-ae37-bbbe7aeedf81 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:06.963336 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f88ce136-55ac-4efe-ae37-bbbe7aeedf81 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:06.963813 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f88ce136-55ac-4efe-ae37-bbbe7aeedf81 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:06.964418 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f88ce136-55ac-4efe-ae37-bbbe7aeedf81 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:06.996320 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-f88ce136-55ac-4efe-ae37-bbbe7aeedf81 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021/ips" status: 200 len: 145 microversion: 2.1 time: 0.052106 Sep 21 16:25:06.997448 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 107/231] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Sep 21 16:25:06 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021/ips => generated 145 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:25:07.157961 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c4970bcb-8c69-472d-9e97-2b2dfdfed73f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:07.158887 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-c4970bcb-8c69-472d-9e97-2b2dfdfed73f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 675b6625-928e-45e6-bb51-f9a0bdfe117e] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:07.161173 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:07.178110 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c4970bcb-8c69-472d-9e97-2b2dfdfed73f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:07.178762 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c4970bcb-8c69-472d-9e97-2b2dfdfed73f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:07.179104 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c4970bcb-8c69-472d-9e97-2b2dfdfed73f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:07.179842 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c4970bcb-8c69-472d-9e97-2b2dfdfed73f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:07.180611 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c4970bcb-8c69-472d-9e97-2b2dfdfed73f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:07.181060 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c4970bcb-8c69-472d-9e97-2b2dfdfed73f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:07.277671 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-c4970bcb-8c69-472d-9e97-2b2dfdfed73f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:07.291251 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-c4970bcb-8c69-472d-9e97-2b2dfdfed73f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e" status: 200 len: 1283 microversion: 2.1 time: 0.138538 Sep 21 16:25:07.292376 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 125/232] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:07 2022] GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e => generated 1283 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:07.300214 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-08b77403-bacb-4178-b68e-1d51ca9cbb8c tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:07.301319 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-08b77403-bacb-4178-b68e-1d51ca9cbb8c tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] [instance: a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:07.316875 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-08b77403-bacb-4178-b68e-1d51ca9cbb8c tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:07.319341 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-08b77403-bacb-4178-b68e-1d51ca9cbb8c tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:07.320241 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-08b77403-bacb-4178-b68e-1d51ca9cbb8c tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:07.321305 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-08b77403-bacb-4178-b68e-1d51ca9cbb8c tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:07.322133 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-08b77403-bacb-4178-b68e-1d51ca9cbb8c tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:07.322954 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-08b77403-bacb-4178-b68e-1d51ca9cbb8c tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:07.448266 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-08b77403-bacb-4178-b68e-1d51ca9cbb8c tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d1610491ba481e80f3e8cccfea3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5ebe21fe434bc3ad5ab4354c52fcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:07.471763 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-08b77403-bacb-4178-b68e-1d51ca9cbb8c tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] 10.222.0.64 "GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319" status: 200 len: 1211 microversion: 2.1 time: 0.191537 Sep 21 16:25:07.473202 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 108/233] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:07 2022] GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 => generated 1211 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:07.640535 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-434d8c03-6de8-48b4-8536-e305db8f2c29 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:07.641522 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-434d8c03-6de8-48b4-8536-e305db8f2c29 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:07.656582 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-25b3715d-c3fa-4c85-beb7-bc5b080631a8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:07.657575 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-25b3715d-c3fa-4c85-beb7-bc5b080631a8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:07.670286 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-434d8c03-6de8-48b4-8536-e305db8f2c29 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:07.674423 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-434d8c03-6de8-48b4-8536-e305db8f2c29 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:07.675866 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-434d8c03-6de8-48b4-8536-e305db8f2c29 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:07.677184 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-434d8c03-6de8-48b4-8536-e305db8f2c29 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:07.682322 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-25b3715d-c3fa-4c85-beb7-bc5b080631a8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:07.683049 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-434d8c03-6de8-48b4-8536-e305db8f2c29 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:07.683954 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-434d8c03-6de8-48b4-8536-e305db8f2c29 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:07.684219 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-25b3715d-c3fa-4c85-beb7-bc5b080631a8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:07.685418 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-25b3715d-c3fa-4c85-beb7-bc5b080631a8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:07.687185 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-25b3715d-c3fa-4c85-beb7-bc5b080631a8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:07.688460 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-25b3715d-c3fa-4c85-beb7-bc5b080631a8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:07.689303 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-25b3715d-c3fa-4c85-beb7-bc5b080631a8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:07.939046 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-434d8c03-6de8-48b4-8536-e305db8f2c29 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:07.953391 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-434d8c03-6de8-48b4-8536-e305db8f2c29 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:07.957348 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-434d8c03-6de8-48b4-8536-e305db8f2c29 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:07.960356 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-434d8c03-6de8-48b4-8536-e305db8f2c29 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1724 microversion: 2.20 time: 0.328090 Sep 21 16:25:07.963177 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 126/234] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:25:07 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1724 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:25:07.978084 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-25b3715d-c3fa-4c85-beb7-bc5b080631a8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:07.991424 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-25b3715d-c3fa-4c85-beb7-bc5b080631a8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 200 len: 1522 microversion: 2.1 time: 0.336904 Sep 21 16:25:07.993003 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 109/235] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:07 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 1522 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:25:08.321769 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-349b0551-21ab-43cc-9b2d-0401741848be tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:08.327154 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-349b0551-21ab-43cc-9b2d-0401741848be tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 675b6625-928e-45e6-bb51-f9a0bdfe117e] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:08.349796 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-349b0551-21ab-43cc-9b2d-0401741848be tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:08.350637 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-349b0551-21ab-43cc-9b2d-0401741848be tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:08.351290 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-349b0551-21ab-43cc-9b2d-0401741848be tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:08.363756 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-349b0551-21ab-43cc-9b2d-0401741848be tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:08.364257 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-349b0551-21ab-43cc-9b2d-0401741848be tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:08.364928 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-349b0551-21ab-43cc-9b2d-0401741848be tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:08.513757 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-7c317a18-721a-426f-80c6-e95b02187a3c tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:08.515496 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-7c317a18-721a-426f-80c6-e95b02187a3c tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] [instance: a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:08.529725 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7c317a18-721a-426f-80c6-e95b02187a3c tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:08.531629 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7c317a18-721a-426f-80c6-e95b02187a3c tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:08.532518 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7c317a18-721a-426f-80c6-e95b02187a3c tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:08.533950 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7c317a18-721a-426f-80c6-e95b02187a3c tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:08.535455 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7c317a18-721a-426f-80c6-e95b02187a3c tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:08.536583 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7c317a18-721a-426f-80c6-e95b02187a3c tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:08.682213 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-349b0551-21ab-43cc-9b2d-0401741848be tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:08.706707 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-349b0551-21ab-43cc-9b2d-0401741848be tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e" status: 200 len: 1313 microversion: 2.1 time: 0.393856 Sep 21 16:25:08.707939 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 127/236] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:08 2022] GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e => generated 1313 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:08.771324 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-7c317a18-721a-426f-80c6-e95b02187a3c tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d1610491ba481e80f3e8cccfea3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5ebe21fe434bc3ad5ab4354c52fcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:08.795089 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-7c317a18-721a-426f-80c6-e95b02187a3c tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] 10.222.0.64 "GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319" status: 200 len: 1267 microversion: 2.1 time: 0.297901 Sep 21 16:25:08.795850 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 110/237] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:08 2022] GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 => generated 1267 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:09.009908 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-7da5d8a9-6d07-4296-9176-b0df2cff5c66 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:09.013638 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-7da5d8a9-6d07-4296-9176-b0df2cff5c66 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:09.043225 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-05d824cd-afb3-4b54-8c10-c62889b37dcc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:09.045012 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7da5d8a9-6d07-4296-9176-b0df2cff5c66 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:09.046523 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7da5d8a9-6d07-4296-9176-b0df2cff5c66 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:09.047602 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7da5d8a9-6d07-4296-9176-b0df2cff5c66 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:09.049329 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7da5d8a9-6d07-4296-9176-b0df2cff5c66 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:09.050798 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7da5d8a9-6d07-4296-9176-b0df2cff5c66 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:09.051946 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7da5d8a9-6d07-4296-9176-b0df2cff5c66 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:09.052788 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-05d824cd-afb3-4b54-8c10-c62889b37dcc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:09.081255 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-05d824cd-afb3-4b54-8c10-c62889b37dcc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:09.087753 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-05d824cd-afb3-4b54-8c10-c62889b37dcc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:09.088470 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-05d824cd-afb3-4b54-8c10-c62889b37dcc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:09.089427 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-05d824cd-afb3-4b54-8c10-c62889b37dcc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:09.094994 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-05d824cd-afb3-4b54-8c10-c62889b37dcc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:09.094994 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-05d824cd-afb3-4b54-8c10-c62889b37dcc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:09.358555 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-7da5d8a9-6d07-4296-9176-b0df2cff5c66 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:09.373060 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-7da5d8a9-6d07-4296-9176-b0df2cff5c66 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:09.374688 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-7da5d8a9-6d07-4296-9176-b0df2cff5c66 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:09.376239 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-7da5d8a9-6d07-4296-9176-b0df2cff5c66 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1724 microversion: 2.20 time: 0.380540 Sep 21 16:25:09.377048 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 128/238] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:25:08 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1724 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:25:09.738519 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-3b71ef8e-21aa-493e-a328-b53ef371d0d2 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:09.740066 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-3b71ef8e-21aa-493e-a328-b53ef371d0d2 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 675b6625-928e-45e6-bb51-f9a0bdfe117e] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:09.761196 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3b71ef8e-21aa-493e-a328-b53ef371d0d2 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:09.762789 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3b71ef8e-21aa-493e-a328-b53ef371d0d2 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:09.764122 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3b71ef8e-21aa-493e-a328-b53ef371d0d2 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:09.766426 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3b71ef8e-21aa-493e-a328-b53ef371d0d2 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:09.767573 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3b71ef8e-21aa-493e-a328-b53ef371d0d2 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:09.768550 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3b71ef8e-21aa-493e-a328-b53ef371d0d2 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:09.837487 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-05d824cd-afb3-4b54-8c10-c62889b37dcc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:09.877875 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-05d824cd-afb3-4b54-8c10-c62889b37dcc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 200 len: 1522 microversion: 2.1 time: 0.843937 Sep 21 16:25:09.881462 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 111/239] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:09 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 1522 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:09.908091 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-2fa99bf2-de5e-48a5-a20c-f08b4a0a849a tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:09.910526 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-2fa99bf2-de5e-48a5-a20c-f08b4a0a849a tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] [instance: a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:09.943824 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2fa99bf2-de5e-48a5-a20c-f08b4a0a849a tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:09.947815 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2fa99bf2-de5e-48a5-a20c-f08b4a0a849a tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:09.948351 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2fa99bf2-de5e-48a5-a20c-f08b4a0a849a tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:09.954911 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2fa99bf2-de5e-48a5-a20c-f08b4a0a849a tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:09.956036 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2fa99bf2-de5e-48a5-a20c-f08b4a0a849a tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:09.957643 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2fa99bf2-de5e-48a5-a20c-f08b4a0a849a tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:10.116540 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-2fa99bf2-de5e-48a5-a20c-f08b4a0a849a tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d1610491ba481e80f3e8cccfea3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5ebe21fe434bc3ad5ab4354c52fcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:10.130364 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-2fa99bf2-de5e-48a5-a20c-f08b4a0a849a tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] 10.222.0.64 "GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319" status: 200 len: 1273 microversion: 2.1 time: 0.245397 Sep 21 16:25:10.132338 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 112/240] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:09 2022] GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 => generated 1273 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:10.167873 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-3b71ef8e-21aa-493e-a328-b53ef371d0d2 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:10.186946 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-3b71ef8e-21aa-493e-a328-b53ef371d0d2 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e" status: 200 len: 1313 microversion: 2.1 time: 0.457430 Sep 21 16:25:10.188499 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 129/241] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:09 2022] GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e => generated 1313 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:25:10.389586 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-d3f91b90-f804-42ac-b5aa-79812f684d13 req-233a9982-57b2-4bb9-b924-6380bfae60b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "675b6625-928e-45e6-bb51-f9a0bdfe117e", "tag": "4915c1ab-5710-4fee-b455-12531022f6aa"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:25:10.407306 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-988d6eeb-a1cd-462f-bf6d-f22594f2e606 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:10.408622 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-988d6eeb-a1cd-462f-bf6d-f22594f2e606 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:10.421378 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-988d6eeb-a1cd-462f-bf6d-f22594f2e606 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:10.428182 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-d3f91b90-f804-42ac-b5aa-79812f684d13 req-233a9982-57b2-4bb9-b924-6380bfae60b2 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:10.430970 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-d3f91b90-f804-42ac-b5aa-79812f684d13 req-233a9982-57b2-4bb9-b924-6380bfae60b2 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:10.431839 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-d3f91b90-f804-42ac-b5aa-79812f684d13 req-233a9982-57b2-4bb9-b924-6380bfae60b2 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:10.433411 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-988d6eeb-a1cd-462f-bf6d-f22594f2e606 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:10.438272 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-988d6eeb-a1cd-462f-bf6d-f22594f2e606 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:10.443819 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-988d6eeb-a1cd-462f-bf6d-f22594f2e606 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:10.444804 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-988d6eeb-a1cd-462f-bf6d-f22594f2e606 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:10.453304 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-988d6eeb-a1cd-462f-bf6d-f22594f2e606 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:10.465017 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:10.491148 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-d3f91b90-f804-42ac-b5aa-79812f684d13 req-233a9982-57b2-4bb9-b924-6380bfae60b2 service nova] Creating event network-changed:4915c1ab-5710-4fee-b455-12531022f6aa for instance 675b6625-928e-45e6-bb51-f9a0bdfe117e on hv-cinder-85862 Sep 21 16:25:10.508818 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-d3f91b90-f804-42ac-b5aa-79812f684d13 req-233a9982-57b2-4bb9-b924-6380bfae60b2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123177 Sep 21 16:25:10.509829 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 113/242] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:25:10.671103 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-988d6eeb-a1cd-462f-bf6d-f22594f2e606 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:10.680778 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-988d6eeb-a1cd-462f-bf6d-f22594f2e606 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:10.682853 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-988d6eeb-a1cd-462f-bf6d-f22594f2e606 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:10.684218 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-988d6eeb-a1cd-462f-bf6d-f22594f2e606 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1724 microversion: 2.20 time: 0.284450 Sep 21 16:25:10.684939 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 130/243] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:25:10 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1724 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:25:10.933255 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-1bbb64a9-809a-4046-aa4d-3b326e9def88 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:10.933996 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-1bbb64a9-809a-4046-aa4d-3b326e9def88 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:10.940438 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:10.943558 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1bbb64a9-809a-4046-aa4d-3b326e9def88 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:10.944296 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1bbb64a9-809a-4046-aa4d-3b326e9def88 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:10.945063 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1bbb64a9-809a-4046-aa4d-3b326e9def88 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:10.945946 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1bbb64a9-809a-4046-aa4d-3b326e9def88 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:10.946482 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1bbb64a9-809a-4046-aa4d-3b326e9def88 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:10.946993 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1bbb64a9-809a-4046-aa4d-3b326e9def88 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:10.954516 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:11.172052 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-3d614701-2501-4358-aa2b-806d37038f51 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:11.173123 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-3d614701-2501-4358-aa2b-806d37038f51 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] [instance: a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:11.186261 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3d614701-2501-4358-aa2b-806d37038f51 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:11.187460 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3d614701-2501-4358-aa2b-806d37038f51 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:11.188562 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3d614701-2501-4358-aa2b-806d37038f51 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:11.190329 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3d614701-2501-4358-aa2b-806d37038f51 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:11.195100 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3d614701-2501-4358-aa2b-806d37038f51 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:11.196328 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3d614701-2501-4358-aa2b-806d37038f51 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:11.301765 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-3d614701-2501-4358-aa2b-806d37038f51 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d1610491ba481e80f3e8cccfea3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5ebe21fe434bc3ad5ab4354c52fcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:11.311547 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-3d614701-2501-4358-aa2b-806d37038f51 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] 10.222.0.64 "GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319" status: 200 len: 1273 microversion: 2.1 time: 0.151700 Sep 21 16:25:11.312262 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 131/244] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:11 2022] GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 => generated 1273 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:11.319790 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-701d173f-1aaa-4a68-82c8-41ae69dc639c tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:11.320765 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-701d173f-1aaa-4a68-82c8-41ae69dc639c tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 675b6625-928e-45e6-bb51-f9a0bdfe117e] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:11.328656 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-701d173f-1aaa-4a68-82c8-41ae69dc639c tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:11.330263 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-701d173f-1aaa-4a68-82c8-41ae69dc639c tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:11.331018 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-701d173f-1aaa-4a68-82c8-41ae69dc639c tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:11.332097 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-701d173f-1aaa-4a68-82c8-41ae69dc639c tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:11.334759 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-701d173f-1aaa-4a68-82c8-41ae69dc639c tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:11.335537 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-701d173f-1aaa-4a68-82c8-41ae69dc639c tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:11.616526 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-1bbb64a9-809a-4046-aa4d-3b326e9def88 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:11.617375 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-701d173f-1aaa-4a68-82c8-41ae69dc639c tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:11.628822 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-1bbb64a9-809a-4046-aa4d-3b326e9def88 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 200 len: 1522 microversion: 2.1 time: 0.700449 Sep 21 16:25:11.629698 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 114/245] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:10 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 1522 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:11.633949 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-701d173f-1aaa-4a68-82c8-41ae69dc639c tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e" status: 200 len: 1313 microversion: 2.1 time: 0.320300 Sep 21 16:25:11.635677 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-e308d020-9acb-4aa2-81c5-134b7a6dffcc tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4258fd83-4b8c-4a03-aa95-28011ca4364f"}} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:25:11.638641 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-e308d020-9acb-4aa2-81c5-134b7a6dffcc tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:11.638920 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 132/246] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:11 2022] GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e => generated 1313 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:11.646555 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e308d020-9acb-4aa2-81c5-134b7a6dffcc tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:11.647376 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e308d020-9acb-4aa2-81c5-134b7a6dffcc tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:11.647939 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e308d020-9acb-4aa2-81c5-134b7a6dffcc tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:11.648758 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e308d020-9acb-4aa2-81c5-134b7a6dffcc tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:11.649332 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e308d020-9acb-4aa2-81c5-134b7a6dffcc tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:11.649973 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e308d020-9acb-4aa2-81c5-134b7a6dffcc tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:11.711251 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-6891bff2-36bb-4c65-a41c-c5eb060073b6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:11.712324 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-6891bff2-36bb-4c65-a41c-c5eb060073b6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:11.719084 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6891bff2-36bb-4c65-a41c-c5eb060073b6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:11.719803 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6891bff2-36bb-4c65-a41c-c5eb060073b6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:11.720712 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6891bff2-36bb-4c65-a41c-c5eb060073b6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:11.721455 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6891bff2-36bb-4c65-a41c-c5eb060073b6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:11.722300 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6891bff2-36bb-4c65-a41c-c5eb060073b6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:11.723161 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6891bff2-36bb-4c65-a41c-c5eb060073b6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:11.920989 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-6891bff2-36bb-4c65-a41c-c5eb060073b6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:11.932047 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-6891bff2-36bb-4c65-a41c-c5eb060073b6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:11.934114 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-6891bff2-36bb-4c65-a41c-c5eb060073b6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:11.935366 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-6891bff2-36bb-4c65-a41c-c5eb060073b6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1724 microversion: 2.20 time: 0.229305 Sep 21 16:25:11.935995 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 133/247] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:25:11 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 16:25:12.165153 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-a5302cb8-ee89-4b52-bbc8-7c0802608d41 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:12.165648 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-a5302cb8-ee89-4b52-bbc8-7c0802608d41 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:12.171850 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a5302cb8-ee89-4b52-bbc8-7c0802608d41 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:12.172336 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a5302cb8-ee89-4b52-bbc8-7c0802608d41 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:12.172764 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a5302cb8-ee89-4b52-bbc8-7c0802608d41 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:12.173462 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a5302cb8-ee89-4b52-bbc8-7c0802608d41 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:12.173912 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a5302cb8-ee89-4b52-bbc8-7c0802608d41 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:12.174354 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a5302cb8-ee89-4b52-bbc8-7c0802608d41 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:12.203793 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-a5302cb8-ee89-4b52-bbc8-7c0802608d41 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77/ips" status: 200 len: 149 microversion: 2.1 time: 0.042230 Sep 21 16:25:12.204256 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 134/248] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Sep 21 16:25:12 2022] GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:25:12.346142 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-69327fcb-1ac0-4253-a9ea-d06f448e942c tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:12.346772 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-69327fcb-1ac0-4253-a9ea-d06f448e942c tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] [instance: a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:12.355084 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-69327fcb-1ac0-4253-a9ea-d06f448e942c tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:12.355784 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-69327fcb-1ac0-4253-a9ea-d06f448e942c tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:12.356658 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-69327fcb-1ac0-4253-a9ea-d06f448e942c tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:12.357459 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-69327fcb-1ac0-4253-a9ea-d06f448e942c tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:12.358283 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-69327fcb-1ac0-4253-a9ea-d06f448e942c tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:12.358661 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-69327fcb-1ac0-4253-a9ea-d06f448e942c tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:12.578985 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-69327fcb-1ac0-4253-a9ea-d06f448e942c tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d1610491ba481e80f3e8cccfea3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5ebe21fe434bc3ad5ab4354c52fcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:12.588243 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-69327fcb-1ac0-4253-a9ea-d06f448e942c tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] 10.222.0.64 "GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319" status: 200 len: 1315 microversion: 2.1 time: 0.245859 Sep 21 16:25:12.588863 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 135/249] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:12 2022] GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:25:12.667066 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-b5bd7268-602a-44fe-9f55-65c7a67c6ae3 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:12.668262 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-b5bd7268-602a-44fe-9f55-65c7a67c6ae3 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 675b6625-928e-45e6-bb51-f9a0bdfe117e] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:12.675137 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b5bd7268-602a-44fe-9f55-65c7a67c6ae3 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:12.676132 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b5bd7268-602a-44fe-9f55-65c7a67c6ae3 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:12.677343 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b5bd7268-602a-44fe-9f55-65c7a67c6ae3 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:12.678514 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b5bd7268-602a-44fe-9f55-65c7a67c6ae3 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:12.679226 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b5bd7268-602a-44fe-9f55-65c7a67c6ae3 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:12.680118 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b5bd7268-602a-44fe-9f55-65c7a67c6ae3 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:12.894356 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-b5bd7268-602a-44fe-9f55-65c7a67c6ae3 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:12.905836 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-b5bd7268-602a-44fe-9f55-65c7a67c6ae3 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e" status: 200 len: 1313 microversion: 2.1 time: 0.243347 Sep 21 16:25:12.910224 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 136/250] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:12 2022] GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:25:12.915148 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-006e0535-1d01-4863-b9ee-f3ef4ed1f790 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:12.916000 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-006e0535-1d01-4863-b9ee-f3ef4ed1f790 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:12.923989 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-006e0535-1d01-4863-b9ee-f3ef4ed1f790 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:12.924627 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-006e0535-1d01-4863-b9ee-f3ef4ed1f790 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:12.925232 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-006e0535-1d01-4863-b9ee-f3ef4ed1f790 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:12.926068 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-006e0535-1d01-4863-b9ee-f3ef4ed1f790 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:12.926715 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-006e0535-1d01-4863-b9ee-f3ef4ed1f790 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:12.927383 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-006e0535-1d01-4863-b9ee-f3ef4ed1f790 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:13.007012 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-e308d020-9acb-4aa2-81c5-134b7a6dffcc tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "POST /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.375335 Sep 21 16:25:13.010077 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 115/251] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Sep 21 16:25:11 2022] POST /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021/os-volume_attachments => generated 194 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:25:13.032626 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-6104bdae-c979-4ae2-9f84-1d5cfb488133 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:13.033480 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-6104bdae-c979-4ae2-9f84-1d5cfb488133 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:13.043185 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6104bdae-c979-4ae2-9f84-1d5cfb488133 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:13.043862 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6104bdae-c979-4ae2-9f84-1d5cfb488133 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:13.044679 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6104bdae-c979-4ae2-9f84-1d5cfb488133 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:13.045505 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6104bdae-c979-4ae2-9f84-1d5cfb488133 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:13.046022 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6104bdae-c979-4ae2-9f84-1d5cfb488133 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:13.046699 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6104bdae-c979-4ae2-9f84-1d5cfb488133 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:13.144392 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-006e0535-1d01-4863-b9ee-f3ef4ed1f790 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:13.166223 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-006e0535-1d01-4863-b9ee-f3ef4ed1f790 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 200 len: 1522 microversion: 2.1 time: 0.257539 Sep 21 16:25:13.167203 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 137/252] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:12 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:13.393515 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-6104bdae-c979-4ae2-9f84-1d5cfb488133 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:13.403628 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-6104bdae-c979-4ae2-9f84-1d5cfb488133 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:13.406246 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-6104bdae-c979-4ae2-9f84-1d5cfb488133 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:13.408008 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-6104bdae-c979-4ae2-9f84-1d5cfb488133 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1724 microversion: 2.20 time: 0.396398 Sep 21 16:25:13.409472 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 116/253] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:25:13 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1724 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:25:13.625628 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-449724ad-6f4c-48ab-b6c7-1644eb5892a7 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:13.631116 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-449724ad-6f4c-48ab-b6c7-1644eb5892a7 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] [instance: a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:13.642931 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-449724ad-6f4c-48ab-b6c7-1644eb5892a7 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:13.646485 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-449724ad-6f4c-48ab-b6c7-1644eb5892a7 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:13.647913 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-449724ad-6f4c-48ab-b6c7-1644eb5892a7 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:13.649747 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-449724ad-6f4c-48ab-b6c7-1644eb5892a7 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:13.651169 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-449724ad-6f4c-48ab-b6c7-1644eb5892a7 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:13.651819 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-449724ad-6f4c-48ab-b6c7-1644eb5892a7 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:13.722644 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-6d87d9e6-3f56-4e77-8404-a4e8c2ab2105 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a08d0ea-25a1-4a2f-9a7a-2e93634c5012"}} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:25:13.726495 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-6d87d9e6-3f56-4e77-8404-a4e8c2ab2105 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:13.735501 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6d87d9e6-3f56-4e77-8404-a4e8c2ab2105 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:13.736715 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6d87d9e6-3f56-4e77-8404-a4e8c2ab2105 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:13.737273 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6d87d9e6-3f56-4e77-8404-a4e8c2ab2105 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:13.738871 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6d87d9e6-3f56-4e77-8404-a4e8c2ab2105 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:13.739371 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6d87d9e6-3f56-4e77-8404-a4e8c2ab2105 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:13.739812 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6d87d9e6-3f56-4e77-8404-a4e8c2ab2105 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:13.852756 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-449724ad-6f4c-48ab-b6c7-1644eb5892a7 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d1610491ba481e80f3e8cccfea3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5ebe21fe434bc3ad5ab4354c52fcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:13.868381 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-449724ad-6f4c-48ab-b6c7-1644eb5892a7 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] 10.222.0.64 "GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319" status: 200 len: 1315 microversion: 2.1 time: 0.250224 Sep 21 16:25:13.869362 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 138/254] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:13 2022] GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:13.915552 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-c277cf41-ddae-43f6-a15c-215fdcd0fc9c req-be894b1d-9348-47da-8fdc-5db19b59c07e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319", "tag": "5c01e8b8-28e9-4871-a0aa-f752eae1c0e4"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:25:13.927894 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-c277cf41-ddae-43f6-a15c-215fdcd0fc9c req-be894b1d-9348-47da-8fdc-5db19b59c07e service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:13.928909 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-c277cf41-ddae-43f6-a15c-215fdcd0fc9c req-be894b1d-9348-47da-8fdc-5db19b59c07e service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:13.929823 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-c277cf41-ddae-43f6-a15c-215fdcd0fc9c req-be894b1d-9348-47da-8fdc-5db19b59c07e service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:13.945876 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-c277cf41-ddae-43f6-a15c-215fdcd0fc9c req-be894b1d-9348-47da-8fdc-5db19b59c07e service nova] Creating event network-changed:5c01e8b8-28e9-4871-a0aa-f752eae1c0e4 for instance a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 on hv-cinder-85862 Sep 21 16:25:13.951748 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-c277cf41-ddae-43f6-a15c-215fdcd0fc9c req-be894b1d-9348-47da-8fdc-5db19b59c07e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040645 Sep 21 16:25:13.952939 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 139/255] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:25:13.958620 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-f1c1c618-c552-48d1-9f4e-ce02173df89f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:13.963364 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-f1c1c618-c552-48d1-9f4e-ce02173df89f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 675b6625-928e-45e6-bb51-f9a0bdfe117e] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:13.966622 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f1c1c618-c552-48d1-9f4e-ce02173df89f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:13.967134 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f1c1c618-c552-48d1-9f4e-ce02173df89f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:13.967575 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f1c1c618-c552-48d1-9f4e-ce02173df89f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:13.968320 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f1c1c618-c552-48d1-9f4e-ce02173df89f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:13.968797 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f1c1c618-c552-48d1-9f4e-ce02173df89f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:13.969232 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f1c1c618-c552-48d1-9f4e-ce02173df89f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:14.123790 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-f1c1c618-c552-48d1-9f4e-ce02173df89f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:14.132593 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-f1c1c618-c552-48d1-9f4e-ce02173df89f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e" status: 200 len: 1313 microversion: 2.1 time: 0.178805 Sep 21 16:25:14.133260 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 140/256] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:13 2022] GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:14.209055 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-f97bfa42-ac45-42ce-9009-8bd2f6b85d4f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:14.209665 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-f97bfa42-ac45-42ce-9009-8bd2f6b85d4f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:14.215976 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f97bfa42-ac45-42ce-9009-8bd2f6b85d4f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:14.216469 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f97bfa42-ac45-42ce-9009-8bd2f6b85d4f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:14.216908 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f97bfa42-ac45-42ce-9009-8bd2f6b85d4f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:14.217619 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f97bfa42-ac45-42ce-9009-8bd2f6b85d4f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:14.218111 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f97bfa42-ac45-42ce-9009-8bd2f6b85d4f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:14.218539 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f97bfa42-ac45-42ce-9009-8bd2f6b85d4f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:14.378985 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-f97bfa42-ac45-42ce-9009-8bd2f6b85d4f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:14.387636 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-f97bfa42-ac45-42ce-9009-8bd2f6b85d4f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 200 len: 1522 microversion: 2.1 time: 0.182455 Sep 21 16:25:14.388239 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 141/257] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:14 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:25:14.437477 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-9b0591d7-8a8c-4018-8ceb-2b49f454165d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:14.438280 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-9b0591d7-8a8c-4018-8ceb-2b49f454165d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:14.445411 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9b0591d7-8a8c-4018-8ceb-2b49f454165d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:14.445910 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9b0591d7-8a8c-4018-8ceb-2b49f454165d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:14.446385 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9b0591d7-8a8c-4018-8ceb-2b49f454165d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:14.447113 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9b0591d7-8a8c-4018-8ceb-2b49f454165d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:14.447579 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9b0591d7-8a8c-4018-8ceb-2b49f454165d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:14.448010 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9b0591d7-8a8c-4018-8ceb-2b49f454165d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:14.590216 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell0:SELECT=2 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:14.617753 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell0:SELECT=6 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:14.623195 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-9b0591d7-8a8c-4018-8ceb-2b49f454165d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:14.632801 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-9b0591d7-8a8c-4018-8ceb-2b49f454165d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:14.634491 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-9b0591d7-8a8c-4018-8ceb-2b49f454165d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:14.635713 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-9b0591d7-8a8c-4018-8ceb-2b49f454165d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1724 microversion: 2.20 time: 0.202567 Sep 21 16:25:14.636293 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 142/258] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:25:14 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 16:25:14.894491 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-2da1c6b6-2fb4-4bd0-a2c0-5c0ca8b8434e tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:14.895502 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-2da1c6b6-2fb4-4bd0-a2c0-5c0ca8b8434e tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] [instance: a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:14.897505 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell0:SELECT=2 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:14.903867 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2da1c6b6-2fb4-4bd0-a2c0-5c0ca8b8434e tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:14.904326 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2da1c6b6-2fb4-4bd0-a2c0-5c0ca8b8434e tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:14.904802 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2da1c6b6-2fb4-4bd0-a2c0-5c0ca8b8434e tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:14.905804 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2da1c6b6-2fb4-4bd0-a2c0-5c0ca8b8434e tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:14.906295 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2da1c6b6-2fb4-4bd0-a2c0-5c0ca8b8434e tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:14.906768 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2da1c6b6-2fb4-4bd0-a2c0-5c0ca8b8434e tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:15.007708 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell0:SELECT=10 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:15.063786 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-2da1c6b6-2fb4-4bd0-a2c0-5c0ca8b8434e tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d1610491ba481e80f3e8cccfea3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5ebe21fe434bc3ad5ab4354c52fcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:15.072119 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-2da1c6b6-2fb4-4bd0-a2c0-5c0ca8b8434e tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] 10.222.0.64 "GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319" status: 200 len: 1315 microversion: 2.1 time: 0.184001 Sep 21 16:25:15.072730 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 143/259] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:14 2022] GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:25:15.160631 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-bf93802f-721a-4570-976c-bd7e68353d9b tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:15.161767 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-bf93802f-721a-4570-976c-bd7e68353d9b tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 675b6625-928e-45e6-bb51-f9a0bdfe117e] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:15.174319 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bf93802f-721a-4570-976c-bd7e68353d9b tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:15.175072 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bf93802f-721a-4570-976c-bd7e68353d9b tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:15.175836 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bf93802f-721a-4570-976c-bd7e68353d9b tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:15.177122 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bf93802f-721a-4570-976c-bd7e68353d9b tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:15.177959 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bf93802f-721a-4570-976c-bd7e68353d9b tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:15.178733 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bf93802f-721a-4570-976c-bd7e68353d9b tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:15.364027 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-bf93802f-721a-4570-976c-bd7e68353d9b tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:15.379577 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-bf93802f-721a-4570-976c-bd7e68353d9b tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e" status: 200 len: 1313 microversion: 2.1 time: 0.226258 Sep 21 16:25:15.380874 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 144/260] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:15 2022] GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:15.415204 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c2cdc828-7ac6-40e5-ae69-889a021e76ef tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:15.415693 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-c2cdc828-7ac6-40e5-ae69-889a021e76ef tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:15.422272 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c2cdc828-7ac6-40e5-ae69-889a021e76ef tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:15.422758 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c2cdc828-7ac6-40e5-ae69-889a021e76ef tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:15.423293 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c2cdc828-7ac6-40e5-ae69-889a021e76ef tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:15.424005 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c2cdc828-7ac6-40e5-ae69-889a021e76ef tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:15.424457 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c2cdc828-7ac6-40e5-ae69-889a021e76ef tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:15.424906 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c2cdc828-7ac6-40e5-ae69-889a021e76ef tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:15.587427 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-c2cdc828-7ac6-40e5-ae69-889a021e76ef tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:15.595912 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-c2cdc828-7ac6-40e5-ae69-889a021e76ef tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 200 len: 1522 microversion: 2.1 time: 0.184667 Sep 21 16:25:15.596573 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 145/261] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:15 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:15.664097 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-e6af036a-a3fe-458b-836a-8d811c3accf2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:15.664788 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-e6af036a-a3fe-458b-836a-8d811c3accf2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:15.672219 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e6af036a-a3fe-458b-836a-8d811c3accf2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:15.672919 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e6af036a-a3fe-458b-836a-8d811c3accf2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:15.673350 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e6af036a-a3fe-458b-836a-8d811c3accf2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:15.674218 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e6af036a-a3fe-458b-836a-8d811c3accf2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:15.675329 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e6af036a-a3fe-458b-836a-8d811c3accf2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:15.675774 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e6af036a-a3fe-458b-836a-8d811c3accf2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:15.819744 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-e6af036a-a3fe-458b-836a-8d811c3accf2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:15.829416 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-e6af036a-a3fe-458b-836a-8d811c3accf2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:15.830914 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-e6af036a-a3fe-458b-836a-8d811c3accf2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:15.832092 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-e6af036a-a3fe-458b-836a-8d811c3accf2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1724 microversion: 2.20 time: 0.173670 Sep 21 16:25:15.832656 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 146/262] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:25:15 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 16:25:16.097698 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-695bec39-f083-4eee-abe2-cd7606a7497d tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:16.098409 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-695bec39-f083-4eee-abe2-cd7606a7497d tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] [instance: a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:16.107452 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-695bec39-f083-4eee-abe2-cd7606a7497d tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:16.107941 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-695bec39-f083-4eee-abe2-cd7606a7497d tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:16.108378 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-695bec39-f083-4eee-abe2-cd7606a7497d tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:16.109098 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-695bec39-f083-4eee-abe2-cd7606a7497d tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:16.109553 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-695bec39-f083-4eee-abe2-cd7606a7497d tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:16.109980 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-695bec39-f083-4eee-abe2-cd7606a7497d tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:16.300841 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-695bec39-f083-4eee-abe2-cd7606a7497d tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d1610491ba481e80f3e8cccfea3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5ebe21fe434bc3ad5ab4354c52fcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:16.303169 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=100 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:16.311082 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-695bec39-f083-4eee-abe2-cd7606a7497d tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] 10.222.0.64 "GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319" status: 200 len: 1315 microversion: 2.1 time: 0.217684 Sep 21 16:25:16.312077 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 147/263] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:16 2022] GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:25:16.377558 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-6d87d9e6-3f56-4e77-8404-a4e8c2ab2105 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "POST /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.660392 Sep 21 16:25:16.378574 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 117/264] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Sep 21 16:25:13 2022] POST /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77/os-volume_attachments => generated 194 bytes in 2662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:25:16.421207 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-e146874c-2db2-4739-8a12-f223e23c88be tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:16.422225 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-e146874c-2db2-4739-8a12-f223e23c88be tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 675b6625-928e-45e6-bb51-f9a0bdfe117e] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:16.431776 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e146874c-2db2-4739-8a12-f223e23c88be tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:16.432680 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e146874c-2db2-4739-8a12-f223e23c88be tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:16.433276 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e146874c-2db2-4739-8a12-f223e23c88be tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:16.434587 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e146874c-2db2-4739-8a12-f223e23c88be tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:16.435236 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e146874c-2db2-4739-8a12-f223e23c88be tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:16.435965 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e146874c-2db2-4739-8a12-f223e23c88be tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:16.618544 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-e146874c-2db2-4739-8a12-f223e23c88be tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:16.628969 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-e146874c-2db2-4739-8a12-f223e23c88be tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e" status: 200 len: 1313 microversion: 2.1 time: 0.213602 Sep 21 16:25:16.630088 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 148/265] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:16 2022] GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:16.631653 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d5c95d50-f752-4b30-9f41-22b268492b0c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:16.633984 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d5c95d50-f752-4b30-9f41-22b268492b0c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:16.652604 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d5c95d50-f752-4b30-9f41-22b268492b0c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:16.654242 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d5c95d50-f752-4b30-9f41-22b268492b0c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:16.655561 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d5c95d50-f752-4b30-9f41-22b268492b0c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:16.656983 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d5c95d50-f752-4b30-9f41-22b268492b0c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:16.657683 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d5c95d50-f752-4b30-9f41-22b268492b0c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:16.658553 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d5c95d50-f752-4b30-9f41-22b268492b0c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:16.857378 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-e0abe93b-0730-4a83-88af-4b1b03d7f4d7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:16.858745 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-e0abe93b-0730-4a83-88af-4b1b03d7f4d7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:16.865931 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e0abe93b-0730-4a83-88af-4b1b03d7f4d7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:16.866497 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e0abe93b-0730-4a83-88af-4b1b03d7f4d7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:16.866932 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e0abe93b-0730-4a83-88af-4b1b03d7f4d7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:16.867664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e0abe93b-0730-4a83-88af-4b1b03d7f4d7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:16.868313 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e0abe93b-0730-4a83-88af-4b1b03d7f4d7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:16.869017 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e0abe93b-0730-4a83-88af-4b1b03d7f4d7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:16.949159 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d5c95d50-f752-4b30-9f41-22b268492b0c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:16.961064 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d5c95d50-f752-4b30-9f41-22b268492b0c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 200 len: 1522 microversion: 2.1 time: 0.342986 Sep 21 16:25:16.962014 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 118/266] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:16 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:17.058237 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-e0abe93b-0730-4a83-88af-4b1b03d7f4d7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:17.071765 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-e0abe93b-0730-4a83-88af-4b1b03d7f4d7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:17.074142 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-e0abe93b-0730-4a83-88af-4b1b03d7f4d7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:17.075875 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-e0abe93b-0730-4a83-88af-4b1b03d7f4d7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1724 microversion: 2.20 time: 0.222381 Sep 21 16:25:17.076866 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 149/267] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:25:16 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 16:25:17.340735 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-f6de5be1-183d-4d15-9291-02461d0353e0 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:17.342247 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-f6de5be1-183d-4d15-9291-02461d0353e0 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] [instance: a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:17.353682 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f6de5be1-183d-4d15-9291-02461d0353e0 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:17.354483 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f6de5be1-183d-4d15-9291-02461d0353e0 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:17.355206 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f6de5be1-183d-4d15-9291-02461d0353e0 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:17.356108 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f6de5be1-183d-4d15-9291-02461d0353e0 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:17.356615 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f6de5be1-183d-4d15-9291-02461d0353e0 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:17.357307 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f6de5be1-183d-4d15-9291-02461d0353e0 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:17.540740 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-f6de5be1-183d-4d15-9291-02461d0353e0 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d1610491ba481e80f3e8cccfea3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5ebe21fe434bc3ad5ab4354c52fcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:17.548603 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-f6de5be1-183d-4d15-9291-02461d0353e0 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] 10.222.0.64 "GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319" status: 200 len: 1315 microversion: 2.1 time: 0.213311 Sep 21 16:25:17.549196 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 119/268] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:17 2022] GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:17.665556 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-4eb02282-0ea2-41a3-816d-a9601afbb90f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:17.666202 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-4eb02282-0ea2-41a3-816d-a9601afbb90f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 675b6625-928e-45e6-bb51-f9a0bdfe117e] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:17.672892 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4eb02282-0ea2-41a3-816d-a9601afbb90f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:17.673381 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4eb02282-0ea2-41a3-816d-a9601afbb90f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:17.673808 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4eb02282-0ea2-41a3-816d-a9601afbb90f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:17.674552 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4eb02282-0ea2-41a3-816d-a9601afbb90f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:17.675559 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4eb02282-0ea2-41a3-816d-a9601afbb90f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:17.675975 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4eb02282-0ea2-41a3-816d-a9601afbb90f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:17.854705 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-4eb02282-0ea2-41a3-816d-a9601afbb90f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:17.864468 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-4eb02282-0ea2-41a3-816d-a9601afbb90f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e" status: 200 len: 1313 microversion: 2.1 time: 0.202825 Sep 21 16:25:17.865076 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 150/269] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:17 2022] GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:17.984975 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-927054f5-02e5-4a3f-a07c-d93ada637819 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:17.985587 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-927054f5-02e5-4a3f-a07c-d93ada637819 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:17.992041 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-927054f5-02e5-4a3f-a07c-d93ada637819 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:17.992522 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-927054f5-02e5-4a3f-a07c-d93ada637819 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:17.992948 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-927054f5-02e5-4a3f-a07c-d93ada637819 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:17.993650 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-927054f5-02e5-4a3f-a07c-d93ada637819 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:17.994130 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-927054f5-02e5-4a3f-a07c-d93ada637819 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:17.994552 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-927054f5-02e5-4a3f-a07c-d93ada637819 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:18.102482 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-27410344-f123-4a11-bcdf-eb5eb19d8f78 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:18.103454 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-27410344-f123-4a11-bcdf-eb5eb19d8f78 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:18.112298 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-27410344-f123-4a11-bcdf-eb5eb19d8f78 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:18.112706 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-27410344-f123-4a11-bcdf-eb5eb19d8f78 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:18.113156 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-27410344-f123-4a11-bcdf-eb5eb19d8f78 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:18.113884 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-27410344-f123-4a11-bcdf-eb5eb19d8f78 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:18.114383 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-27410344-f123-4a11-bcdf-eb5eb19d8f78 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:18.115204 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-27410344-f123-4a11-bcdf-eb5eb19d8f78 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:18.166835 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-927054f5-02e5-4a3f-a07c-d93ada637819 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:18.180444 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-927054f5-02e5-4a3f-a07c-d93ada637819 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 200 len: 1522 microversion: 2.1 time: 0.198980 Sep 21 16:25:18.181299 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 120/270] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:17 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:18.286539 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-27410344-f123-4a11-bcdf-eb5eb19d8f78 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:18.308469 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-27410344-f123-4a11-bcdf-eb5eb19d8f78 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:18.311616 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-27410344-f123-4a11-bcdf-eb5eb19d8f78 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:18.313910 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-27410344-f123-4a11-bcdf-eb5eb19d8f78 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1724 microversion: 2.20 time: 0.215631 Sep 21 16:25:18.315041 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 151/271] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:25:18 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 16:25:18.577151 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-24c2be39-7a50-4bb6-afad-1a574e80a454 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:18.580493 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-24c2be39-7a50-4bb6-afad-1a574e80a454 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] [instance: a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:18.588399 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-24c2be39-7a50-4bb6-afad-1a574e80a454 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:18.589033 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-24c2be39-7a50-4bb6-afad-1a574e80a454 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:18.589542 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-24c2be39-7a50-4bb6-afad-1a574e80a454 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:18.591611 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-24c2be39-7a50-4bb6-afad-1a574e80a454 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:18.591611 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-24c2be39-7a50-4bb6-afad-1a574e80a454 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:18.591611 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-24c2be39-7a50-4bb6-afad-1a574e80a454 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:18.782931 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-24c2be39-7a50-4bb6-afad-1a574e80a454 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d1610491ba481e80f3e8cccfea3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5ebe21fe434bc3ad5ab4354c52fcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:18.793238 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-24c2be39-7a50-4bb6-afad-1a574e80a454 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] 10.222.0.64 "GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319" status: 200 len: 1315 microversion: 2.1 time: 0.220249 Sep 21 16:25:18.794010 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 121/272] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:18 2022] GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:25:18.889132 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-3bb405e2-e2d4-4614-b0be-be38ef4daa24 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:18.889717 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-3bb405e2-e2d4-4614-b0be-be38ef4daa24 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 675b6625-928e-45e6-bb51-f9a0bdfe117e] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:18.896962 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3bb405e2-e2d4-4614-b0be-be38ef4daa24 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:18.897463 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3bb405e2-e2d4-4614-b0be-be38ef4daa24 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:18.897898 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3bb405e2-e2d4-4614-b0be-be38ef4daa24 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:18.898690 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3bb405e2-e2d4-4614-b0be-be38ef4daa24 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:18.899148 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3bb405e2-e2d4-4614-b0be-be38ef4daa24 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:18.899572 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3bb405e2-e2d4-4614-b0be-be38ef4daa24 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:19.046652 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-3bb405e2-e2d4-4614-b0be-be38ef4daa24 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:19.055717 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-3bb405e2-e2d4-4614-b0be-be38ef4daa24 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e" status: 200 len: 1313 microversion: 2.1 time: 0.170685 Sep 21 16:25:19.056319 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 152/273] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:18 2022] GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:25:19.206323 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-314c6c28-cf21-45e1-af06-3e8623e8c3eb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:19.207362 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-314c6c28-cf21-45e1-af06-3e8623e8c3eb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:19.213728 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-314c6c28-cf21-45e1-af06-3e8623e8c3eb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:19.214264 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-314c6c28-cf21-45e1-af06-3e8623e8c3eb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:19.214702 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-314c6c28-cf21-45e1-af06-3e8623e8c3eb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:19.215419 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-314c6c28-cf21-45e1-af06-3e8623e8c3eb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:19.215882 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-314c6c28-cf21-45e1-af06-3e8623e8c3eb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:19.216304 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-314c6c28-cf21-45e1-af06-3e8623e8c3eb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:19.360330 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-d5728ebd-2975-44b1-872d-60ad7bc536ff tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:19.361580 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-d5728ebd-2975-44b1-872d-60ad7bc536ff tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:19.371684 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d5728ebd-2975-44b1-872d-60ad7bc536ff tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:19.372493 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d5728ebd-2975-44b1-872d-60ad7bc536ff tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:19.373436 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d5728ebd-2975-44b1-872d-60ad7bc536ff tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:19.374824 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d5728ebd-2975-44b1-872d-60ad7bc536ff tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:19.375488 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d5728ebd-2975-44b1-872d-60ad7bc536ff tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:19.376168 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d5728ebd-2975-44b1-872d-60ad7bc536ff tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:19.386851 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-314c6c28-cf21-45e1-af06-3e8623e8c3eb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:19.397610 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-314c6c28-cf21-45e1-af06-3e8623e8c3eb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 200 len: 1522 microversion: 2.1 time: 0.195968 Sep 21 16:25:19.398594 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 122/274] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:19 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:19.668996 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d5728ebd-2975-44b1-872d-60ad7bc536ff tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:19.696830 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d5728ebd-2975-44b1-872d-60ad7bc536ff tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:19.700542 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d5728ebd-2975-44b1-872d-60ad7bc536ff tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:19.703066 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-d5728ebd-2975-44b1-872d-60ad7bc536ff tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1724 microversion: 2.20 time: 0.349152 Sep 21 16:25:19.705210 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 153/275] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:25:19 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1724 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:25:19.777351 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-86e01cde-2e80-4719-8931-9b415b7539a5 req-c18b1c1c-5eac-42a9-b058-3ca50146803b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "675b6625-928e-45e6-bb51-f9a0bdfe117e", "name": "network-vif-plugged", "status": "completed", "tag": "4915c1ab-5710-4fee-b455-12531022f6aa"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:25:19.791664 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-86e01cde-2e80-4719-8931-9b415b7539a5 req-c18b1c1c-5eac-42a9-b058-3ca50146803b service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:19.792646 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-86e01cde-2e80-4719-8931-9b415b7539a5 req-c18b1c1c-5eac-42a9-b058-3ca50146803b service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:19.793238 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-86e01cde-2e80-4719-8931-9b415b7539a5 req-c18b1c1c-5eac-42a9-b058-3ca50146803b service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:19.808055 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-86e01cde-2e80-4719-8931-9b415b7539a5 req-c18b1c1c-5eac-42a9-b058-3ca50146803b service nova] Creating event network-vif-plugged:4915c1ab-5710-4fee-b455-12531022f6aa for instance 675b6625-928e-45e6-bb51-f9a0bdfe117e on hv-cinder-85862 Sep 21 16:25:19.823026 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-d118663a-c13d-4aac-a5ce-f534e92510fc tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:19.824041 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-d118663a-c13d-4aac-a5ce-f534e92510fc tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] [instance: a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:19.824232 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-86e01cde-2e80-4719-8931-9b415b7539a5 req-c18b1c1c-5eac-42a9-b058-3ca50146803b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050395 Sep 21 16:25:19.825623 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 123/276] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:25:19.834486 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d118663a-c13d-4aac-a5ce-f534e92510fc tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:19.835604 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d118663a-c13d-4aac-a5ce-f534e92510fc tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:19.836360 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d118663a-c13d-4aac-a5ce-f534e92510fc tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:19.846956 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d118663a-c13d-4aac-a5ce-f534e92510fc tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:19.847815 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d118663a-c13d-4aac-a5ce-f534e92510fc tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:19.849149 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d118663a-c13d-4aac-a5ce-f534e92510fc tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:20.082189 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-2f47fe09-d567-4b6b-a73e-0a09ce1ef986 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:20.083222 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-2f47fe09-d567-4b6b-a73e-0a09ce1ef986 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 675b6625-928e-45e6-bb51-f9a0bdfe117e] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:20.093469 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2f47fe09-d567-4b6b-a73e-0a09ce1ef986 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:20.094293 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2f47fe09-d567-4b6b-a73e-0a09ce1ef986 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:20.094898 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2f47fe09-d567-4b6b-a73e-0a09ce1ef986 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:20.095919 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2f47fe09-d567-4b6b-a73e-0a09ce1ef986 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:20.096604 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2f47fe09-d567-4b6b-a73e-0a09ce1ef986 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:20.097188 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2f47fe09-d567-4b6b-a73e-0a09ce1ef986 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:20.130021 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d118663a-c13d-4aac-a5ce-f534e92510fc tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d1610491ba481e80f3e8cccfea3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5ebe21fe434bc3ad5ab4354c52fcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:20.138767 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-d118663a-c13d-4aac-a5ce-f534e92510fc tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] 10.222.0.64 "GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319" status: 200 len: 1315 microversion: 2.1 time: 0.323783 Sep 21 16:25:20.143419 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 154/277] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:19 2022] GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:20.350901 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-2f47fe09-d567-4b6b-a73e-0a09ce1ef986 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:20.359103 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-2f47fe09-d567-4b6b-a73e-0a09ce1ef986 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e" status: 200 len: 1313 microversion: 2.1 time: 0.283093 Sep 21 16:25:20.359690 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 124/278] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:20 2022] GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:25:20.438338 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-5528b1f9-4b86-415a-b26e-6afa79096fad tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:20.439135 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-5528b1f9-4b86-415a-b26e-6afa79096fad tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:20.450693 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5528b1f9-4b86-415a-b26e-6afa79096fad tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:20.451586 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5528b1f9-4b86-415a-b26e-6afa79096fad tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:20.452377 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5528b1f9-4b86-415a-b26e-6afa79096fad tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:20.453723 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5528b1f9-4b86-415a-b26e-6afa79096fad tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:20.455076 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5528b1f9-4b86-415a-b26e-6afa79096fad tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:20.455889 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5528b1f9-4b86-415a-b26e-6afa79096fad tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:20.632652 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5528b1f9-4b86-415a-b26e-6afa79096fad tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:20.645830 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-5528b1f9-4b86-415a-b26e-6afa79096fad tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 200 len: 1522 microversion: 2.1 time: 0.215536 Sep 21 16:25:20.653732 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 155/279] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:20 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:20.767066 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-7aa52785-4e27-4a0d-91e8-f2464b3e3dcc tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:20.768195 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-7aa52785-4e27-4a0d-91e8-f2464b3e3dcc tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:20.779631 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7aa52785-4e27-4a0d-91e8-f2464b3e3dcc tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:20.780841 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7aa52785-4e27-4a0d-91e8-f2464b3e3dcc tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:20.781797 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7aa52785-4e27-4a0d-91e8-f2464b3e3dcc tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:20.783009 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7aa52785-4e27-4a0d-91e8-f2464b3e3dcc tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:20.784258 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7aa52785-4e27-4a0d-91e8-f2464b3e3dcc tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:20.785198 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7aa52785-4e27-4a0d-91e8-f2464b3e3dcc tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:21.007321 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-7aa52785-4e27-4a0d-91e8-f2464b3e3dcc tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:21.015974 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-7aa52785-4e27-4a0d-91e8-f2464b3e3dcc tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:21.017441 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-7aa52785-4e27-4a0d-91e8-f2464b3e3dcc tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:21.019179 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-7aa52785-4e27-4a0d-91e8-f2464b3e3dcc tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1724 microversion: 2.20 time: 0.259231 Sep 21 16:25:21.020066 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 125/280] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:25:20 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1724 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:25:21.174449 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-6b99b03c-a6a4-4d00-93b3-e7258dc080d5 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:21.175140 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-6b99b03c-a6a4-4d00-93b3-e7258dc080d5 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] [instance: a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:21.186422 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6b99b03c-a6a4-4d00-93b3-e7258dc080d5 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:21.186924 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6b99b03c-a6a4-4d00-93b3-e7258dc080d5 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:21.187363 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6b99b03c-a6a4-4d00-93b3-e7258dc080d5 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:21.188081 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6b99b03c-a6a4-4d00-93b3-e7258dc080d5 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:21.188964 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6b99b03c-a6a4-4d00-93b3-e7258dc080d5 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:21.189404 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6b99b03c-a6a4-4d00-93b3-e7258dc080d5 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:21.389718 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-01df8917-deed-43da-b153-adce5103088f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:21.391204 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-01df8917-deed-43da-b153-adce5103088f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 675b6625-928e-45e6-bb51-f9a0bdfe117e] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:21.401283 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-6b99b03c-a6a4-4d00-93b3-e7258dc080d5 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d1610491ba481e80f3e8cccfea3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5ebe21fe434bc3ad5ab4354c52fcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:21.407219 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-01df8917-deed-43da-b153-adce5103088f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:21.408478 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-01df8917-deed-43da-b153-adce5103088f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:21.409580 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-01df8917-deed-43da-b153-adce5103088f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:21.411188 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-01df8917-deed-43da-b153-adce5103088f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:21.411607 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-6b99b03c-a6a4-4d00-93b3-e7258dc080d5 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] 10.222.0.64 "GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319" status: 200 len: 1315 microversion: 2.1 time: 0.244189 Sep 21 16:25:21.412613 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-01df8917-deed-43da-b153-adce5103088f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:21.413751 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-01df8917-deed-43da-b153-adce5103088f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:21.418550 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 156/281] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:21 2022] GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:21.621823 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-01df8917-deed-43da-b153-adce5103088f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:21.639516 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-01df8917-deed-43da-b153-adce5103088f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e" status: 200 len: 1313 microversion: 2.1 time: 0.256451 Sep 21 16:25:21.641815 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 126/282] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:21 2022] GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:21.693818 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ea1ab192-2a3c-4534-adb6-2d7cac627b61 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:21.695596 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ea1ab192-2a3c-4534-adb6-2d7cac627b61 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:21.707740 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ea1ab192-2a3c-4534-adb6-2d7cac627b61 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:21.708630 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ea1ab192-2a3c-4534-adb6-2d7cac627b61 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:21.709455 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ea1ab192-2a3c-4534-adb6-2d7cac627b61 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:21.711159 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ea1ab192-2a3c-4534-adb6-2d7cac627b61 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:21.711818 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ea1ab192-2a3c-4534-adb6-2d7cac627b61 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:21.712405 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ea1ab192-2a3c-4534-adb6-2d7cac627b61 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:21.849932 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-b2849c19-3fd7-4f71-9e25-5945946e96ee req-9aa72731-da1a-44c3-9480-cd28c72e12c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319", "name": "network-vif-plugged", "status": "completed", "tag": "5c01e8b8-28e9-4871-a0aa-f752eae1c0e4"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:25:21.861593 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-b2849c19-3fd7-4f71-9e25-5945946e96ee req-9aa72731-da1a-44c3-9480-cd28c72e12c0 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:21.862808 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-b2849c19-3fd7-4f71-9e25-5945946e96ee req-9aa72731-da1a-44c3-9480-cd28c72e12c0 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:21.863476 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-b2849c19-3fd7-4f71-9e25-5945946e96ee req-9aa72731-da1a-44c3-9480-cd28c72e12c0 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:21.876838 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-b2849c19-3fd7-4f71-9e25-5945946e96ee req-9aa72731-da1a-44c3-9480-cd28c72e12c0 service nova] Creating event network-vif-plugged:5c01e8b8-28e9-4871-a0aa-f752eae1c0e4 for instance a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 on hv-cinder-85862 Sep 21 16:25:21.882768 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-b2849c19-3fd7-4f71-9e25-5945946e96ee req-9aa72731-da1a-44c3-9480-cd28c72e12c0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038430 Sep 21 16:25:21.884627 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 127/283] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:25:22.060818 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ea1ab192-2a3c-4534-adb6-2d7cac627b61 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:22.071197 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-19016810-2fa7-4840-8f57-bbd70cd53f8a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:22.071991 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-19016810-2fa7-4840-8f57-bbd70cd53f8a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:22.079724 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-19016810-2fa7-4840-8f57-bbd70cd53f8a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:22.080220 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-19016810-2fa7-4840-8f57-bbd70cd53f8a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:22.081548 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-19016810-2fa7-4840-8f57-bbd70cd53f8a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:22.082347 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-19016810-2fa7-4840-8f57-bbd70cd53f8a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:22.082810 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-19016810-2fa7-4840-8f57-bbd70cd53f8a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:22.083178 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ea1ab192-2a3c-4534-adb6-2d7cac627b61 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 200 len: 1522 microversion: 2.1 time: 0.399563 Sep 21 16:25:22.083342 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-19016810-2fa7-4840-8f57-bbd70cd53f8a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:22.085015 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 157/284] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:21 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 1522 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:25:22.351233 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-19016810-2fa7-4840-8f57-bbd70cd53f8a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:22.363165 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-19016810-2fa7-4840-8f57-bbd70cd53f8a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:22.364406 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-19016810-2fa7-4840-8f57-bbd70cd53f8a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:22.365854 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-19016810-2fa7-4840-8f57-bbd70cd53f8a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1724 microversion: 2.20 time: 0.304248 Sep 21 16:25:22.366647 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 128/285] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:25:22 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1724 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 16:25:22.437315 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-f1c34d82-3771-412d-a4a6-c652f63cd33f tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:22.438161 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-f1c34d82-3771-412d-a4a6-c652f63cd33f tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] [instance: a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:22.446111 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f1c34d82-3771-412d-a4a6-c652f63cd33f tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:22.447134 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f1c34d82-3771-412d-a4a6-c652f63cd33f tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:22.447624 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f1c34d82-3771-412d-a4a6-c652f63cd33f tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:22.448481 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f1c34d82-3771-412d-a4a6-c652f63cd33f tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:22.449046 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f1c34d82-3771-412d-a4a6-c652f63cd33f tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:22.449471 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f1c34d82-3771-412d-a4a6-c652f63cd33f tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:22.636399 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-f1c34d82-3771-412d-a4a6-c652f63cd33f tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d1610491ba481e80f3e8cccfea3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5ebe21fe434bc3ad5ab4354c52fcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:22.646119 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-f1c34d82-3771-412d-a4a6-c652f63cd33f tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] 10.222.0.64 "GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319" status: 200 len: 1315 microversion: 2.1 time: 0.213173 Sep 21 16:25:22.658140 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 158/286] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:22 2022] GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:22.680655 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-ee82b202-24e0-4990-80bc-a3b982e892d9 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:22.681455 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-ee82b202-24e0-4990-80bc-a3b982e892d9 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 675b6625-928e-45e6-bb51-f9a0bdfe117e] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:22.692977 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ee82b202-24e0-4990-80bc-a3b982e892d9 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:22.693877 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ee82b202-24e0-4990-80bc-a3b982e892d9 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:22.694735 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ee82b202-24e0-4990-80bc-a3b982e892d9 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:22.696071 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ee82b202-24e0-4990-80bc-a3b982e892d9 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:22.696916 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ee82b202-24e0-4990-80bc-a3b982e892d9 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:22.697694 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ee82b202-24e0-4990-80bc-a3b982e892d9 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:22.725833 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:22.902806 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-ee82b202-24e0-4990-80bc-a3b982e892d9 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:22.914306 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-ee82b202-24e0-4990-80bc-a3b982e892d9 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e" status: 200 len: 1496 microversion: 2.1 time: 0.238432 Sep 21 16:25:22.915235 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 129/287] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:22 2022] GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e => generated 1496 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:25:23.110980 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-9b859f76-de29-4cd6-9469-e84be4e92489 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:23.112619 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-9b859f76-de29-4cd6-9469-e84be4e92489 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:23.120849 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9b859f76-de29-4cd6-9469-e84be4e92489 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:23.121432 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9b859f76-de29-4cd6-9469-e84be4e92489 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:23.122283 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9b859f76-de29-4cd6-9469-e84be4e92489 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:23.123545 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9b859f76-de29-4cd6-9469-e84be4e92489 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:23.124317 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9b859f76-de29-4cd6-9469-e84be4e92489 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:23.124825 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9b859f76-de29-4cd6-9469-e84be4e92489 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:23.407080 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-8ea481b4-b669-4029-a1c7-a8465b2b9e65 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:23.410489 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-8ea481b4-b669-4029-a1c7-a8465b2b9e65 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:23.425485 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8ea481b4-b669-4029-a1c7-a8465b2b9e65 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:23.426231 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8ea481b4-b669-4029-a1c7-a8465b2b9e65 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:23.426952 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8ea481b4-b669-4029-a1c7-a8465b2b9e65 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:23.427943 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8ea481b4-b669-4029-a1c7-a8465b2b9e65 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:23.428657 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8ea481b4-b669-4029-a1c7-a8465b2b9e65 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:23.429160 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8ea481b4-b669-4029-a1c7-a8465b2b9e65 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:23.551743 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-9b859f76-de29-4cd6-9469-e84be4e92489 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:23.588124 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-9b859f76-de29-4cd6-9469-e84be4e92489 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 200 len: 1522 microversion: 2.1 time: 0.481342 Sep 21 16:25:23.589973 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 159/288] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:23 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 1522 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:23.600159 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-1ff2f6b8-b651-40fb-9f0d-054b0d100456 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:23.601567 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-1ff2f6b8-b651-40fb-9f0d-054b0d100456 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 675b6625-928e-45e6-bb51-f9a0bdfe117e] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:23.618776 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1ff2f6b8-b651-40fb-9f0d-054b0d100456 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:23.620011 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1ff2f6b8-b651-40fb-9f0d-054b0d100456 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:23.621040 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1ff2f6b8-b651-40fb-9f0d-054b0d100456 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:23.623164 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1ff2f6b8-b651-40fb-9f0d-054b0d100456 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:23.625021 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1ff2f6b8-b651-40fb-9f0d-054b0d100456 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:23.626414 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1ff2f6b8-b651-40fb-9f0d-054b0d100456 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:23.693822 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-8ea481b4-b669-4029-a1c7-a8465b2b9e65 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:23.694993 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-1ff2f6b8-b651-40fb-9f0d-054b0d100456 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 675b6625-928e-45e6-bb51-f9a0bdfe117e] Going to try to terminate instance {{(pid=120532) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 16:25:23.717593 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-8ea481b4-b669-4029-a1c7-a8465b2b9e65 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:23.723943 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-8ea481b4-b669-4029-a1c7-a8465b2b9e65 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:23.727279 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-8ea481b4-b669-4029-a1c7-a8465b2b9e65 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1745 microversion: 2.20 time: 0.331029 Sep 21 16:25:23.732410 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 130/289] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:25:23 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1745 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:25:23.763279 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-a0a1ff00-85be-4090-a3ea-b765dd51b6c6 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:23.765957 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-a0a1ff00-85be-4090-a3ea-b765dd51b6c6 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] [instance: a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:23.785705 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a0a1ff00-85be-4090-a3ea-b765dd51b6c6 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:23.787140 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a0a1ff00-85be-4090-a3ea-b765dd51b6c6 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:23.789642 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a0a1ff00-85be-4090-a3ea-b765dd51b6c6 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:23.793450 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a0a1ff00-85be-4090-a3ea-b765dd51b6c6 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:23.794656 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a0a1ff00-85be-4090-a3ea-b765dd51b6c6 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:23.796612 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a0a1ff00-85be-4090-a3ea-b765dd51b6c6 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:23.872254 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-1ff2f6b8-b651-40fb-9f0d-054b0d100456 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "DELETE /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e" status: 204 len: 0 microversion: 2.1 time: 0.279574 Sep 21 16:25:23.874076 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 160/290] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Sep 21 16:25:23 2022] DELETE /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 21 16:25:23.907143 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-094883c0-fe39-4224-b5f6-fb96404a7f29 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:23.911256 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-094883c0-fe39-4224-b5f6-fb96404a7f29 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 675b6625-928e-45e6-bb51-f9a0bdfe117e] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:23.925345 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-094883c0-fe39-4224-b5f6-fb96404a7f29 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:23.926034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-094883c0-fe39-4224-b5f6-fb96404a7f29 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:23.926487 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-094883c0-fe39-4224-b5f6-fb96404a7f29 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:23.931371 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-094883c0-fe39-4224-b5f6-fb96404a7f29 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:23.932252 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-094883c0-fe39-4224-b5f6-fb96404a7f29 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:23.932875 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-094883c0-fe39-4224-b5f6-fb96404a7f29 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:24.153439 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-a0a1ff00-85be-4090-a3ea-b765dd51b6c6 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d1610491ba481e80f3e8cccfea3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5ebe21fe434bc3ad5ab4354c52fcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:24.164792 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-a0a1ff00-85be-4090-a3ea-b765dd51b6c6 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] 10.222.0.64 "GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319" status: 200 len: 1315 microversion: 2.1 time: 0.430246 Sep 21 16:25:24.166550 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 131/291] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:23 2022] GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 => generated 1315 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:24.505954 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-094883c0-fe39-4224-b5f6-fb96404a7f29 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:24.523398 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-094883c0-fe39-4224-b5f6-fb96404a7f29 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e" status: 200 len: 1502 microversion: 2.1 time: 0.642525 Sep 21 16:25:24.525171 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 161/292] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:23 2022] GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e => generated 1502 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:25:24.628538 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-7b2c25a6-766e-4bbe-83ee-dd661773309d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:24.629253 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-7b2c25a6-766e-4bbe-83ee-dd661773309d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:24.636075 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7b2c25a6-766e-4bbe-83ee-dd661773309d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:24.636857 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7b2c25a6-766e-4bbe-83ee-dd661773309d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:24.637630 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7b2c25a6-766e-4bbe-83ee-dd661773309d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:24.638546 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7b2c25a6-766e-4bbe-83ee-dd661773309d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:24.639166 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7b2c25a6-766e-4bbe-83ee-dd661773309d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:24.639749 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7b2c25a6-766e-4bbe-83ee-dd661773309d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:24.764950 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-9e5652c8-aa5b-4d3c-ac41-63646bea414f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:24.765649 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-9e5652c8-aa5b-4d3c-ac41-63646bea414f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:24.772607 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9e5652c8-aa5b-4d3c-ac41-63646bea414f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:24.773090 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9e5652c8-aa5b-4d3c-ac41-63646bea414f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:24.773530 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9e5652c8-aa5b-4d3c-ac41-63646bea414f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:24.774649 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9e5652c8-aa5b-4d3c-ac41-63646bea414f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:24.775132 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9e5652c8-aa5b-4d3c-ac41-63646bea414f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:24.775570 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9e5652c8-aa5b-4d3c-ac41-63646bea414f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:24.814439 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-7b2c25a6-766e-4bbe-83ee-dd661773309d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:24.826936 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-7b2c25a6-766e-4bbe-83ee-dd661773309d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 200 len: 1522 microversion: 2.1 time: 0.209144 Sep 21 16:25:24.827721 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 132/293] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:24 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:25.191698 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-f487b168-b54f-48fe-ba2a-a8011552b589 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:25.193157 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-f487b168-b54f-48fe-ba2a-a8011552b589 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] [instance: a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:25.201030 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f487b168-b54f-48fe-ba2a-a8011552b589 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:25.201641 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f487b168-b54f-48fe-ba2a-a8011552b589 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:25.202222 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f487b168-b54f-48fe-ba2a-a8011552b589 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:25.203095 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f487b168-b54f-48fe-ba2a-a8011552b589 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:25.203850 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f487b168-b54f-48fe-ba2a-a8011552b589 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:25.204530 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f487b168-b54f-48fe-ba2a-a8011552b589 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:25.349528 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-9e5652c8-aa5b-4d3c-ac41-63646bea414f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:25.356616 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:25.359685 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-9e5652c8-aa5b-4d3c-ac41-63646bea414f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:25.361171 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-9e5652c8-aa5b-4d3c-ac41-63646bea414f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:25.373854 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-9e5652c8-aa5b-4d3c-ac41-63646bea414f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1745 microversion: 2.20 time: 0.612699 Sep 21 16:25:25.373854 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 162/294] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:25:24 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1745 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 16:25:25.534235 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-f487b168-b54f-48fe-ba2a-a8011552b589 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d1610491ba481e80f3e8cccfea3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5ebe21fe434bc3ad5ab4354c52fcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:25.554029 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-f487b168-b54f-48fe-ba2a-a8011552b589 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] 10.222.0.64 "GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319" status: 200 len: 1315 microversion: 2.1 time: 0.366505 Sep 21 16:25:25.554459 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-881fc1a8-1cad-44a6-8f10-7003fbe4bfe8 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:25.556508 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-881fc1a8-1cad-44a6-8f10-7003fbe4bfe8 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 675b6625-928e-45e6-bb51-f9a0bdfe117e] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:25.558965 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 133/295] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:25 2022] GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 => generated 1315 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:25:25.565435 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-881fc1a8-1cad-44a6-8f10-7003fbe4bfe8 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:25.565949 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-881fc1a8-1cad-44a6-8f10-7003fbe4bfe8 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:25.566386 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-881fc1a8-1cad-44a6-8f10-7003fbe4bfe8 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:25.567088 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-881fc1a8-1cad-44a6-8f10-7003fbe4bfe8 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:25.567525 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-881fc1a8-1cad-44a6-8f10-7003fbe4bfe8 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:25.568128 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-881fc1a8-1cad-44a6-8f10-7003fbe4bfe8 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:25.856777 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-6d01d01f-d666-457e-b82e-bf02bdc23217 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:25.857947 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-6d01d01f-d666-457e-b82e-bf02bdc23217 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:25.868913 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6d01d01f-d666-457e-b82e-bf02bdc23217 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:25.870191 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6d01d01f-d666-457e-b82e-bf02bdc23217 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:25.871228 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6d01d01f-d666-457e-b82e-bf02bdc23217 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:25.872781 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6d01d01f-d666-457e-b82e-bf02bdc23217 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:25.873898 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6d01d01f-d666-457e-b82e-bf02bdc23217 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:25.874928 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6d01d01f-d666-457e-b82e-bf02bdc23217 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:25.999447 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-881fc1a8-1cad-44a6-8f10-7003fbe4bfe8 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:26.015649 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-881fc1a8-1cad-44a6-8f10-7003fbe4bfe8 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e" status: 200 len: 1502 microversion: 2.1 time: 0.466339 Sep 21 16:25:26.030881 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 163/296] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:25 2022] GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e => generated 1502 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:25:26.059149 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-46b4f213-d938-49bd-82bf-3c4e95a2bea4 req-b18052bc-db96-4771-b651-cd647f3554a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f563aac-6055-4b77-b3bb-894ed14c1f64", "name": "network-vif-plugged", "status": "completed", "tag": "252450c8-e7d3-467d-be6e-17b527b01bb8"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:25:26.087096 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-6d01d01f-d666-457e-b82e-bf02bdc23217 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:26.093108 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-46b4f213-d938-49bd-82bf-3c4e95a2bea4 req-b18052bc-db96-4771-b651-cd647f3554a4 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:26.094245 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-46b4f213-d938-49bd-82bf-3c4e95a2bea4 req-b18052bc-db96-4771-b651-cd647f3554a4 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:26.095199 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-46b4f213-d938-49bd-82bf-3c4e95a2bea4 req-b18052bc-db96-4771-b651-cd647f3554a4 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:26.102977 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-6d01d01f-d666-457e-b82e-bf02bdc23217 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 200 len: 1522 microversion: 2.1 time: 0.252333 Sep 21 16:25:26.104191 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 134/297] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:25 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:25:26.129556 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-46b4f213-d938-49bd-82bf-3c4e95a2bea4 req-b18052bc-db96-4771-b651-cd647f3554a4 service nova] Creating event network-vif-plugged:252450c8-e7d3-467d-be6e-17b527b01bb8 for instance 5f563aac-6055-4b77-b3bb-894ed14c1f64 on hv-cinder-85862 Sep 21 16:25:26.149069 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-46b4f213-d938-49bd-82bf-3c4e95a2bea4 req-b18052bc-db96-4771-b651-cd647f3554a4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115396 Sep 21 16:25:26.156239 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 164/298] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:25:26.405466 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-dff0693c-0e48-4538-84f4-ac1de0b81807 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:26.406372 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-dff0693c-0e48-4538-84f4-ac1de0b81807 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:26.479366 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dff0693c-0e48-4538-84f4-ac1de0b81807 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:26.480068 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dff0693c-0e48-4538-84f4-ac1de0b81807 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:26.480533 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dff0693c-0e48-4538-84f4-ac1de0b81807 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:26.490083 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dff0693c-0e48-4538-84f4-ac1de0b81807 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:26.490083 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dff0693c-0e48-4538-84f4-ac1de0b81807 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:26.495854 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dff0693c-0e48-4538-84f4-ac1de0b81807 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:26.601656 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ad0a758f-231c-4062-a6c6-f1cc31c6fc39 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:26.604057 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ad0a758f-231c-4062-a6c6-f1cc31c6fc39 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] [instance: a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:26.615439 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ad0a758f-231c-4062-a6c6-f1cc31c6fc39 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:26.616640 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ad0a758f-231c-4062-a6c6-f1cc31c6fc39 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:26.631733 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ad0a758f-231c-4062-a6c6-f1cc31c6fc39 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:26.631733 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ad0a758f-231c-4062-a6c6-f1cc31c6fc39 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:26.631733 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ad0a758f-231c-4062-a6c6-f1cc31c6fc39 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:26.631733 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ad0a758f-231c-4062-a6c6-f1cc31c6fc39 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:26.872686 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-dff0693c-0e48-4538-84f4-ac1de0b81807 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:26.893253 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-dff0693c-0e48-4538-84f4-ac1de0b81807 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:26.896701 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-dff0693c-0e48-4538-84f4-ac1de0b81807 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:26.899739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-dff0693c-0e48-4538-84f4-ac1de0b81807 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1745 microversion: 2.20 time: 0.500298 Sep 21 16:25:26.902793 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 135/299] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:25:26 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1745 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:25:26.916185 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ad0a758f-231c-4062-a6c6-f1cc31c6fc39 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d1610491ba481e80f3e8cccfea3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5ebe21fe434bc3ad5ab4354c52fcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:26.926379 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ad0a758f-231c-4062-a6c6-f1cc31c6fc39 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] 10.222.0.64 "GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319" status: 200 len: 1315 microversion: 2.1 time: 0.348480 Sep 21 16:25:26.926971 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 165/300] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:26 2022] GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:27.062676 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-044e7bb3-9865-4076-a1e1-0dd89ba07e6e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:27.063357 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-044e7bb3-9865-4076-a1e1-0dd89ba07e6e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 675b6625-928e-45e6-bb51-f9a0bdfe117e] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:27.070026 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-044e7bb3-9865-4076-a1e1-0dd89ba07e6e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:27.070563 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-044e7bb3-9865-4076-a1e1-0dd89ba07e6e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:27.071051 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-044e7bb3-9865-4076-a1e1-0dd89ba07e6e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:27.071976 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-044e7bb3-9865-4076-a1e1-0dd89ba07e6e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:27.072599 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-044e7bb3-9865-4076-a1e1-0dd89ba07e6e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:27.073798 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-044e7bb3-9865-4076-a1e1-0dd89ba07e6e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:27.153238 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-435907f0-5106-4ad3-9438-2e08c5843a96 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:27.154655 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-435907f0-5106-4ad3-9438-2e08c5843a96 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:27.164385 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-435907f0-5106-4ad3-9438-2e08c5843a96 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:27.166668 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-435907f0-5106-4ad3-9438-2e08c5843a96 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:27.167474 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-435907f0-5106-4ad3-9438-2e08c5843a96 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:27.168475 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-435907f0-5106-4ad3-9438-2e08c5843a96 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:27.169240 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-435907f0-5106-4ad3-9438-2e08c5843a96 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:27.169901 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-435907f0-5106-4ad3-9438-2e08c5843a96 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:27.296838 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-044e7bb3-9865-4076-a1e1-0dd89ba07e6e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:27.307978 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-044e7bb3-9865-4076-a1e1-0dd89ba07e6e tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e" status: 200 len: 1502 microversion: 2.1 time: 0.249921 Sep 21 16:25:27.309401 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 136/301] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:27 2022] GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e => generated 1502 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:27.579923 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-435907f0-5106-4ad3-9438-2e08c5843a96 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:27.590832 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-435907f0-5106-4ad3-9438-2e08c5843a96 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 200 len: 1522 microversion: 2.1 time: 0.442543 Sep 21 16:25:27.591677 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 166/302] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:27 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 1522 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:25:27.928283 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d07bb534-86fe-4887-8ea2-8ae690959286 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:27.929776 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d07bb534-86fe-4887-8ea2-8ae690959286 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:27.937009 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d07bb534-86fe-4887-8ea2-8ae690959286 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:27.937499 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d07bb534-86fe-4887-8ea2-8ae690959286 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:27.938184 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d07bb534-86fe-4887-8ea2-8ae690959286 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:27.939078 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d07bb534-86fe-4887-8ea2-8ae690959286 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:27.940452 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d07bb534-86fe-4887-8ea2-8ae690959286 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:27.940885 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d07bb534-86fe-4887-8ea2-8ae690959286 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:27.967388 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-19f533ff-f528-46c6-9562-8228d5657a60 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:27.968498 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-19f533ff-f528-46c6-9562-8228d5657a60 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] [instance: a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:27.991800 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-19f533ff-f528-46c6-9562-8228d5657a60 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:27.997533 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-19f533ff-f528-46c6-9562-8228d5657a60 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:27.998419 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-19f533ff-f528-46c6-9562-8228d5657a60 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:27.999800 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-19f533ff-f528-46c6-9562-8228d5657a60 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:28.005019 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-19f533ff-f528-46c6-9562-8228d5657a60 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:28.006267 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-19f533ff-f528-46c6-9562-8228d5657a60 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:28.134678 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d07bb534-86fe-4887-8ea2-8ae690959286 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:28.148454 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d07bb534-86fe-4887-8ea2-8ae690959286 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:28.154194 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d07bb534-86fe-4887-8ea2-8ae690959286 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:28.156512 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d07bb534-86fe-4887-8ea2-8ae690959286 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1745 microversion: 2.20 time: 0.232748 Sep 21 16:25:28.170842 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 137/303] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:25:27 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1745 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 16:25:28.343264 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-19f533ff-f528-46c6-9562-8228d5657a60 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d1610491ba481e80f3e8cccfea3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5ebe21fe434bc3ad5ab4354c52fcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:28.344671 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-fd554177-ecfe-4e53-9467-a0ee6fee23b9 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:28.346120 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-fd554177-ecfe-4e53-9467-a0ee6fee23b9 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 675b6625-928e-45e6-bb51-f9a0bdfe117e] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:28.352728 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fd554177-ecfe-4e53-9467-a0ee6fee23b9 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:28.353454 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fd554177-ecfe-4e53-9467-a0ee6fee23b9 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:28.353915 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fd554177-ecfe-4e53-9467-a0ee6fee23b9 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:28.354954 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fd554177-ecfe-4e53-9467-a0ee6fee23b9 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:28.355656 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fd554177-ecfe-4e53-9467-a0ee6fee23b9 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:28.356647 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fd554177-ecfe-4e53-9467-a0ee6fee23b9 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:28.357183 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-19f533ff-f528-46c6-9562-8228d5657a60 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] 10.222.0.64 "GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319" status: 200 len: 1315 microversion: 2.1 time: 0.396549 Sep 21 16:25:28.368949 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 167/304] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:27 2022] GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:25:28.549682 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-fd554177-ecfe-4e53-9467-a0ee6fee23b9 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:28.590489 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-fd554177-ecfe-4e53-9467-a0ee6fee23b9 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e" status: 200 len: 1502 microversion: 2.1 time: 0.240644 Sep 21 16:25:28.593441 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 138/305] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:28 2022] GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e => generated 1502 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:28.629048 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-98209236-a5ed-480c-893a-4be384f7e896 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:28.629709 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-98209236-a5ed-480c-893a-4be384f7e896 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:28.637298 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-98209236-a5ed-480c-893a-4be384f7e896 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:28.638407 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-98209236-a5ed-480c-893a-4be384f7e896 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:28.639512 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-98209236-a5ed-480c-893a-4be384f7e896 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:28.640693 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-98209236-a5ed-480c-893a-4be384f7e896 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:28.641336 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-98209236-a5ed-480c-893a-4be384f7e896 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:28.642157 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-98209236-a5ed-480c-893a-4be384f7e896 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:29.090467 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-98209236-a5ed-480c-893a-4be384f7e896 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:29.104246 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-98209236-a5ed-480c-893a-4be384f7e896 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 200 len: 1522 microversion: 2.1 time: 0.478881 Sep 21 16:25:29.105253 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 168/306] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:28 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 1522 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:25:29.186105 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-4f1ed11a-e0f2-4161-a4ef-cf9cd466a78b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:29.186896 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-4f1ed11a-e0f2-4161-a4ef-cf9cd466a78b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:29.194443 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4f1ed11a-e0f2-4161-a4ef-cf9cd466a78b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:29.195195 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4f1ed11a-e0f2-4161-a4ef-cf9cd466a78b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:29.195657 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4f1ed11a-e0f2-4161-a4ef-cf9cd466a78b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:29.196368 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4f1ed11a-e0f2-4161-a4ef-cf9cd466a78b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:29.196823 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4f1ed11a-e0f2-4161-a4ef-cf9cd466a78b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:29.197234 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4f1ed11a-e0f2-4161-a4ef-cf9cd466a78b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:29.375210 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-4f1ed11a-e0f2-4161-a4ef-cf9cd466a78b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:29.396414 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ecd78131-a231-48a3-b619-f1c2bdf2ea23 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:29.396960 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-4f1ed11a-e0f2-4161-a4ef-cf9cd466a78b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:29.397360 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ecd78131-a231-48a3-b619-f1c2bdf2ea23 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] [instance: a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:29.397931 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-4f1ed11a-e0f2-4161-a4ef-cf9cd466a78b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:29.399446 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-4f1ed11a-e0f2-4161-a4ef-cf9cd466a78b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1745 microversion: 2.20 time: 0.217564 Sep 21 16:25:29.400882 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 139/307] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:25:29 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1745 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 16:25:29.416248 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ecd78131-a231-48a3-b619-f1c2bdf2ea23 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:29.417090 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ecd78131-a231-48a3-b619-f1c2bdf2ea23 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:29.417862 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ecd78131-a231-48a3-b619-f1c2bdf2ea23 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:29.419083 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ecd78131-a231-48a3-b619-f1c2bdf2ea23 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:29.420103 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ecd78131-a231-48a3-b619-f1c2bdf2ea23 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:29.421401 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ecd78131-a231-48a3-b619-f1c2bdf2ea23 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:29.612366 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ecd78131-a231-48a3-b619-f1c2bdf2ea23 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d1610491ba481e80f3e8cccfea3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5ebe21fe434bc3ad5ab4354c52fcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:29.624205 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ecd78131-a231-48a3-b619-f1c2bdf2ea23 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] 10.222.0.64 "GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319" status: 200 len: 1315 microversion: 2.1 time: 0.234308 Sep 21 16:25:29.625096 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 169/308] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:29 2022] GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:29.642538 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-db31f4ea-c8a7-4b9a-a3c5-167a098b1550 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:29.643223 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-db31f4ea-c8a7-4b9a-a3c5-167a098b1550 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 675b6625-928e-45e6-bb51-f9a0bdfe117e] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:29.649607 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-db31f4ea-c8a7-4b9a-a3c5-167a098b1550 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:29.650216 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-db31f4ea-c8a7-4b9a-a3c5-167a098b1550 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:29.650821 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-db31f4ea-c8a7-4b9a-a3c5-167a098b1550 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:29.651682 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-db31f4ea-c8a7-4b9a-a3c5-167a098b1550 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:29.652141 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-db31f4ea-c8a7-4b9a-a3c5-167a098b1550 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:29.652569 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-db31f4ea-c8a7-4b9a-a3c5-167a098b1550 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:29.834333 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-db31f4ea-c8a7-4b9a-a3c5-167a098b1550 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:29.849061 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-db31f4ea-c8a7-4b9a-a3c5-167a098b1550 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e" status: 200 len: 1502 microversion: 2.1 time: 0.210313 Sep 21 16:25:29.850140 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 140/309] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:29 2022] GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e => generated 1502 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:30.148774 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-4be782f3-8a94-4a5d-9fcc-a5e280547637 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:30.149409 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-4be782f3-8a94-4a5d-9fcc-a5e280547637 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:30.157914 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4be782f3-8a94-4a5d-9fcc-a5e280547637 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:30.158947 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4be782f3-8a94-4a5d-9fcc-a5e280547637 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:30.159226 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4be782f3-8a94-4a5d-9fcc-a5e280547637 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:30.160157 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4be782f3-8a94-4a5d-9fcc-a5e280547637 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:30.160797 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4be782f3-8a94-4a5d-9fcc-a5e280547637 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:30.161410 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4be782f3-8a94-4a5d-9fcc-a5e280547637 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:30.346535 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-4be782f3-8a94-4a5d-9fcc-a5e280547637 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:30.375755 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-4be782f3-8a94-4a5d-9fcc-a5e280547637 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 200 len: 1522 microversion: 2.1 time: 0.230214 Sep 21 16:25:30.391751 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 170/310] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:30 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:30.441459 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-b728db1d-6441-472d-9143-76f5a7c673ea tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:30.448663 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-b728db1d-6441-472d-9143-76f5a7c673ea tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:30.460690 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b728db1d-6441-472d-9143-76f5a7c673ea tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:30.461493 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b728db1d-6441-472d-9143-76f5a7c673ea tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:30.462208 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b728db1d-6441-472d-9143-76f5a7c673ea tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:30.463288 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b728db1d-6441-472d-9143-76f5a7c673ea tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:30.464007 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b728db1d-6441-472d-9143-76f5a7c673ea tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:30.464627 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b728db1d-6441-472d-9143-76f5a7c673ea tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:30.656251 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-83e7a39d-015a-4cd1-826d-0848bf22c4ad tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:30.659237 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-83e7a39d-015a-4cd1-826d-0848bf22c4ad tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] [instance: a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:30.672962 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-83e7a39d-015a-4cd1-826d-0848bf22c4ad tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:30.674340 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-83e7a39d-015a-4cd1-826d-0848bf22c4ad tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:30.675479 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-83e7a39d-015a-4cd1-826d-0848bf22c4ad tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:30.676733 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-83e7a39d-015a-4cd1-826d-0848bf22c4ad tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:30.678316 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-83e7a39d-015a-4cd1-826d-0848bf22c4ad tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:30.679000 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-83e7a39d-015a-4cd1-826d-0848bf22c4ad tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:30.803100 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-b728db1d-6441-472d-9143-76f5a7c673ea tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:30.816657 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-b728db1d-6441-472d-9143-76f5a7c673ea tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:30.821574 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-b728db1d-6441-472d-9143-76f5a7c673ea tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:30.825786 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-b728db1d-6441-472d-9143-76f5a7c673ea tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1745 microversion: 2.20 time: 0.404665 Sep 21 16:25:30.837883 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 141/311] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:25:30 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1745 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:25:30.873611 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-cd9bcae8-4ac5-4c23-a4e7-53323b91568c tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:30.874544 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-cd9bcae8-4ac5-4c23-a4e7-53323b91568c tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 675b6625-928e-45e6-bb51-f9a0bdfe117e] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:30.884272 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cd9bcae8-4ac5-4c23-a4e7-53323b91568c tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:30.884734 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cd9bcae8-4ac5-4c23-a4e7-53323b91568c tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:30.886666 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cd9bcae8-4ac5-4c23-a4e7-53323b91568c tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:30.891797 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cd9bcae8-4ac5-4c23-a4e7-53323b91568c tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:30.893216 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cd9bcae8-4ac5-4c23-a4e7-53323b91568c tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:30.893928 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cd9bcae8-4ac5-4c23-a4e7-53323b91568c tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:31.021626 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-83e7a39d-015a-4cd1-826d-0848bf22c4ad tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d1610491ba481e80f3e8cccfea3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5ebe21fe434bc3ad5ab4354c52fcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:31.031536 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-83e7a39d-015a-4cd1-826d-0848bf22c4ad tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] 10.222.0.64 "GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319" status: 200 len: 1315 microversion: 2.1 time: 0.387175 Sep 21 16:25:31.032785 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 171/312] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:30 2022] GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:25:31.192547 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-cd9bcae8-4ac5-4c23-a4e7-53323b91568c tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:31.201923 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-cd9bcae8-4ac5-4c23-a4e7-53323b91568c tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e" status: 200 len: 1502 microversion: 2.1 time: 0.332324 Sep 21 16:25:31.203378 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 142/313] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:30 2022] GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e => generated 1502 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:31.406956 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-1592e792-3161-4005-a1ce-1aded473c422 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:31.409683 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-1592e792-3161-4005-a1ce-1aded473c422 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:31.416807 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:31.419389 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1592e792-3161-4005-a1ce-1aded473c422 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:31.420179 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1592e792-3161-4005-a1ce-1aded473c422 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:31.420807 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1592e792-3161-4005-a1ce-1aded473c422 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:31.421924 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1592e792-3161-4005-a1ce-1aded473c422 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:31.422676 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1592e792-3161-4005-a1ce-1aded473c422 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:31.423312 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1592e792-3161-4005-a1ce-1aded473c422 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:31.660989 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-1592e792-3161-4005-a1ce-1aded473c422 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:31.676753 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-1592e792-3161-4005-a1ce-1aded473c422 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 200 len: 1522 microversion: 2.1 time: 0.274330 Sep 21 16:25:31.677978 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 172/314] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:31 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:31.858441 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-93bb3274-6dbd-4bf2-90ee-9fbd74d0e992 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:31.860534 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-93bb3274-6dbd-4bf2-90ee-9fbd74d0e992 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:31.873544 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-93bb3274-6dbd-4bf2-90ee-9fbd74d0e992 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:31.874808 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-93bb3274-6dbd-4bf2-90ee-9fbd74d0e992 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:31.875852 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-93bb3274-6dbd-4bf2-90ee-9fbd74d0e992 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:31.877923 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-93bb3274-6dbd-4bf2-90ee-9fbd74d0e992 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:31.879063 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-93bb3274-6dbd-4bf2-90ee-9fbd74d0e992 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:31.880063 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-93bb3274-6dbd-4bf2-90ee-9fbd74d0e992 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:32.072973 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-28534eb9-bece-432c-8a01-fb68c0b7e6c9 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:32.074236 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-28534eb9-bece-432c-8a01-fb68c0b7e6c9 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] [instance: a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:32.082246 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-28534eb9-bece-432c-8a01-fb68c0b7e6c9 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:32.083223 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-28534eb9-bece-432c-8a01-fb68c0b7e6c9 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:32.084046 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-28534eb9-bece-432c-8a01-fb68c0b7e6c9 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:32.085321 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-28534eb9-bece-432c-8a01-fb68c0b7e6c9 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:32.086090 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-28534eb9-bece-432c-8a01-fb68c0b7e6c9 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:32.086917 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-28534eb9-bece-432c-8a01-fb68c0b7e6c9 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:32.247163 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-93bb3274-6dbd-4bf2-90ee-9fbd74d0e992 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:32.279209 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-93bb3274-6dbd-4bf2-90ee-9fbd74d0e992 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:32.289699 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-93bb3274-6dbd-4bf2-90ee-9fbd74d0e992 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:32.299878 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-93bb3274-6dbd-4bf2-90ee-9fbd74d0e992 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1745 microversion: 2.20 time: 0.443113 Sep 21 16:25:32.302366 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 143/315] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:25:31 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1745 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:25:32.313348 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-a87ecb16-7a4c-44f6-ade3-2686c54fc830 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:32.320362 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-a87ecb16-7a4c-44f6-ade3-2686c54fc830 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 675b6625-928e-45e6-bb51-f9a0bdfe117e] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:32.337642 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a87ecb16-7a4c-44f6-ade3-2686c54fc830 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:32.338950 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a87ecb16-7a4c-44f6-ade3-2686c54fc830 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:32.340425 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a87ecb16-7a4c-44f6-ade3-2686c54fc830 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:32.342568 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a87ecb16-7a4c-44f6-ade3-2686c54fc830 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:32.343857 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a87ecb16-7a4c-44f6-ade3-2686c54fc830 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:32.344984 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a87ecb16-7a4c-44f6-ade3-2686c54fc830 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:32.363938 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-28534eb9-bece-432c-8a01-fb68c0b7e6c9 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d1610491ba481e80f3e8cccfea3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5ebe21fe434bc3ad5ab4354c52fcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:32.380463 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-28534eb9-bece-432c-8a01-fb68c0b7e6c9 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] 10.222.0.64 "GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319" status: 200 len: 1315 microversion: 2.1 time: 0.309763 Sep 21 16:25:32.384042 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 173/316] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:32 2022] GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:32.704404 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ca220137-a383-43af-a583-1ee997872605 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:32.705112 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ca220137-a383-43af-a583-1ee997872605 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:32.715212 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-a87ecb16-7a4c-44f6-ade3-2686c54fc830 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:32.722195 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ca220137-a383-43af-a583-1ee997872605 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:32.722700 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ca220137-a383-43af-a583-1ee997872605 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:32.723137 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ca220137-a383-43af-a583-1ee997872605 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:32.723856 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ca220137-a383-43af-a583-1ee997872605 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:32.724316 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ca220137-a383-43af-a583-1ee997872605 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:32.725171 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ca220137-a383-43af-a583-1ee997872605 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:32.741667 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-a87ecb16-7a4c-44f6-ade3-2686c54fc830 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e" status: 200 len: 1502 microversion: 2.1 time: 0.436567 Sep 21 16:25:32.745700 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 144/317] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:32 2022] GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e => generated 1502 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:33.262033 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ca220137-a383-43af-a583-1ee997872605 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:33.287455 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ca220137-a383-43af-a583-1ee997872605 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 200 len: 1522 microversion: 2.1 time: 0.581327 Sep 21 16:25:33.306080 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 174/318] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:32 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 1522 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:25:33.339177 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-0e33eaef-6141-4235-8d0a-371dfaf49bdf tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:33.343271 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-0e33eaef-6141-4235-8d0a-371dfaf49bdf tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:33.373932 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0e33eaef-6141-4235-8d0a-371dfaf49bdf tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:33.391702 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0e33eaef-6141-4235-8d0a-371dfaf49bdf tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:33.391702 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0e33eaef-6141-4235-8d0a-371dfaf49bdf tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:33.391702 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0e33eaef-6141-4235-8d0a-371dfaf49bdf tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:33.391702 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0e33eaef-6141-4235-8d0a-371dfaf49bdf tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:33.392859 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0e33eaef-6141-4235-8d0a-371dfaf49bdf tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:33.411726 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-62839b76-ac1c-416b-87d1-e9646338e445 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:33.412885 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-62839b76-ac1c-416b-87d1-e9646338e445 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] [instance: a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:33.434213 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-62839b76-ac1c-416b-87d1-e9646338e445 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:33.434837 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-62839b76-ac1c-416b-87d1-e9646338e445 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:33.441697 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-62839b76-ac1c-416b-87d1-e9646338e445 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:33.443103 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-62839b76-ac1c-416b-87d1-e9646338e445 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:33.444292 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-62839b76-ac1c-416b-87d1-e9646338e445 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:33.449069 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-62839b76-ac1c-416b-87d1-e9646338e445 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:33.828791 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-62839b76-ac1c-416b-87d1-e9646338e445 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d1610491ba481e80f3e8cccfea3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5ebe21fe434bc3ad5ab4354c52fcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:33.840692 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-62839b76-ac1c-416b-87d1-e9646338e445 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] 10.222.0.64 "GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319" status: 200 len: 1315 microversion: 2.1 time: 0.434921 Sep 21 16:25:33.842265 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 175/319] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:33 2022] GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:33.848606 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-412dbaad-60af-4059-ad0c-98d8695613d8 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:33.849817 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-412dbaad-60af-4059-ad0c-98d8695613d8 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 675b6625-928e-45e6-bb51-f9a0bdfe117e] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:33.857945 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-412dbaad-60af-4059-ad0c-98d8695613d8 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:33.858989 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-412dbaad-60af-4059-ad0c-98d8695613d8 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:33.860280 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-412dbaad-60af-4059-ad0c-98d8695613d8 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:33.862356 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-412dbaad-60af-4059-ad0c-98d8695613d8 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:33.863075 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-412dbaad-60af-4059-ad0c-98d8695613d8 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:33.863910 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-412dbaad-60af-4059-ad0c-98d8695613d8 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:34.070078 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-412dbaad-60af-4059-ad0c-98d8695613d8 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:34.070078 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-412dbaad-60af-4059-ad0c-98d8695613d8 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e" status: 200 len: 1502 microversion: 2.1 time: 0.222747 Sep 21 16:25:34.070078 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 176/320] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:33 2022] GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e => generated 1502 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:34.311181 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-0e33eaef-6141-4235-8d0a-371dfaf49bdf tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:34.328728 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-94b1ebd4-c192-49ad-8e1b-2241e56bf35c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:34.329368 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-94b1ebd4-c192-49ad-8e1b-2241e56bf35c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:34.335907 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-0e33eaef-6141-4235-8d0a-371dfaf49bdf tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:34.340798 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-0e33eaef-6141-4235-8d0a-371dfaf49bdf tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:34.343325 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-0e33eaef-6141-4235-8d0a-371dfaf49bdf tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1745 microversion: 2.20 time: 1.014688 Sep 21 16:25:34.344179 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-94b1ebd4-c192-49ad-8e1b-2241e56bf35c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:34.358105 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-94b1ebd4-c192-49ad-8e1b-2241e56bf35c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:34.358598 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 145/321] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:25:33 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1745 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:25:34.358698 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-94b1ebd4-c192-49ad-8e1b-2241e56bf35c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:34.358698 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-94b1ebd4-c192-49ad-8e1b-2241e56bf35c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:34.358698 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-94b1ebd4-c192-49ad-8e1b-2241e56bf35c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:34.358698 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-94b1ebd4-c192-49ad-8e1b-2241e56bf35c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:34.531379 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-94b1ebd4-c192-49ad-8e1b-2241e56bf35c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:34.541247 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-94b1ebd4-c192-49ad-8e1b-2241e56bf35c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 200 len: 1522 microversion: 2.1 time: 0.216238 Sep 21 16:25:34.554084 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 177/322] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:34 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:25:34.762020 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-78c4289d-ee51-40a2-a02f-39e877d46b6c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:25:34.770203 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-78c4289d-ee51-40a2-a02f-39e877d46b6c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:34.770705 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-78c4289d-ee51-40a2-a02f-39e877d46b6c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:34.771147 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-78c4289d-ee51-40a2-a02f-39e877d46b6c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:34.778740 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=100 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:34.896671 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-3a3a7781-e655-487b-8576-4503c06c33ca tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:34.898843 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-3a3a7781-e655-487b-8576-4503c06c33ca tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] [instance: a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:34.907942 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3a3a7781-e655-487b-8576-4503c06c33ca tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:34.908856 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3a3a7781-e655-487b-8576-4503c06c33ca tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:34.909591 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3a3a7781-e655-487b-8576-4503c06c33ca tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:34.911108 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3a3a7781-e655-487b-8576-4503c06c33ca tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:34.911902 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3a3a7781-e655-487b-8576-4503c06c33ca tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:34.912568 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3a3a7781-e655-487b-8576-4503c06c33ca tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:35.146475 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-78c4289d-ee51-40a2-a02f-39e877d46b6c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Going to try to stop instance {{(pid=120531) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 21 16:25:35.201898 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-3a3a7781-e655-487b-8576-4503c06c33ca tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d1610491ba481e80f3e8cccfea3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5ebe21fe434bc3ad5ab4354c52fcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:35.222702 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-3a3a7781-e655-487b-8576-4503c06c33ca tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] 10.222.0.64 "GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319" status: 200 len: 1315 microversion: 2.1 time: 0.336062 Sep 21 16:25:35.225335 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 178/323] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:34 2022] GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:35.238236 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-0ea98e5d-1653-4107-8b8d-d7c7319eecaa tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:35.239932 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-0ea98e5d-1653-4107-8b8d-d7c7319eecaa tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 675b6625-928e-45e6-bb51-f9a0bdfe117e] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:35.249154 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-78c4289d-ee51-40a2-a02f-39e877d46b6c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "POST /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021/action" status: 202 len: 0 microversion: 2.1 time: 0.491452 Sep 21 16:25:35.252942 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 146/324] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Sep 21 16:25:34 2022] POST /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 21 16:25:35.259894 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0ea98e5d-1653-4107-8b8d-d7c7319eecaa tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:35.260813 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0ea98e5d-1653-4107-8b8d-d7c7319eecaa tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:35.261433 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0ea98e5d-1653-4107-8b8d-d7c7319eecaa tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:35.264534 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0ea98e5d-1653-4107-8b8d-d7c7319eecaa tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:35.265298 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0ea98e5d-1653-4107-8b8d-d7c7319eecaa tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:35.265600 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-0b369f5d-ca40-41a4-aa5d-d6d5688a498a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:35.266486 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-0b369f5d-ca40-41a4-aa5d-d6d5688a498a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:35.268497 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0ea98e5d-1653-4107-8b8d-d7c7319eecaa tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:35.274769 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0b369f5d-ca40-41a4-aa5d-d6d5688a498a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:35.275362 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0b369f5d-ca40-41a4-aa5d-d6d5688a498a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:35.275801 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0b369f5d-ca40-41a4-aa5d-d6d5688a498a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:35.276600 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0b369f5d-ca40-41a4-aa5d-d6d5688a498a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:35.278001 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0b369f5d-ca40-41a4-aa5d-d6d5688a498a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:35.278603 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0b369f5d-ca40-41a4-aa5d-d6d5688a498a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:35.415517 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-0ea98e5d-1653-4107-8b8d-d7c7319eecaa tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:35.424997 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-0ea98e5d-1653-4107-8b8d-d7c7319eecaa tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e" status: 200 len: 1460 microversion: 2.1 time: 0.197785 Sep 21 16:25:35.439527 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 179/325] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:35 2022] GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e => generated 1460 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:35.447017 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-0253be65-ef86-4307-9c7e-f90b06874733 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:35.448251 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-0253be65-ef86-4307-9c7e-f90b06874733 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:35.456188 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0253be65-ef86-4307-9c7e-f90b06874733 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:35.457067 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0253be65-ef86-4307-9c7e-f90b06874733 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:35.457748 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0253be65-ef86-4307-9c7e-f90b06874733 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:35.459044 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0253be65-ef86-4307-9c7e-f90b06874733 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:35.460286 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0253be65-ef86-4307-9c7e-f90b06874733 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:35.461005 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0253be65-ef86-4307-9c7e-f90b06874733 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:35.465917 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=100 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:35.670263 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-0b369f5d-ca40-41a4-aa5d-d6d5688a498a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:35.705237 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-0b369f5d-ca40-41a4-aa5d-d6d5688a498a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1724 microversion: 2.1 time: 0.446137 Sep 21 16:25:35.718080 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 147/326] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:35 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1724 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:35.740082 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-286c4c8d-97d8-4b12-817e-4707233463be tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:35.743474 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-286c4c8d-97d8-4b12-817e-4707233463be tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:35.756915 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-286c4c8d-97d8-4b12-817e-4707233463be tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:35.757850 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-286c4c8d-97d8-4b12-817e-4707233463be tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:35.758769 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-286c4c8d-97d8-4b12-817e-4707233463be tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:35.759806 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-286c4c8d-97d8-4b12-817e-4707233463be tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:35.760200 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-0253be65-ef86-4307-9c7e-f90b06874733 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:35.760817 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-286c4c8d-97d8-4b12-817e-4707233463be tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:35.761487 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-286c4c8d-97d8-4b12-817e-4707233463be tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:35.825771 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-0253be65-ef86-4307-9c7e-f90b06874733 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:35.829324 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-0253be65-ef86-4307-9c7e-f90b06874733 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:35.832798 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-0253be65-ef86-4307-9c7e-f90b06874733 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1745 microversion: 2.20 time: 0.391695 Sep 21 16:25:35.835063 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 180/327] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:25:35 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1745 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:25:35.840078 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-f0e0d198-b073-4e4a-812c-7856df38f89d req-010e9bd5-4fb8-4936-85d8-04b4bfdbb4c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "675b6625-928e-45e6-bb51-f9a0bdfe117e", "name": "network-vif-deleted", "tag": "4915c1ab-5710-4fee-b455-12531022f6aa"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:25:35.851561 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-f0e0d198-b073-4e4a-812c-7856df38f89d req-010e9bd5-4fb8-4936-85d8-04b4bfdbb4c4 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:35.852447 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-f0e0d198-b073-4e4a-812c-7856df38f89d req-010e9bd5-4fb8-4936-85d8-04b4bfdbb4c4 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:35.853872 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-f0e0d198-b073-4e4a-812c-7856df38f89d req-010e9bd5-4fb8-4936-85d8-04b4bfdbb4c4 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:35.870932 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-f0e0d198-b073-4e4a-812c-7856df38f89d req-010e9bd5-4fb8-4936-85d8-04b4bfdbb4c4 service nova] Creating event network-vif-deleted:4915c1ab-5710-4fee-b455-12531022f6aa for instance 675b6625-928e-45e6-bb51-f9a0bdfe117e on hv-cinder-85862 Sep 21 16:25:35.877327 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-f0e0d198-b073-4e4a-812c-7856df38f89d req-010e9bd5-4fb8-4936-85d8-04b4bfdbb4c4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040196 Sep 21 16:25:35.878570 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 181/328] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:25:36.249277 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-5865c46e-d919-40e6-a129-3c2c67309bea tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:36.250827 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-5865c46e-d919-40e6-a129-3c2c67309bea tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] [instance: a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:36.260462 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5865c46e-d919-40e6-a129-3c2c67309bea tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:36.261370 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5865c46e-d919-40e6-a129-3c2c67309bea tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:36.262031 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5865c46e-d919-40e6-a129-3c2c67309bea tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:36.263318 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5865c46e-d919-40e6-a129-3c2c67309bea tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:36.264243 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5865c46e-d919-40e6-a129-3c2c67309bea tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:36.264960 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5865c46e-d919-40e6-a129-3c2c67309bea tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:36.334096 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-286c4c8d-97d8-4b12-817e-4707233463be tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:36.364418 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-286c4c8d-97d8-4b12-817e-4707233463be tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 200 len: 1522 microversion: 2.1 time: 0.654495 Sep 21 16:25:36.365984 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 148/329] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:35 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 1522 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:36.455678 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-0bfe6c54-5ceb-4cd3-90d4-fe2fb04ac6f0 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:36.456839 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-0bfe6c54-5ceb-4cd3-90d4-fe2fb04ac6f0 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 675b6625-928e-45e6-bb51-f9a0bdfe117e] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:36.477611 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0bfe6c54-5ceb-4cd3-90d4-fe2fb04ac6f0 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:36.488191 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5865c46e-d919-40e6-a129-3c2c67309bea tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d1610491ba481e80f3e8cccfea3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5ebe21fe434bc3ad5ab4354c52fcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:36.499023 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0bfe6c54-5ceb-4cd3-90d4-fe2fb04ac6f0 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:36.503576 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0bfe6c54-5ceb-4cd3-90d4-fe2fb04ac6f0 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:36.504769 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0bfe6c54-5ceb-4cd3-90d4-fe2fb04ac6f0 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:36.505267 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0bfe6c54-5ceb-4cd3-90d4-fe2fb04ac6f0 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:36.505481 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-5865c46e-d919-40e6-a129-3c2c67309bea tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] 10.222.0.64 "GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319" status: 200 len: 1465 microversion: 2.1 time: 0.260423 Sep 21 16:25:36.505719 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0bfe6c54-5ceb-4cd3-90d4-fe2fb04ac6f0 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:36.522082 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 182/330] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:36 2022] GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 => generated 1465 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:36.572985 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0bfe6c54-5ceb-4cd3-90d4-fe2fb04ac6f0 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:36.573569 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0bfe6c54-5ceb-4cd3-90d4-fe2fb04ac6f0 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:36.574168 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0bfe6c54-5ceb-4cd3-90d4-fe2fb04ac6f0 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:36.575157 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.objects.instance [None req-0bfe6c54-5ceb-4cd3-90d4-fe2fb04ac6f0 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lazy-loading 'fault' on Instance uuid 675b6625-928e-45e6-bb51-f9a0bdfe117e {{(pid=120531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 16:25:36.603632 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-833b413a-3ac1-4382-8de7-a7a6735cb0dc tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:36.604147 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-833b413a-3ac1-4382-8de7-a7a6735cb0dc tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] [instance: a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:36.611764 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-833b413a-3ac1-4382-8de7-a7a6735cb0dc tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:36.612262 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-833b413a-3ac1-4382-8de7-a7a6735cb0dc tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:36.612702 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-833b413a-3ac1-4382-8de7-a7a6735cb0dc tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:36.613416 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-833b413a-3ac1-4382-8de7-a7a6735cb0dc tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:36.613876 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-833b413a-3ac1-4382-8de7-a7a6735cb0dc tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:36.614350 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-833b413a-3ac1-4382-8de7-a7a6735cb0dc tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:36.652064 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-833b413a-3ac1-4382-8de7-a7a6735cb0dc tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] [instance: a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319] Going to try to terminate instance {{(pid=120532) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 16:25:36.671432 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-0bfe6c54-5ceb-4cd3-90d4-fe2fb04ac6f0 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:36.685731 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-0bfe6c54-5ceb-4cd3-90d4-fe2fb04ac6f0 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e" status: 200 len: 1303 microversion: 2.1 time: 0.238632 Sep 21 16:25:36.698999 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 149/331] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:36 2022] GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e => generated 1303 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:36.737413 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-eea7f4b4-1642-45dd-93fc-4d2110b3641f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:36.740686 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-eea7f4b4-1642-45dd-93fc-4d2110b3641f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:36.765213 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-833b413a-3ac1-4382-8de7-a7a6735cb0dc tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319" status: 204 len: 0 microversion: 2.1 time: 0.165172 Sep 21 16:25:36.765905 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 183/332] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Sep 21 16:25:36 2022] DELETE /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 21 16:25:36.771012 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-eea7f4b4-1642-45dd-93fc-4d2110b3641f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:36.774598 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-eea7f4b4-1642-45dd-93fc-4d2110b3641f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:36.775617 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-eea7f4b4-1642-45dd-93fc-4d2110b3641f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:36.781973 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-2414e607-f5fb-4393-8064-6e358508c358 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:36.782971 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-2414e607-f5fb-4393-8064-6e358508c358 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] [instance: a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:36.784219 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-eea7f4b4-1642-45dd-93fc-4d2110b3641f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:36.785516 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-eea7f4b4-1642-45dd-93fc-4d2110b3641f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:36.786377 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-eea7f4b4-1642-45dd-93fc-4d2110b3641f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:36.791652 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2414e607-f5fb-4393-8064-6e358508c358 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:36.792157 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2414e607-f5fb-4393-8064-6e358508c358 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:36.793019 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2414e607-f5fb-4393-8064-6e358508c358 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:36.793882 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2414e607-f5fb-4393-8064-6e358508c358 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:36.794509 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2414e607-f5fb-4393-8064-6e358508c358 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:36.794993 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2414e607-f5fb-4393-8064-6e358508c358 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:37.290564 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-2414e607-f5fb-4393-8064-6e358508c358 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d1610491ba481e80f3e8cccfea3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5ebe21fe434bc3ad5ab4354c52fcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:37.310288 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-2414e607-f5fb-4393-8064-6e358508c358 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] 10.222.0.64 "GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319" status: 200 len: 1471 microversion: 2.1 time: 0.536229 Sep 21 16:25:37.312362 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 184/333] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:36 2022] GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 => generated 1471 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:37.324064 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-8d9bc34f-11c2-42e9-90b3-0e5b2e5e033f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:37.325669 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-8d9bc34f-11c2-42e9-90b3-0e5b2e5e033f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:37.338876 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8d9bc34f-11c2-42e9-90b3-0e5b2e5e033f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:37.340364 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8d9bc34f-11c2-42e9-90b3-0e5b2e5e033f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:37.341429 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8d9bc34f-11c2-42e9-90b3-0e5b2e5e033f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:37.343975 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8d9bc34f-11c2-42e9-90b3-0e5b2e5e033f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:37.345416 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8d9bc34f-11c2-42e9-90b3-0e5b2e5e033f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:37.346568 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8d9bc34f-11c2-42e9-90b3-0e5b2e5e033f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:37.449636 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-eea7f4b4-1642-45dd-93fc-4d2110b3641f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:37.470465 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-eea7f4b4-1642-45dd-93fc-4d2110b3641f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1724 microversion: 2.1 time: 0.742336 Sep 21 16:25:37.472386 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 150/334] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:36 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1724 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:37.485619 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-60d6596a-bf93-46f3-abc0-5ffdf2462f06 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:37.487435 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-60d6596a-bf93-46f3-abc0-5ffdf2462f06 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:37.501014 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-60d6596a-bf93-46f3-abc0-5ffdf2462f06 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:37.502644 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-60d6596a-bf93-46f3-abc0-5ffdf2462f06 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:37.503350 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-60d6596a-bf93-46f3-abc0-5ffdf2462f06 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:37.504707 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-60d6596a-bf93-46f3-abc0-5ffdf2462f06 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:37.505524 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-60d6596a-bf93-46f3-abc0-5ffdf2462f06 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:37.506359 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-60d6596a-bf93-46f3-abc0-5ffdf2462f06 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:37.838607 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-8d9bc34f-11c2-42e9-90b3-0e5b2e5e033f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:37.868541 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-8d9bc34f-11c2-42e9-90b3-0e5b2e5e033f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:37.871797 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-8d9bc34f-11c2-42e9-90b3-0e5b2e5e033f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:37.874464 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-8d9bc34f-11c2-42e9-90b3-0e5b2e5e033f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1740 microversion: 2.20 time: 0.558685 Sep 21 16:25:37.876785 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 185/335] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:25:37 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1740 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:25:37.885241 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-116efcbc-cd5e-43df-9b29-009a0e69c89a tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:37.886853 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-116efcbc-cd5e-43df-9b29-009a0e69c89a tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 675b6625-928e-45e6-bb51-f9a0bdfe117e] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:37.898812 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-116efcbc-cd5e-43df-9b29-009a0e69c89a tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:37.900116 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-116efcbc-cd5e-43df-9b29-009a0e69c89a tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:37.901181 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-116efcbc-cd5e-43df-9b29-009a0e69c89a tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:37.902788 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-116efcbc-cd5e-43df-9b29-009a0e69c89a tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:37.903903 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-116efcbc-cd5e-43df-9b29-009a0e69c89a tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:37.905191 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-116efcbc-cd5e-43df-9b29-009a0e69c89a tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:37.977521 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-116efcbc-cd5e-43df-9b29-009a0e69c89a tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:37.979561 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-116efcbc-cd5e-43df-9b29-009a0e69c89a tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:37.980560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-116efcbc-cd5e-43df-9b29-009a0e69c89a tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:37.981374 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.objects.instance [None req-116efcbc-cd5e-43df-9b29-009a0e69c89a tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lazy-loading 'fault' on Instance uuid 675b6625-928e-45e6-bb51-f9a0bdfe117e {{(pid=120532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 16:25:38.054894 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-60d6596a-bf93-46f3-abc0-5ffdf2462f06 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:38.075971 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-116efcbc-cd5e-43df-9b29-009a0e69c89a tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:38.082399 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-60d6596a-bf93-46f3-abc0-5ffdf2462f06 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 200 len: 1502 microversion: 2.1 time: 0.607687 Sep 21 16:25:38.087057 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 151/336] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:37 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 1502 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:38.100952 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-116efcbc-cd5e-43df-9b29-009a0e69c89a tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e" status: 200 len: 1303 microversion: 2.1 time: 0.222625 Sep 21 16:25:38.101566 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 186/337] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:37 2022] GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e => generated 1303 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:38.156024 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-1f186ca1-10b4-48e9-b412-8e325f7f90a9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb6265f6-0f2d-45aa-961f-71992245ad5a"}} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:25:38.160548 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-1f186ca1-10b4-48e9-b412-8e325f7f90a9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:38.188261 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1f186ca1-10b4-48e9-b412-8e325f7f90a9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:38.189639 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1f186ca1-10b4-48e9-b412-8e325f7f90a9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:38.190364 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1f186ca1-10b4-48e9-b412-8e325f7f90a9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:38.191458 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1f186ca1-10b4-48e9-b412-8e325f7f90a9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:38.192529 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1f186ca1-10b4-48e9-b412-8e325f7f90a9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:38.192935 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1f186ca1-10b4-48e9-b412-8e325f7f90a9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:38.264217 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.wsgi [None req-1f186ca1-10b4-48e9-b412-8e325f7f90a9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] HTTP exception thrown: Cannot 'attach_volume' instance 0ece03bf-7582-46b8-8966-0f46577abe14 while it is in vm_state rescued Sep 21 16:25:38.268175 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-1f186ca1-10b4-48e9-b412-8e325f7f90a9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Request method failure captured: Sep 21 16:25:38.268175 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: request: POST /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14/os-volume_attachments HTTP/1.1 Sep 21 16:25:38.268175 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept: application/json Sep 21 16:25:38.268175 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept-Encoding: identity Sep 21 16:25:38.268175 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Connection: close Sep 21 16:25:38.268175 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Length: 74 Sep 21 16:25:38.268175 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Type: application/json Sep 21 16:25:38.268175 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Host: 10.222.0.64 Sep 21 16:25:38.268175 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Openstack-System-Scope: None Sep 21 16:25:38.268175 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: User-Agent: python-urllib3/1.26.12 Sep 21 16:25:38.268175 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Auth-Token: gAAAAABjKzpyl2VCA8qOXz_21Lb4_x9U1Xx-KlcjECNulDWe7htEJ0Af4mLHkpXjsPlA1iQ8jPMrxiWhztqQcFxCTlE1P4S3HVT0CeR12yBvkFP50lGbKEP4T7hlDNnQEqfVaKzVcRuzvbEZYlwT4nr23Om4knGB4vuwh-cjuvcsP1wXC1rngVU Sep 21 16:25:38.268175 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Id: None Sep 21 16:25:38.268175 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Name: None Sep 21 16:25:38.268175 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Identity-Status: Confirmed Sep 21 16:25:38.268175 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Is-Admin-Project: True Sep 21 16:25:38.268175 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Id: default Sep 21 16:25:38.268175 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Name: Default Sep 21 16:25:38.268175 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Id: b93e202a295d427a85fdaf0209951bd5 Sep 21 16:25:38.268175 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-717335908 Sep 21 16:25:38.268175 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Role: member,reader Sep 21 16:25:38.268175 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Roles: member,reader Sep 21 16:25:38.271053 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/b93e202a295d427a85fdaf0209951bd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b93e202a295d427a85fdaf0209951bd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_b93e202a295d427a85fdaf0209951bd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b93e202a295d427a85fdaf0209951bd5"}]}] Sep 21 16:25:38.271053 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant: tempest-ServerRescueNegativeTestJSON-717335908 Sep 21 16:25:38.271053 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Id: b93e202a295d427a85fdaf0209951bd5 Sep 21 16:25:38.271053 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-717335908 Sep 21 16:25:38.271053 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User: tempest-ServerRescueNegativeTestJSON-717335908-project Sep 21 16:25:38.271053 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Id: default Sep 21 16:25:38.271053 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Name: Default Sep 21 16:25:38.271053 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Id: d2382a6610ae42fa865283ed12dd9982 Sep 21 16:25:38.271053 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Name: tempest-ServerRescueNegativeTestJSON-717335908-project Sep 21 16:25:38.271053 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Sep 21 16:25:38.271053 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: {"volumeAttachment": {"volumeId": "cb6265f6-0f2d-45aa-961f-71992245ad5a"}} Sep 21 16:25:38.271053 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: method: > Sep 21 16:25:38.272529 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: exception: Cannot 'attach_volume' instance 0ece03bf-7582-46b8-8966-0f46577abe14 while it is in vm_state rescued Sep 21 16:25:38.272529 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: action_args: {'server_id': '0ece03bf-7582-46b8-8966-0f46577abe14', 'body': {'volumeAttachment': {'volumeId': 'cb6265f6-0f2d-45aa-961f-71992245ad5a'}}} Sep 21 16:25:38.272529 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:25:38.272529 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:25:38.272529 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 21 16:25:38.272529 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 21 16:25:38.272529 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 21 16:25:38.272529 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 21 16:25:38.272529 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 21 16:25:38.272529 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 21 16:25:38.272529 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0ece03bf-7582-46b8-8966-0f46577abe14 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 21 16:25:38.272529 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:25:38.272529 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:25:38.272529 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:25:38.272529 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:25:38.272529 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:25:38.272529 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:25:38.272529 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:25:38.272529 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:25:38.275031 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:25:38.275031 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:25:38.275031 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 21 16:25:38.275031 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 21 16:25:38.275031 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 21 16:25:38.275031 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 21 16:25:38.275031 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 21 16:25:38.275031 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 21 16:25:38.275031 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 21 16:25:38.275031 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 21 16:25:38.275031 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 21 16:25:38.275031 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 21 16:25:38.275031 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 0ece03bf-7582-46b8-8966-0f46577abe14 while it is in vm_state rescued Sep 21 16:25:38.275031 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:25:38.275031 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:25:38.275031 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:25:38.275031 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:25:38.275031 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:25:38.275031 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:25:38.277391 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:25:38.277391 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:25:38.277391 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 0ece03bf-7582-46b8-8966-0f46577abe14 while it is in vm_state rescued Sep 21 16:25:38.277391 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:25:38.281892 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-1f186ca1-10b4-48e9-b412-8e325f7f90a9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Returning 409 to user: Cannot 'attach_volume' instance 0ece03bf-7582-46b8-8966-0f46577abe14 while it is in vm_state rescued {{(pid=120531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:25:38.283864 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-1f186ca1-10b4-48e9-b412-8e325f7f90a9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "POST /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.132817 Sep 21 16:25:38.295806 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 152/338] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Sep 21 16:25:38 2022] POST /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14/os-volume_attachments => generated 152 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 21 16:25:38.296071 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-f3a76cad-cb46-4da9-a54e-58f37ab7ee8b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:25:38.296808 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-f3a76cad-cb46-4da9-a54e-58f37ab7ee8b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:38.305448 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f3a76cad-cb46-4da9-a54e-58f37ab7ee8b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:38.306187 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f3a76cad-cb46-4da9-a54e-58f37ab7ee8b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:38.306704 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f3a76cad-cb46-4da9-a54e-58f37ab7ee8b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:38.307444 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f3a76cad-cb46-4da9-a54e-58f37ab7ee8b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:38.308030 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f3a76cad-cb46-4da9-a54e-58f37ab7ee8b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:38.308541 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f3a76cad-cb46-4da9-a54e-58f37ab7ee8b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:38.358175 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-db57243c-3203-47fa-a701-b49264ae4984 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:38.360339 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-db57243c-3203-47fa-a701-b49264ae4984 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] [instance: a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:38.381310 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-db57243c-3203-47fa-a701-b49264ae4984 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:38.383448 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-db57243c-3203-47fa-a701-b49264ae4984 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:38.397164 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-db57243c-3203-47fa-a701-b49264ae4984 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:38.401222 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-db57243c-3203-47fa-a701-b49264ae4984 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:38.401873 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-db57243c-3203-47fa-a701-b49264ae4984 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:38.402397 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-db57243c-3203-47fa-a701-b49264ae4984 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:38.425525 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-f3a76cad-cb46-4da9-a54e-58f37ab7ee8b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "POST /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14/action" status: 202 len: 0 microversion: 2.1 time: 0.129908 Sep 21 16:25:38.433921 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 187/339] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Sep 21 16:25:38 2022] POST /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 21 16:25:38.447260 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-a9dbde0f-3306-450b-9bd2-d73a80430bd8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:38.455918 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-a9dbde0f-3306-450b-9bd2-d73a80430bd8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:38.476606 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a9dbde0f-3306-450b-9bd2-d73a80430bd8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:38.478194 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a9dbde0f-3306-450b-9bd2-d73a80430bd8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:38.494077 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a9dbde0f-3306-450b-9bd2-d73a80430bd8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:38.497027 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a9dbde0f-3306-450b-9bd2-d73a80430bd8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:38.504193 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a9dbde0f-3306-450b-9bd2-d73a80430bd8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:38.505407 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a9dbde0f-3306-450b-9bd2-d73a80430bd8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:38.967361 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a9dbde0f-3306-450b-9bd2-d73a80430bd8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:38.988091 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-a9dbde0f-3306-450b-9bd2-d73a80430bd8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 200 len: 1510 microversion: 2.1 time: 0.548967 Sep 21 16:25:38.992589 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 188/340] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:38 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 1510 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:39.009068 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-d7639cc1-07b7-4e07-9dcd-23cb0882c397 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:39.009805 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-d7639cc1-07b7-4e07-9dcd-23cb0882c397 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:39.028689 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d7639cc1-07b7-4e07-9dcd-23cb0882c397 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:39.029654 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d7639cc1-07b7-4e07-9dcd-23cb0882c397 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:39.043447 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d7639cc1-07b7-4e07-9dcd-23cb0882c397 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:39.044248 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d7639cc1-07b7-4e07-9dcd-23cb0882c397 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:39.044742 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d7639cc1-07b7-4e07-9dcd-23cb0882c397 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:39.045184 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d7639cc1-07b7-4e07-9dcd-23cb0882c397 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:39.097281 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-db57243c-3203-47fa-a701-b49264ae4984 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d1610491ba481e80f3e8cccfea3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5ebe21fe434bc3ad5ab4354c52fcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:39.108638 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-db57243c-3203-47fa-a701-b49264ae4984 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] 10.222.0.64 "GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319" status: 200 len: 1471 microversion: 2.1 time: 0.766015 Sep 21 16:25:39.111721 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 153/341] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:38 2022] GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 => generated 1471 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:25:39.139256 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-216eaa4e-efc4-4890-9c07-a2458a67e95d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:39.141752 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-216eaa4e-efc4-4890-9c07-a2458a67e95d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:39.158656 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-216eaa4e-efc4-4890-9c07-a2458a67e95d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:39.159425 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-216eaa4e-efc4-4890-9c07-a2458a67e95d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:39.160035 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-216eaa4e-efc4-4890-9c07-a2458a67e95d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:39.162294 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-216eaa4e-efc4-4890-9c07-a2458a67e95d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:39.163039 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-216eaa4e-efc4-4890-9c07-a2458a67e95d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:39.170534 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-216eaa4e-efc4-4890-9c07-a2458a67e95d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:39.259709 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d7639cc1-07b7-4e07-9dcd-23cb0882c397 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:39.289656 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-d7639cc1-07b7-4e07-9dcd-23cb0882c397 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1724 microversion: 2.1 time: 0.292183 Sep 21 16:25:39.299906 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 189/342] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:38 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1724 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:39.339647 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-50c6c088-154f-4f48-b839-f4d3f4f3d7b6 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:39.345307 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-50c6c088-154f-4f48-b839-f4d3f4f3d7b6 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 675b6625-928e-45e6-bb51-f9a0bdfe117e] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:39.378983 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-50c6c088-154f-4f48-b839-f4d3f4f3d7b6 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:39.382558 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-50c6c088-154f-4f48-b839-f4d3f4f3d7b6 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:39.383398 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-50c6c088-154f-4f48-b839-f4d3f4f3d7b6 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:39.390967 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-50c6c088-154f-4f48-b839-f4d3f4f3d7b6 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:39.392415 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-50c6c088-154f-4f48-b839-f4d3f4f3d7b6 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:39.394520 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-50c6c088-154f-4f48-b839-f4d3f4f3d7b6 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:39.535303 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-216eaa4e-efc4-4890-9c07-a2458a67e95d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:39.541053 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-50c6c088-154f-4f48-b839-f4d3f4f3d7b6 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:39.541546 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-50c6c088-154f-4f48-b839-f4d3f4f3d7b6 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:39.542583 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-50c6c088-154f-4f48-b839-f4d3f4f3d7b6 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:39.542583 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.objects.instance [None req-50c6c088-154f-4f48-b839-f4d3f4f3d7b6 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lazy-loading 'fault' on Instance uuid 675b6625-928e-45e6-bb51-f9a0bdfe117e {{(pid=120532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 16:25:39.554981 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-216eaa4e-efc4-4890-9c07-a2458a67e95d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:39.559306 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-216eaa4e-efc4-4890-9c07-a2458a67e95d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:39.562781 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-216eaa4e-efc4-4890-9c07-a2458a67e95d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1740 microversion: 2.20 time: 0.431213 Sep 21 16:25:39.566389 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 154/343] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:25:39 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1740 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:25:39.638886 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-50c6c088-154f-4f48-b839-f4d3f4f3d7b6 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:39.668373 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-50c6c088-154f-4f48-b839-f4d3f4f3d7b6 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e" status: 200 len: 1303 microversion: 2.1 time: 0.365226 Sep 21 16:25:39.675349 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 190/344] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:39 2022] GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e => generated 1303 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:40.020870 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-dce4c9c7-4607-4cae-bfb7-36ea0a6a39d7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:40.021504 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-dce4c9c7-4607-4cae-bfb7-36ea0a6a39d7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:40.046279 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dce4c9c7-4607-4cae-bfb7-36ea0a6a39d7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:40.047035 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dce4c9c7-4607-4cae-bfb7-36ea0a6a39d7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:40.051682 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dce4c9c7-4607-4cae-bfb7-36ea0a6a39d7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:40.052934 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dce4c9c7-4607-4cae-bfb7-36ea0a6a39d7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:40.053758 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dce4c9c7-4607-4cae-bfb7-36ea0a6a39d7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:40.053972 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dce4c9c7-4607-4cae-bfb7-36ea0a6a39d7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:40.140136 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-95ee656c-fc18-4db9-b53c-8cc0c75f4364 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:40.140748 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-95ee656c-fc18-4db9-b53c-8cc0c75f4364 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] [instance: a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:40.148794 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-95ee656c-fc18-4db9-b53c-8cc0c75f4364 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:40.149285 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-95ee656c-fc18-4db9-b53c-8cc0c75f4364 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:40.149722 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-95ee656c-fc18-4db9-b53c-8cc0c75f4364 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:40.150474 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-95ee656c-fc18-4db9-b53c-8cc0c75f4364 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:40.150930 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-95ee656c-fc18-4db9-b53c-8cc0c75f4364 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:40.151350 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-95ee656c-fc18-4db9-b53c-8cc0c75f4364 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:40.555254 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-95ee656c-fc18-4db9-b53c-8cc0c75f4364 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d1610491ba481e80f3e8cccfea3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5ebe21fe434bc3ad5ab4354c52fcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:40.603564 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-95ee656c-fc18-4db9-b53c-8cc0c75f4364 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] 10.222.0.64 "GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319" status: 200 len: 1471 microversion: 2.1 time: 0.469501 Sep 21 16:25:40.614810 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 191/345] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:40 2022] GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 => generated 1471 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:40.662516 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-10a0f6bb-6fea-431f-ab56-dfacbbe81e74 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:40.667512 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-10a0f6bb-6fea-431f-ab56-dfacbbe81e74 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:40.717251 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-10a0f6bb-6fea-431f-ab56-dfacbbe81e74 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:40.718860 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-10a0f6bb-6fea-431f-ab56-dfacbbe81e74 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:40.723754 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-10a0f6bb-6fea-431f-ab56-dfacbbe81e74 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:40.730395 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-10a0f6bb-6fea-431f-ab56-dfacbbe81e74 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:40.731824 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-10a0f6bb-6fea-431f-ab56-dfacbbe81e74 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:40.739036 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-10a0f6bb-6fea-431f-ab56-dfacbbe81e74 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:40.810279 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-dce4c9c7-4607-4cae-bfb7-36ea0a6a39d7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:40.840224 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-dce4c9c7-4607-4cae-bfb7-36ea0a6a39d7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 200 len: 1510 microversion: 2.1 time: 0.825775 Sep 21 16:25:40.846306 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 155/346] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:40 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 1510 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:40.862797 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-7ba792e8-0efe-44d9-953c-0b56114a458b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:40.863411 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-7ba792e8-0efe-44d9-953c-0b56114a458b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:40.879960 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7ba792e8-0efe-44d9-953c-0b56114a458b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:40.880853 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7ba792e8-0efe-44d9-953c-0b56114a458b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:40.881510 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7ba792e8-0efe-44d9-953c-0b56114a458b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:40.884256 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7ba792e8-0efe-44d9-953c-0b56114a458b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:40.885120 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7ba792e8-0efe-44d9-953c-0b56114a458b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:40.885777 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7ba792e8-0efe-44d9-953c-0b56114a458b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:41.317831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-10a0f6bb-6fea-431f-ab56-dfacbbe81e74 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:41.357184 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-10a0f6bb-6fea-431f-ab56-dfacbbe81e74 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1724 microversion: 2.1 time: 0.721655 Sep 21 16:25:41.358636 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 192/347] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:40 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1724 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:41.378543 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-df779212-907e-4b7f-9b57-8161ebc0c5a4 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:41.386917 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-df779212-907e-4b7f-9b57-8161ebc0c5a4 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 675b6625-928e-45e6-bb51-f9a0bdfe117e] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:41.412600 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-df779212-907e-4b7f-9b57-8161ebc0c5a4 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:41.413467 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-df779212-907e-4b7f-9b57-8161ebc0c5a4 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:41.414319 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-df779212-907e-4b7f-9b57-8161ebc0c5a4 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:41.415597 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-df779212-907e-4b7f-9b57-8161ebc0c5a4 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:41.416431 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-df779212-907e-4b7f-9b57-8161ebc0c5a4 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:41.417201 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-df779212-907e-4b7f-9b57-8161ebc0c5a4 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:41.516708 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-7ba792e8-0efe-44d9-953c-0b56114a458b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:41.567259 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-7ba792e8-0efe-44d9-953c-0b56114a458b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:41.569790 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-7ba792e8-0efe-44d9-953c-0b56114a458b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:41.579297 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-7ba792e8-0efe-44d9-953c-0b56114a458b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1740 microversion: 2.20 time: 0.731641 Sep 21 16:25:41.581933 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 156/348] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:25:40 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1740 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:25:41.670839 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-2439c92e-86b1-41b2-a40e-14e6527cd244 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:41.681321 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-df779212-907e-4b7f-9b57-8161ebc0c5a4 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:41.682709 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-2439c92e-86b1-41b2-a40e-14e6527cd244 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] [instance: a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:41.684142 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-df779212-907e-4b7f-9b57-8161ebc0c5a4 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:41.690070 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-df779212-907e-4b7f-9b57-8161ebc0c5a4 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:41.692798 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_api:SELECT=88 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:41.693417 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.objects.instance [None req-df779212-907e-4b7f-9b57-8161ebc0c5a4 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lazy-loading 'fault' on Instance uuid 675b6625-928e-45e6-bb51-f9a0bdfe117e {{(pid=120532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 16:25:41.726512 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2439c92e-86b1-41b2-a40e-14e6527cd244 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:41.726512 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2439c92e-86b1-41b2-a40e-14e6527cd244 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:41.730147 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2439c92e-86b1-41b2-a40e-14e6527cd244 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:41.734965 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2439c92e-86b1-41b2-a40e-14e6527cd244 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:41.736998 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2439c92e-86b1-41b2-a40e-14e6527cd244 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:41.741464 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2439c92e-86b1-41b2-a40e-14e6527cd244 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:41.886998 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-df779212-907e-4b7f-9b57-8161ebc0c5a4 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:41.890587 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:41.935098 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-df779212-907e-4b7f-9b57-8161ebc0c5a4 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e" status: 200 len: 1303 microversion: 2.1 time: 0.574466 Sep 21 16:25:41.980509 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 193/349] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:41 2022] GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e => generated 1303 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:42.003950 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-64f30d7e-0214-4e9e-9c07-e4ddda225b99 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:42.007863 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-64f30d7e-0214-4e9e-9c07-e4ddda225b99 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:42.048105 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-64f30d7e-0214-4e9e-9c07-e4ddda225b99 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:42.053419 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-64f30d7e-0214-4e9e-9c07-e4ddda225b99 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:42.057073 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-64f30d7e-0214-4e9e-9c07-e4ddda225b99 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:42.058323 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-64f30d7e-0214-4e9e-9c07-e4ddda225b99 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:42.061618 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-64f30d7e-0214-4e9e-9c07-e4ddda225b99 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:42.064475 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-64f30d7e-0214-4e9e-9c07-e4ddda225b99 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:42.275451 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-2439c92e-86b1-41b2-a40e-14e6527cd244 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d1610491ba481e80f3e8cccfea3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5ebe21fe434bc3ad5ab4354c52fcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:42.328136 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-2439c92e-86b1-41b2-a40e-14e6527cd244 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] 10.222.0.64 "GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319" status: 200 len: 1471 microversion: 2.1 time: 0.666983 Sep 21 16:25:42.347369 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 157/350] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:41 2022] GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 => generated 1471 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:25:42.401524 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-27287a15-bb22-4054-ac85-074f0626d1b3 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:42.403649 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-27287a15-bb22-4054-ac85-074f0626d1b3 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:42.461975 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-27287a15-bb22-4054-ac85-074f0626d1b3 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:42.466232 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-27287a15-bb22-4054-ac85-074f0626d1b3 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:42.466557 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-27287a15-bb22-4054-ac85-074f0626d1b3 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:42.470689 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-27287a15-bb22-4054-ac85-074f0626d1b3 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:42.473119 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-27287a15-bb22-4054-ac85-074f0626d1b3 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:42.477393 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-27287a15-bb22-4054-ac85-074f0626d1b3 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:42.587043 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-64f30d7e-0214-4e9e-9c07-e4ddda225b99 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:42.599701 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-64f30d7e-0214-4e9e-9c07-e4ddda225b99 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 200 len: 1510 microversion: 2.1 time: 0.607801 Sep 21 16:25:42.600394 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 194/351] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:41 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 1510 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:42.622073 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-18acf856-eaf2-4a98-9f01-8b4b27ccbc55 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:42.627259 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-18acf856-eaf2-4a98-9f01-8b4b27ccbc55 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:42.635989 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-18acf856-eaf2-4a98-9f01-8b4b27ccbc55 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:42.636872 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-18acf856-eaf2-4a98-9f01-8b4b27ccbc55 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:42.637588 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-18acf856-eaf2-4a98-9f01-8b4b27ccbc55 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:42.638542 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-18acf856-eaf2-4a98-9f01-8b4b27ccbc55 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:42.645495 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-18acf856-eaf2-4a98-9f01-8b4b27ccbc55 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:42.646437 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-18acf856-eaf2-4a98-9f01-8b4b27ccbc55 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:42.896409 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-27287a15-bb22-4054-ac85-074f0626d1b3 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:42.958632 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-27287a15-bb22-4054-ac85-074f0626d1b3 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1724 microversion: 2.1 time: 0.571108 Sep 21 16:25:42.963724 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 158/352] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:42 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1724 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:42.989075 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d55333a2-9d0e-46d5-b0fa-1f366b06d371 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:42.992932 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d55333a2-9d0e-46d5-b0fa-1f366b06d371 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 675b6625-928e-45e6-bb51-f9a0bdfe117e] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:43.022676 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d55333a2-9d0e-46d5-b0fa-1f366b06d371 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:43.023606 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d55333a2-9d0e-46d5-b0fa-1f366b06d371 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:43.024389 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d55333a2-9d0e-46d5-b0fa-1f366b06d371 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:43.028119 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d55333a2-9d0e-46d5-b0fa-1f366b06d371 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:43.033349 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d55333a2-9d0e-46d5-b0fa-1f366b06d371 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:43.035164 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d55333a2-9d0e-46d5-b0fa-1f366b06d371 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:43.154675 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-18acf856-eaf2-4a98-9f01-8b4b27ccbc55 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:43.165219 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d55333a2-9d0e-46d5-b0fa-1f366b06d371 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:43.168445 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d55333a2-9d0e-46d5-b0fa-1f366b06d371 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:43.172475 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d55333a2-9d0e-46d5-b0fa-1f366b06d371 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:43.173593 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.objects.instance [None req-d55333a2-9d0e-46d5-b0fa-1f366b06d371 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lazy-loading 'fault' on Instance uuid 675b6625-928e-45e6-bb51-f9a0bdfe117e {{(pid=120531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 16:25:43.182603 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-18acf856-eaf2-4a98-9f01-8b4b27ccbc55 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:43.186915 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-18acf856-eaf2-4a98-9f01-8b4b27ccbc55 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:43.197974 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-18acf856-eaf2-4a98-9f01-8b4b27ccbc55 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1740 microversion: 2.20 time: 0.572028 Sep 21 16:25:43.215917 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 195/353] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:25:42 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1740 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:25:43.301391 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d55333a2-9d0e-46d5-b0fa-1f366b06d371 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:43.335907 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d55333a2-9d0e-46d5-b0fa-1f366b06d371 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e" status: 200 len: 1303 microversion: 2.1 time: 0.356612 Sep 21 16:25:43.339211 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 159/354] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:42 2022] GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e => generated 1303 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:43.392877 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-5df54787-8088-47eb-95fe-1fd011c9ef7d tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:43.394157 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-5df54787-8088-47eb-95fe-1fd011c9ef7d tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] [instance: a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:43.427104 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5df54787-8088-47eb-95fe-1fd011c9ef7d tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:43.427912 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5df54787-8088-47eb-95fe-1fd011c9ef7d tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:43.428468 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5df54787-8088-47eb-95fe-1fd011c9ef7d tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:43.429625 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5df54787-8088-47eb-95fe-1fd011c9ef7d tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:43.431255 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5df54787-8088-47eb-95fe-1fd011c9ef7d tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:43.431874 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5df54787-8088-47eb-95fe-1fd011c9ef7d tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:43.632823 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-b04d9d17-f5e6-4718-b3dc-024622bb9e91 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:43.637235 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-b04d9d17-f5e6-4718-b3dc-024622bb9e91 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:43.668696 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b04d9d17-f5e6-4718-b3dc-024622bb9e91 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:43.679079 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b04d9d17-f5e6-4718-b3dc-024622bb9e91 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:43.680336 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b04d9d17-f5e6-4718-b3dc-024622bb9e91 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:43.684575 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b04d9d17-f5e6-4718-b3dc-024622bb9e91 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:43.687827 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b04d9d17-f5e6-4718-b3dc-024622bb9e91 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:43.705166 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b04d9d17-f5e6-4718-b3dc-024622bb9e91 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:43.997600 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5df54787-8088-47eb-95fe-1fd011c9ef7d tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d1610491ba481e80f3e8cccfea3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5ebe21fe434bc3ad5ab4354c52fcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:44.019743 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-5df54787-8088-47eb-95fe-1fd011c9ef7d tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] 10.222.0.64 "GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319" status: 200 len: 1471 microversion: 2.1 time: 0.644442 Sep 21 16:25:44.030140 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 196/355] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:43 2022] GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 => generated 1471 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:44.031729 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-93c6be8a-6fd3-4c31-aa61-a6a91ff54796 req-239ab63e-1312-498a-be0c-e4fea1949b99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319", "name": "network-vif-unplugged", "status": "completed", "tag": "5c01e8b8-28e9-4871-a0aa-f752eae1c0e4"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:25:44.089910 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-93c6be8a-6fd3-4c31-aa61-a6a91ff54796 req-239ab63e-1312-498a-be0c-e4fea1949b99 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:44.095002 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-93c6be8a-6fd3-4c31-aa61-a6a91ff54796 req-239ab63e-1312-498a-be0c-e4fea1949b99 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:44.095996 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-93c6be8a-6fd3-4c31-aa61-a6a91ff54796 req-239ab63e-1312-498a-be0c-e4fea1949b99 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:44.144083 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-93c6be8a-6fd3-4c31-aa61-a6a91ff54796 req-239ab63e-1312-498a-be0c-e4fea1949b99 service nova] Creating event network-vif-unplugged:5c01e8b8-28e9-4871-a0aa-f752eae1c0e4 for instance a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 on hv-cinder-85862 Sep 21 16:25:44.156337 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-93c6be8a-6fd3-4c31-aa61-a6a91ff54796 req-239ab63e-1312-498a-be0c-e4fea1949b99 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.132571 Sep 21 16:25:44.158742 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 197/356] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:25:44.167672 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-0ac5727c-3864-4f90-8219-ff1c0590ed6c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:44.180098 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-0ac5727c-3864-4f90-8219-ff1c0590ed6c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:44.190284 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0ac5727c-3864-4f90-8219-ff1c0590ed6c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:44.191418 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0ac5727c-3864-4f90-8219-ff1c0590ed6c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:44.192161 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0ac5727c-3864-4f90-8219-ff1c0590ed6c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:44.193674 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0ac5727c-3864-4f90-8219-ff1c0590ed6c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:44.195465 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0ac5727c-3864-4f90-8219-ff1c0590ed6c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:44.196496 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0ac5727c-3864-4f90-8219-ff1c0590ed6c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:44.215547 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-b04d9d17-f5e6-4718-b3dc-024622bb9e91 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:44.251890 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-b04d9d17-f5e6-4718-b3dc-024622bb9e91 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 200 len: 1510 microversion: 2.1 time: 0.629868 Sep 21 16:25:44.252795 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 160/357] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:43 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 1510 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:44.297798 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-7f60b16c-ded8-4dd2-a93d-950837a71da3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:44.298801 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-7f60b16c-ded8-4dd2-a93d-950837a71da3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:44.314214 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7f60b16c-ded8-4dd2-a93d-950837a71da3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:44.315030 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7f60b16c-ded8-4dd2-a93d-950837a71da3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:44.315222 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7f60b16c-ded8-4dd2-a93d-950837a71da3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:44.318907 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7f60b16c-ded8-4dd2-a93d-950837a71da3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:44.320005 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7f60b16c-ded8-4dd2-a93d-950837a71da3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:44.321734 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7f60b16c-ded8-4dd2-a93d-950837a71da3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:44.366285 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:44.435864 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-0ac5727c-3864-4f90-8219-ff1c0590ed6c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:44.473098 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-0ac5727c-3864-4f90-8219-ff1c0590ed6c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1724 microversion: 2.1 time: 0.312709 Sep 21 16:25:44.479597 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 198/358] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:44 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1724 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:44.497281 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-8a1be8d2-ea91-48b8-a01d-d7659ad0b46f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:44.513303 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-8a1be8d2-ea91-48b8-a01d-d7659ad0b46f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 675b6625-928e-45e6-bb51-f9a0bdfe117e] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:44.528064 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8a1be8d2-ea91-48b8-a01d-d7659ad0b46f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:44.531382 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8a1be8d2-ea91-48b8-a01d-d7659ad0b46f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:44.532093 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8a1be8d2-ea91-48b8-a01d-d7659ad0b46f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:44.536592 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8a1be8d2-ea91-48b8-a01d-d7659ad0b46f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:44.537310 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8a1be8d2-ea91-48b8-a01d-d7659ad0b46f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:44.538272 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8a1be8d2-ea91-48b8-a01d-d7659ad0b46f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:44.635149 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8a1be8d2-ea91-48b8-a01d-d7659ad0b46f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:44.640437 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8a1be8d2-ea91-48b8-a01d-d7659ad0b46f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:44.641389 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8a1be8d2-ea91-48b8-a01d-d7659ad0b46f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:44.646149 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.objects.instance [None req-8a1be8d2-ea91-48b8-a01d-d7659ad0b46f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lazy-loading 'fault' on Instance uuid 675b6625-928e-45e6-bb51-f9a0bdfe117e {{(pid=120532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 16:25:44.732568 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-8a1be8d2-ea91-48b8-a01d-d7659ad0b46f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415e8845ba8d46cc9dc939ef4556e865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97c0b8a086b046ddb2b2d475124dc692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:44.743995 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-8a1be8d2-ea91-48b8-a01d-d7659ad0b46f tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e" status: 200 len: 1303 microversion: 2.1 time: 0.253159 Sep 21 16:25:44.764439 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 199/359] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:44 2022] GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e => generated 1303 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:45.053742 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-cc216ad0-9c74-4136-8acf-d5120d9c03b1 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:45.055258 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-cc216ad0-9c74-4136-8acf-d5120d9c03b1 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] [instance: a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:45.080996 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cc216ad0-9c74-4136-8acf-d5120d9c03b1 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:45.091227 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cc216ad0-9c74-4136-8acf-d5120d9c03b1 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:45.092105 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cc216ad0-9c74-4136-8acf-d5120d9c03b1 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:45.093834 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cc216ad0-9c74-4136-8acf-d5120d9c03b1 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:45.095083 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cc216ad0-9c74-4136-8acf-d5120d9c03b1 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:45.096248 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cc216ad0-9c74-4136-8acf-d5120d9c03b1 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:45.301069 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-7f60b16c-ded8-4dd2-a93d-950837a71da3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:45.341803 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-7f60b16c-ded8-4dd2-a93d-950837a71da3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:45.355066 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-7f60b16c-ded8-4dd2-a93d-950837a71da3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:45.371788 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-7f60b16c-ded8-4dd2-a93d-950837a71da3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1740 microversion: 2.20 time: 1.068542 Sep 21 16:25:45.373343 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 161/360] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:25:44 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1740 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 16:25:45.398312 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-e3d4ca04-c67f-496b-a3d3-120f5fa47f41 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:45.408697 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-e3d4ca04-c67f-496b-a3d3-120f5fa47f41 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:45.444638 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e3d4ca04-c67f-496b-a3d3-120f5fa47f41 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:45.448276 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e3d4ca04-c67f-496b-a3d3-120f5fa47f41 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:45.468359 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e3d4ca04-c67f-496b-a3d3-120f5fa47f41 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:45.469681 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e3d4ca04-c67f-496b-a3d3-120f5fa47f41 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:45.470528 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e3d4ca04-c67f-496b-a3d3-120f5fa47f41 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:45.471737 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e3d4ca04-c67f-496b-a3d3-120f5fa47f41 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:45.818613 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-cc216ad0-9c74-4136-8acf-d5120d9c03b1 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d1610491ba481e80f3e8cccfea3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5ebe21fe434bc3ad5ab4354c52fcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:45.855836 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-cc216ad0-9c74-4136-8acf-d5120d9c03b1 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] 10.222.0.64 "GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319" status: 200 len: 1471 microversion: 2.1 time: 0.811091 Sep 21 16:25:45.858277 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 200/361] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:45 2022] GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 => generated 1471 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:25:45.870698 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ae795b1a-0ab5-4576-89ba-d0de8858b323 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:45.873256 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ae795b1a-0ab5-4576-89ba-d0de8858b323 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:45.889348 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ae795b1a-0ab5-4576-89ba-d0de8858b323 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:45.890547 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ae795b1a-0ab5-4576-89ba-d0de8858b323 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:45.891702 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ae795b1a-0ab5-4576-89ba-d0de8858b323 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:45.895386 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ae795b1a-0ab5-4576-89ba-d0de8858b323 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:45.896130 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ae795b1a-0ab5-4576-89ba-d0de8858b323 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:45.897419 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ae795b1a-0ab5-4576-89ba-d0de8858b323 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:46.304779 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ae795b1a-0ab5-4576-89ba-d0de8858b323 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:46.320972 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ae795b1a-0ab5-4576-89ba-d0de8858b323 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1724 microversion: 2.1 time: 0.461128 Sep 21 16:25:46.322216 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 201/362] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:45 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1724 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:46.329738 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-4e845c9a-2a43-4239-8b8b-642e61b27265 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:46.335130 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-4e845c9a-2a43-4239-8b8b-642e61b27265 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] [instance: 675b6625-928e-45e6-bb51-f9a0bdfe117e] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:46.352769 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-e3d4ca04-c67f-496b-a3d3-120f5fa47f41 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:46.363970 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4e845c9a-2a43-4239-8b8b-642e61b27265 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:46.369879 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4e845c9a-2a43-4239-8b8b-642e61b27265 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:46.371811 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-e3d4ca04-c67f-496b-a3d3-120f5fa47f41 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 200 len: 1510 microversion: 2.1 time: 0.996638 Sep 21 16:25:46.372605 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4e845c9a-2a43-4239-8b8b-642e61b27265 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:46.373594 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4e845c9a-2a43-4239-8b8b-642e61b27265 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:46.374485 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 162/363] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:45 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 1510 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:46.375213 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4e845c9a-2a43-4239-8b8b-642e61b27265 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:46.379609 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4e845c9a-2a43-4239-8b8b-642e61b27265 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:46.404904 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.wsgi [None req-4e845c9a-2a43-4239-8b8b-642e61b27265 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] HTTP exception thrown: Instance 675b6625-928e-45e6-bb51-f9a0bdfe117e could not be found. Sep 21 16:25:46.410306 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-4e845c9a-2a43-4239-8b8b-642e61b27265 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Request method failure captured: Sep 21 16:25:46.410306 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: request: GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e HTTP/1.1 Sep 21 16:25:46.410306 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept: application/json Sep 21 16:25:46.410306 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept-Encoding: identity Sep 21 16:25:46.410306 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Connection: close Sep 21 16:25:46.410306 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Length: 0 Sep 21 16:25:46.410306 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Type: application/json Sep 21 16:25:46.410306 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Host: 10.222.0.64 Sep 21 16:25:46.410306 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Openstack-System-Scope: None Sep 21 16:25:46.410306 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: User-Agent: python-urllib3/1.26.12 Sep 21 16:25:46.410306 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Auth-Token: gAAAAABjKzq--G33FaFUyKLhKKEwxvN_9M6T__jBOIoQnwlPtjZrOScRW0J32PplQ1W23HmMWKoCyX3KYzuCl4SUVLXY_Wl_79O80qDzHhxDA6O3CFCU7vJPusiH-4AGl7gOmmwgOjmvK5HebeXqfO0PW2NOrqtb0Hav_bsAhblfH25H_4KZ1fM Sep 21 16:25:46.410306 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Id: None Sep 21 16:25:46.410306 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Name: None Sep 21 16:25:46.410306 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Identity-Status: Confirmed Sep 21 16:25:46.410306 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Is-Admin-Project: True Sep 21 16:25:46.410306 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Id: default Sep 21 16:25:46.410306 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Name: Default Sep 21 16:25:46.410306 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Id: 97c0b8a086b046ddb2b2d475124dc692 Sep 21 16:25:46.410306 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Name: tempest-VolumesActionsTest-181559012 Sep 21 16:25:46.410306 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Role: member,reader Sep 21 16:25:46.410306 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Roles: member,reader Sep 21 16:25:46.411720 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/97c0b8a086b046ddb2b2d475124dc692"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/97c0b8a086b046ddb2b2d475124dc692"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_97c0b8a086b046ddb2b2d475124dc692"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/97c0b8a086b046ddb2b2d475124dc692"}]}] Sep 21 16:25:46.411720 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant: tempest-VolumesActionsTest-181559012 Sep 21 16:25:46.411720 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Id: 97c0b8a086b046ddb2b2d475124dc692 Sep 21 16:25:46.411720 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Name: tempest-VolumesActionsTest-181559012 Sep 21 16:25:46.411720 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User: tempest-VolumesActionsTest-181559012-project Sep 21 16:25:46.411720 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Id: default Sep 21 16:25:46.411720 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Name: Default Sep 21 16:25:46.411720 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Id: 415e8845ba8d46cc9dc939ef4556e865 Sep 21 16:25:46.411720 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Name: tempest-VolumesActionsTest-181559012-project Sep 21 16:25:46.411720 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: method: > Sep 21 16:25:46.411720 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: exception: Instance 675b6625-928e-45e6-bb51-f9a0bdfe117e could not be found. Sep 21 16:25:46.411720 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: action_args: {'id': '675b6625-928e-45e6-bb51-f9a0bdfe117e'} Sep 21 16:25:46.412488 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:25:46.412488 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:25:46.412488 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 16:25:46.412488 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 16:25:46.412488 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 16:25:46.412488 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 16:25:46.412488 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 16:25:46.412488 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 16:25:46.412488 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 16:25:46.412488 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 16:25:46.412488 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 675b6625-928e-45e6-bb51-f9a0bdfe117e could not be found. Sep 21 16:25:46.412488 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:25:46.412488 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:25:46.412488 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:25:46.412488 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:25:46.412488 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:25:46.412488 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:25:46.412488 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:25:46.412488 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:25:46.412488 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:25:46.413677 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:25:46.413677 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 16:25:46.413677 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 16:25:46.413677 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 16:25:46.413677 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 16:25:46.413677 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 16:25:46.413677 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:25:46.413677 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 675b6625-928e-45e6-bb51-f9a0bdfe117e could not be found. Sep 21 16:25:46.413677 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:25:46.413677 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:25:46.413677 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:25:46.413677 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:25:46.413677 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:25:46.413677 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:25:46.413677 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:25:46.413677 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:25:46.413677 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 675b6625-928e-45e6-bb51-f9a0bdfe117e could not be found. Sep 21 16:25:46.413677 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:25:46.426164 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-4e845c9a-2a43-4239-8b8b-642e61b27265 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] Returning 404 to user: Instance 675b6625-928e-45e6-bb51-f9a0bdfe117e could not be found. {{(pid=120532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:25:46.433439 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-90ff0d90-d7c4-42f9-bf49-49d238287cfa tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:46.434585 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-90ff0d90-d7c4-42f9-bf49-49d238287cfa tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:46.438419 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-4e845c9a-2a43-4239-8b8b-642e61b27265 tempest-VolumesActionsTest-181559012 tempest-VolumesActionsTest-181559012-project] 10.222.0.64 "GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e" status: 404 len: 111 microversion: 2.1 time: 0.114801 Sep 21 16:25:46.442439 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 202/364] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:46 2022] GET /compute/v2.1/servers/675b6625-928e-45e6-bb51-f9a0bdfe117e => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 16:25:46.447875 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-90ff0d90-d7c4-42f9-bf49-49d238287cfa tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:46.448772 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-90ff0d90-d7c4-42f9-bf49-49d238287cfa tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:46.449463 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-90ff0d90-d7c4-42f9-bf49-49d238287cfa tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:46.450450 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-90ff0d90-d7c4-42f9-bf49-49d238287cfa tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:46.452243 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-90ff0d90-d7c4-42f9-bf49-49d238287cfa tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:46.454235 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-90ff0d90-d7c4-42f9-bf49-49d238287cfa tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:46.716418 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-105a24a4-0051-414f-9fa5-f4b8de5e3f25 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Action: 'create', calling method: .version_select at 0x7fdb88d5cb80>, body: {"keypair": {"name": "tempest-keypair-30027367", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7UwZIyoomw38DpLu3iCKpGZ0IP+fMKeqddvLalu3eYt5SsaC/zZR7JSirltO9lRVNVk/X7pTHK1anlGIscGMNFT2DscCu5zVKz89gm4snq8HQNJGAIgoQjxkt9Ijv8VQ=="}} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:25:46.755964 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.quota [None req-105a24a4-0051-414f-9fa5-f4b8de5e3f25 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Getting quotas for project ce7a3e77ddf14b48986752434dda6d33. Resources: {'key_pairs'} {{(pid=120532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 16:25:46.771649 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.quota [None req-105a24a4-0051-414f-9fa5-f4b8de5e3f25 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Getting quotas for user b917d84a650f4355a676e315ea039f0e and project ce7a3e77ddf14b48986752434dda6d33. Resources: {'key_pairs'} {{(pid=120532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 16:25:46.866272 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-105a24a4-0051-414f-9fa5-f4b8de5e3f25 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.153539 Sep 21 16:25:46.868328 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 203/365] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Sep 21 16:25:46 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:25:46.896177 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-9b888c3b-8e34-44cd-9d75-3409a3278596 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:46.897337 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-9b888c3b-8e34-44cd-9d75-3409a3278596 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] [instance: a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:46.926113 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9b888c3b-8e34-44cd-9d75-3409a3278596 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:46.932232 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9b888c3b-8e34-44cd-9d75-3409a3278596 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:46.933412 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9b888c3b-8e34-44cd-9d75-3409a3278596 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:46.934516 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9b888c3b-8e34-44cd-9d75-3409a3278596 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:46.935090 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9b888c3b-8e34-44cd-9d75-3409a3278596 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:46.935897 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9b888c3b-8e34-44cd-9d75-3409a3278596 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:47.547336 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-9b888c3b-8e34-44cd-9d75-3409a3278596 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d1610491ba481e80f3e8cccfea3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5ebe21fe434bc3ad5ab4354c52fcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:47.570449 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-9b888c3b-8e34-44cd-9d75-3409a3278596 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] 10.222.0.64 "GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319" status: 200 len: 1471 microversion: 2.1 time: 0.675766 Sep 21 16:25:47.571795 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 204/366] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:46 2022] GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 => generated 1471 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:47.585697 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ad262c30-93f9-46fb-98a8-f41f9c4b869f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:47.613024 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ad262c30-93f9-46fb-98a8-f41f9c4b869f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:47.674449 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ad262c30-93f9-46fb-98a8-f41f9c4b869f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:47.675146 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ad262c30-93f9-46fb-98a8-f41f9c4b869f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:47.675605 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ad262c30-93f9-46fb-98a8-f41f9c4b869f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:47.676365 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ad262c30-93f9-46fb-98a8-f41f9c4b869f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:47.676837 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ad262c30-93f9-46fb-98a8-f41f9c4b869f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:47.677264 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ad262c30-93f9-46fb-98a8-f41f9c4b869f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:47.901673 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-90ff0d90-d7c4-42f9-bf49-49d238287cfa tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:47.917182 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-90ff0d90-d7c4-42f9-bf49-49d238287cfa tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:47.918727 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-90ff0d90-d7c4-42f9-bf49-49d238287cfa tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:47.919930 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-90ff0d90-d7c4-42f9-bf49-49d238287cfa tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1740 microversion: 2.20 time: 1.491281 Sep 21 16:25:47.940915 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 163/367] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:25:46 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1740 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:25:47.949077 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-92a26e9b-f5e4-4d29-944e-15f001e95e72 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:47.949716 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-92a26e9b-f5e4-4d29-944e-15f001e95e72 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:47.996454 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-92a26e9b-f5e4-4d29-944e-15f001e95e72 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:48.006871 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-92a26e9b-f5e4-4d29-944e-15f001e95e72 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:48.007330 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-92a26e9b-f5e4-4d29-944e-15f001e95e72 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:48.008105 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-92a26e9b-f5e4-4d29-944e-15f001e95e72 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:48.008570 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-92a26e9b-f5e4-4d29-944e-15f001e95e72 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:48.008993 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-92a26e9b-f5e4-4d29-944e-15f001e95e72 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:48.256621 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ad262c30-93f9-46fb-98a8-f41f9c4b869f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:48.273080 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ad262c30-93f9-46fb-98a8-f41f9c4b869f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1724 microversion: 2.1 time: 0.692666 Sep 21 16:25:48.273516 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 205/368] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:47 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1724 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:48.425612 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-18806597-14c6-4d25-a1ba-c36bec5cf62a req-7cc7fc3b-be34-4f31-be61-31caa5c1a0e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319", "name": "network-vif-deleted", "tag": "5c01e8b8-28e9-4871-a0aa-f752eae1c0e4"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:25:48.458363 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-18806597-14c6-4d25-a1ba-c36bec5cf62a req-7cc7fc3b-be34-4f31-be61-31caa5c1a0e9 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:48.472695 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-18806597-14c6-4d25-a1ba-c36bec5cf62a req-7cc7fc3b-be34-4f31-be61-31caa5c1a0e9 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:48.475111 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-18806597-14c6-4d25-a1ba-c36bec5cf62a req-7cc7fc3b-be34-4f31-be61-31caa5c1a0e9 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:48.512114 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-92a26e9b-f5e4-4d29-944e-15f001e95e72 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:48.543658 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-92a26e9b-f5e4-4d29-944e-15f001e95e72 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 200 len: 1510 microversion: 2.1 time: 0.610479 Sep 21 16:25:48.551163 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 164/369] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:47 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 1510 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:48.578962 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-18806597-14c6-4d25-a1ba-c36bec5cf62a req-7cc7fc3b-be34-4f31-be61-31caa5c1a0e9 service nova] Creating event network-vif-deleted:5c01e8b8-28e9-4871-a0aa-f752eae1c0e4 for instance a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 on hv-cinder-85862 Sep 21 16:25:48.607165 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d2d4fdc9-ed04-4c8f-af17-f10236fa6e78 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:48.608226 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d2d4fdc9-ed04-4c8f-af17-f10236fa6e78 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] [instance: a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:48.624752 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-18806597-14c6-4d25-a1ba-c36bec5cf62a req-7cc7fc3b-be34-4f31-be61-31caa5c1a0e9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210625 Sep 21 16:25:48.632658 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 206/370] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:25:48.633009 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d2d4fdc9-ed04-4c8f-af17-f10236fa6e78 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:48.634261 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d2d4fdc9-ed04-4c8f-af17-f10236fa6e78 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:48.635079 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d2d4fdc9-ed04-4c8f-af17-f10236fa6e78 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:48.641421 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d2d4fdc9-ed04-4c8f-af17-f10236fa6e78 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:48.645011 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d2d4fdc9-ed04-4c8f-af17-f10236fa6e78 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:48.645725 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d2d4fdc9-ed04-4c8f-af17-f10236fa6e78 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:48.863183 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d2d4fdc9-ed04-4c8f-af17-f10236fa6e78 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d1610491ba481e80f3e8cccfea3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5ebe21fe434bc3ad5ab4354c52fcdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:48.876911 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d2d4fdc9-ed04-4c8f-af17-f10236fa6e78 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] 10.222.0.64 "GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319" status: 200 len: 1300 microversion: 2.1 time: 0.275563 Sep 21 16:25:48.878185 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 165/371] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:48 2022] GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 => generated 1300 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:25:48.952779 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-cfd2000a-5936-4abb-8ec8-92c468273f6a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:48.954335 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-cfd2000a-5936-4abb-8ec8-92c468273f6a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:48.972584 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cfd2000a-5936-4abb-8ec8-92c468273f6a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:48.977180 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cfd2000a-5936-4abb-8ec8-92c468273f6a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:48.978745 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cfd2000a-5936-4abb-8ec8-92c468273f6a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:48.981333 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cfd2000a-5936-4abb-8ec8-92c468273f6a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:48.982306 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cfd2000a-5936-4abb-8ec8-92c468273f6a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:48.987176 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cfd2000a-5936-4abb-8ec8-92c468273f6a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:49.305151 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-4b147ea6-ac06-4765-a25e-482cb1653a38 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:49.305957 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-4b147ea6-ac06-4765-a25e-482cb1653a38 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:49.317579 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4b147ea6-ac06-4765-a25e-482cb1653a38 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:49.318194 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4b147ea6-ac06-4765-a25e-482cb1653a38 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:49.318649 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4b147ea6-ac06-4765-a25e-482cb1653a38 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:49.319420 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4b147ea6-ac06-4765-a25e-482cb1653a38 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:49.320164 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4b147ea6-ac06-4765-a25e-482cb1653a38 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:49.334458 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4b147ea6-ac06-4765-a25e-482cb1653a38 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:50.063394 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-cfd2000a-5936-4abb-8ec8-92c468273f6a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:50.063394 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-cfd2000a-5936-4abb-8ec8-92c468273f6a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:50.063918 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-cfd2000a-5936-4abb-8ec8-92c468273f6a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:50.064223 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-cfd2000a-5936-4abb-8ec8-92c468273f6a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1740 microversion: 2.20 time: 1.116317 Sep 21 16:25:50.065595 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 207/372] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:25:48 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1740 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:25:50.079870 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-0898816a-87c6-473d-8192-8d5f1842f44e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:50.080830 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-0898816a-87c6-473d-8192-8d5f1842f44e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:50.099977 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0898816a-87c6-473d-8192-8d5f1842f44e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:50.100925 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0898816a-87c6-473d-8192-8d5f1842f44e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:50.101847 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0898816a-87c6-473d-8192-8d5f1842f44e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:50.102798 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0898816a-87c6-473d-8192-8d5f1842f44e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:50.103650 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0898816a-87c6-473d-8192-8d5f1842f44e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:50.106151 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0898816a-87c6-473d-8192-8d5f1842f44e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:50.295560 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-4b147ea6-ac06-4765-a25e-482cb1653a38 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:50.323342 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-4b147ea6-ac06-4765-a25e-482cb1653a38 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1724 microversion: 2.1 time: 1.019249 Sep 21 16:25:50.338900 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 166/373] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:49 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1724 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:25:50.352727 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-6ae96d02-ed6c-4e48-9ca5-0404a45bf165 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:50.353438 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-6ae96d02-ed6c-4e48-9ca5-0404a45bf165 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] [instance: a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:50.372510 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6ae96d02-ed6c-4e48-9ca5-0404a45bf165 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:50.380758 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6ae96d02-ed6c-4e48-9ca5-0404a45bf165 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:50.381571 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6ae96d02-ed6c-4e48-9ca5-0404a45bf165 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:50.382793 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6ae96d02-ed6c-4e48-9ca5-0404a45bf165 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:50.384362 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6ae96d02-ed6c-4e48-9ca5-0404a45bf165 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:50.386902 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6ae96d02-ed6c-4e48-9ca5-0404a45bf165 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:50.443079 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.wsgi [None req-6ae96d02-ed6c-4e48-9ca5-0404a45bf165 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] HTTP exception thrown: Instance a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 could not be found. Sep 21 16:25:50.445035 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-6ae96d02-ed6c-4e48-9ca5-0404a45bf165 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Request method failure captured: Sep 21 16:25:50.445035 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: request: GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 HTTP/1.1 Sep 21 16:25:50.445035 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept: application/json Sep 21 16:25:50.445035 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept-Encoding: identity Sep 21 16:25:50.445035 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Connection: close Sep 21 16:25:50.445035 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Length: 0 Sep 21 16:25:50.445035 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Type: application/json Sep 21 16:25:50.445035 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Host: 10.222.0.64 Sep 21 16:25:50.445035 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Openstack-System-Scope: None Sep 21 16:25:50.445035 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: User-Agent: python-urllib3/1.26.12 Sep 21 16:25:50.445035 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Auth-Token: gAAAAABjKzrcSdLY9V1YfQQ3f5AvvERXW4bOeXAQAk2g1Is6EnmeQr6RulSeZ8zoicUceXNtmq09a634HGH9ndNNuKCyX1dGjo8lvcNllPdv-TDAI8pL8lb8feMD6TO5NjruxvR9aKbEliZlZgKrGeqCdvkwMyLGabdCxOD4lyYc7T1iNPmRDyE Sep 21 16:25:50.445035 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Id: None Sep 21 16:25:50.445035 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Name: None Sep 21 16:25:50.445035 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Identity-Status: Confirmed Sep 21 16:25:50.445035 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Is-Admin-Project: True Sep 21 16:25:50.445035 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Id: default Sep 21 16:25:50.445035 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Name: Default Sep 21 16:25:50.445035 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Id: de5ebe21fe434bc3ad5ab4354c52fcdb Sep 21 16:25:50.445035 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Name: tempest-VolumesNegativeTest-842181849 Sep 21 16:25:50.445035 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Role: member,reader Sep 21 16:25:50.445035 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Roles: member,reader Sep 21 16:25:50.446640 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/de5ebe21fe434bc3ad5ab4354c52fcdb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/de5ebe21fe434bc3ad5ab4354c52fcdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_de5ebe21fe434bc3ad5ab4354c52fcdb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/de5ebe21fe434bc3ad5ab4354c52fcdb"}]}] Sep 21 16:25:50.446640 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant: tempest-VolumesNegativeTest-842181849 Sep 21 16:25:50.446640 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Id: de5ebe21fe434bc3ad5ab4354c52fcdb Sep 21 16:25:50.446640 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Name: tempest-VolumesNegativeTest-842181849 Sep 21 16:25:50.446640 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User: tempest-VolumesNegativeTest-842181849-project Sep 21 16:25:50.446640 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Id: default Sep 21 16:25:50.446640 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Name: Default Sep 21 16:25:50.446640 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Id: 22d1610491ba481e80f3e8cccfea3aa1 Sep 21 16:25:50.446640 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Name: tempest-VolumesNegativeTest-842181849-project Sep 21 16:25:50.446640 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: method: > Sep 21 16:25:50.446640 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: exception: Instance a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 could not be found. Sep 21 16:25:50.446640 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: action_args: {'id': 'a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319'} Sep 21 16:25:50.447548 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:25:50.447548 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:25:50.447548 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 16:25:50.447548 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 16:25:50.447548 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 16:25:50.447548 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 16:25:50.447548 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 16:25:50.447548 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 16:25:50.447548 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 16:25:50.447548 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 16:25:50.447548 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 could not be found. Sep 21 16:25:50.447548 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:25:50.447548 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:25:50.447548 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:25:50.447548 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:25:50.447548 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:25:50.447548 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:25:50.447548 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:25:50.447548 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:25:50.447548 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:25:50.448872 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:25:50.448872 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 16:25:50.448872 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 16:25:50.448872 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 16:25:50.448872 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 16:25:50.448872 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 16:25:50.448872 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:25:50.448872 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 could not be found. Sep 21 16:25:50.448872 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:25:50.448872 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:25:50.448872 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:25:50.448872 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:25:50.448872 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:25:50.448872 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:25:50.448872 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:25:50.448872 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:25:50.448872 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 could not be found. Sep 21 16:25:50.448872 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:25:50.451839 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-6ae96d02-ed6c-4e48-9ca5-0404a45bf165 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] Returning 404 to user: Instance a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 could not be found. {{(pid=120531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:25:50.453039 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-6ae96d02-ed6c-4e48-9ca5-0404a45bf165 tempest-VolumesNegativeTest-842181849 tempest-VolumesNegativeTest-842181849-project] 10.222.0.64 "GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319" status: 404 len: 111 microversion: 2.1 time: 0.113026 Sep 21 16:25:50.455858 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 167/374] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:50 2022] GET /compute/v2.1/servers/a1bddc3b-dcb2-4ca3-8fa4-4a9f6dea7319 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 16:25:50.740996 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-0898816a-87c6-473d-8192-8d5f1842f44e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:50.761762 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-0898816a-87c6-473d-8192-8d5f1842f44e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 200 len: 1516 microversion: 2.1 time: 0.687629 Sep 21 16:25:50.767858 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 208/375] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:50 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 1516 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:51.133806 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-b9aa4fe2-e818-40a4-8516-9a039436ee1c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:51.133806 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-b9aa4fe2-e818-40a4-8516-9a039436ee1c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:51.158902 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b9aa4fe2-e818-40a4-8516-9a039436ee1c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:51.159938 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b9aa4fe2-e818-40a4-8516-9a039436ee1c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:51.160712 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b9aa4fe2-e818-40a4-8516-9a039436ee1c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:51.162420 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b9aa4fe2-e818-40a4-8516-9a039436ee1c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:51.163104 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b9aa4fe2-e818-40a4-8516-9a039436ee1c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:51.163569 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b9aa4fe2-e818-40a4-8516-9a039436ee1c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:51.365953 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ed692e6b-e554-4472-abcd-c930e4a45a72 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:51.365953 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ed692e6b-e554-4472-abcd-c930e4a45a72 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:51.417821 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ed692e6b-e554-4472-abcd-c930e4a45a72 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:51.425044 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ed692e6b-e554-4472-abcd-c930e4a45a72 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:51.431000 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ed692e6b-e554-4472-abcd-c930e4a45a72 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:51.437225 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ed692e6b-e554-4472-abcd-c930e4a45a72 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:51.442515 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ed692e6b-e554-4472-abcd-c930e4a45a72 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:51.445062 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ed692e6b-e554-4472-abcd-c930e4a45a72 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:51.689995 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-b9aa4fe2-e818-40a4-8516-9a039436ee1c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:51.708849 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-b9aa4fe2-e818-40a4-8516-9a039436ee1c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:51.713990 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-b9aa4fe2-e818-40a4-8516-9a039436ee1c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:51.718575 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-b9aa4fe2-e818-40a4-8516-9a039436ee1c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1740 microversion: 2.20 time: 0.601238 Sep 21 16:25:51.722221 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 168/376] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:25:51 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1740 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:25:51.940446 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ed692e6b-e554-4472-abcd-c930e4a45a72 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:51.963964 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ed692e6b-e554-4472-abcd-c930e4a45a72 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1724 microversion: 2.1 time: 0.614154 Sep 21 16:25:51.964884 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 209/377] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:51 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1724 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:52.445954 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-3d276e6f-c925-44c2-bba3-f9bfdf127e91 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-361503464", "imageRef": "600db436-ed6c-41b7-89f7-7dd31852a1a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8e8cfcce-7266-4377-accc-1ed5295280a6"}], "security_groups": [{"name": "tempest-securitygroup--1882868000"}], "key_name": "tempest-keypair-30027367", "user_data": "}} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:25:52.760423 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ef4b3e72-f9f1-457c-ae77-25c7065bf232 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:52.761168 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ef4b3e72-f9f1-457c-ae77-25c7065bf232 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:52.772834 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:52.794481 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ef4b3e72-f9f1-457c-ae77-25c7065bf232 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:52.795741 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ef4b3e72-f9f1-457c-ae77-25c7065bf232 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:52.796743 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ef4b3e72-f9f1-457c-ae77-25c7065bf232 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:52.799681 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ef4b3e72-f9f1-457c-ae77-25c7065bf232 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:52.802249 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ef4b3e72-f9f1-457c-ae77-25c7065bf232 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:52.802927 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ef4b3e72-f9f1-457c-ae77-25c7065bf232 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:53.129675 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ef4b3e72-f9f1-457c-ae77-25c7065bf232 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:53.148399 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ef4b3e72-f9f1-457c-ae77-25c7065bf232 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:53.169351 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ef4b3e72-f9f1-457c-ae77-25c7065bf232 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:53.171234 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ef4b3e72-f9f1-457c-ae77-25c7065bf232 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1740 microversion: 2.20 time: 0.415409 Sep 21 16:25:53.181133 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 210/378] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:25:52 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1740 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:25:53.199971 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-7639cacc-2f60-4ed7-a69a-a633e8541bae tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:53.200598 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-7639cacc-2f60-4ed7-a69a-a633e8541bae tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:53.215876 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7639cacc-2f60-4ed7-a69a-a633e8541bae tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:53.216390 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7639cacc-2f60-4ed7-a69a-a633e8541bae tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:53.216837 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7639cacc-2f60-4ed7-a69a-a633e8541bae tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:53.217589 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7639cacc-2f60-4ed7-a69a-a633e8541bae tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:53.218041 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7639cacc-2f60-4ed7-a69a-a633e8541bae tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:53.218500 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7639cacc-2f60-4ed7-a69a-a633e8541bae tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:53.545176 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-7639cacc-2f60-4ed7-a69a-a633e8541bae tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:53.555733 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-7639cacc-2f60-4ed7-a69a-a633e8541bae tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1724 microversion: 2.1 time: 0.373703 Sep 21 16:25:53.556580 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 211/379] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:53 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1724 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:53.561781 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-cec9c5fe-113c-4117-a7fb-e794b23b53ee tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Action: 'create', calling method: .version_select at 0x7fdb899d6d30>, body: {"keypair": {"name": "tempest-keypair-1452663926", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKlOtsUMdzXrsBV8bjJc/2PwNdpefFUnRLEqlvQRWsdxamG0qI4dyMWRR2dr0oBmJgTG6XMsGaFKhVVjt8vwm7QaO0qy4/MmE7U9RZALpaI6VyV9IWeBFqPAPJlDhuZrSA=="}} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:25:53.579876 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.quota [None req-cec9c5fe-113c-4117-a7fb-e794b23b53ee tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Getting quotas for project b93e202a295d427a85fdaf0209951bd5. Resources: {'key_pairs'} {{(pid=120532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 16:25:53.585121 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.quota [None req-cec9c5fe-113c-4117-a7fb-e794b23b53ee tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Getting quotas for user d2382a6610ae42fa865283ed12dd9982 and project b93e202a295d427a85fdaf0209951bd5. Resources: {'key_pairs'} {{(pid=120532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 16:25:53.625779 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-cec9c5fe-113c-4117-a7fb-e794b23b53ee tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.067833 Sep 21 16:25:53.633239 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 212/380] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Sep 21 16:25:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:25:53.636081 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Exception ignored in: . at 0x7fdb88c3e8b0> Sep 21 16:25:53.636081 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Traceback (most recent call last): Sep 21 16:25:53.636081 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 488, in Sep 21 16:25:53.641164 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: and _finalize_fairy(None, rec, pool, ref, echo, True), Sep 21 16:25:53.641164 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 774, in _finalize_fairy Sep 21 16:25:53.641820 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: connection_record.checkin() Sep 21 16:25:53.641820 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 521, in checkin Sep 21 16:25:53.642316 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: pool.dispatch.checkin(connection, self) Sep 21 16:25:53.642316 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/event/attr.py", line 343, in __call__ Sep 21 16:25:53.647117 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: fn(*args, **kw) Sep 21 16:25:53.647117 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py", line 51, in _thread_yield Sep 21 16:25:53.651519 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: time.sleep(0) Sep 21 16:25:53.651519 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: File "/usr/local/lib/python3.8/dist-packages/eventlet/greenthread.py", line 33, in sleep Sep 21 16:25:53.655206 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Sep 21 16:25:53.655206 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: AssertionError: do not call blocking functions from the mainloop Sep 21 16:25:54.208626 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-8583f994-58e5-48c3-b19c-05d85fd7fc9e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:54.210126 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-8583f994-58e5-48c3-b19c-05d85fd7fc9e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:54.221857 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8583f994-58e5-48c3-b19c-05d85fd7fc9e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:54.223273 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8583f994-58e5-48c3-b19c-05d85fd7fc9e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:54.223950 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8583f994-58e5-48c3-b19c-05d85fd7fc9e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:54.225273 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8583f994-58e5-48c3-b19c-05d85fd7fc9e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:54.225977 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8583f994-58e5-48c3-b19c-05d85fd7fc9e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:54.226791 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8583f994-58e5-48c3-b19c-05d85fd7fc9e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:55.016607 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-8583f994-58e5-48c3-b19c-05d85fd7fc9e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:55.060787 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-8583f994-58e5-48c3-b19c-05d85fd7fc9e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:55.064693 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-8583f994-58e5-48c3-b19c-05d85fd7fc9e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:55.068604 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-8583f994-58e5-48c3-b19c-05d85fd7fc9e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1740 microversion: 2.20 time: 0.865415 Sep 21 16:25:55.077518 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 213/381] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:25:54 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1740 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 16:25:55.103211 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-913d12b5-792c-477c-8d86-6cffb616b0f1 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:55.114393 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-913d12b5-792c-477c-8d86-6cffb616b0f1 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:55.155564 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-913d12b5-792c-477c-8d86-6cffb616b0f1 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:55.161058 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-913d12b5-792c-477c-8d86-6cffb616b0f1 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:55.167083 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-913d12b5-792c-477c-8d86-6cffb616b0f1 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:55.173576 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-913d12b5-792c-477c-8d86-6cffb616b0f1 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:55.174912 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-913d12b5-792c-477c-8d86-6cffb616b0f1 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:55.176143 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-913d12b5-792c-477c-8d86-6cffb616b0f1 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:55.190163 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=100 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:25:55.635697 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-913d12b5-792c-477c-8d86-6cffb616b0f1 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:55.657059 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-913d12b5-792c-477c-8d86-6cffb616b0f1 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1724 microversion: 2.1 time: 0.575754 Sep 21 16:25:55.658424 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 214/382] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:55 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1724 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:25:56.099936 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ca160320-8279-4b80-9639-003a498acb7c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:56.100895 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ca160320-8279-4b80-9639-003a498acb7c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:56.116785 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ca160320-8279-4b80-9639-003a498acb7c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:56.118863 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ca160320-8279-4b80-9639-003a498acb7c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:56.121007 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ca160320-8279-4b80-9639-003a498acb7c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:56.122940 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ca160320-8279-4b80-9639-003a498acb7c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:56.125243 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ca160320-8279-4b80-9639-003a498acb7c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:56.127357 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ca160320-8279-4b80-9639-003a498acb7c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:56.533320 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ca160320-8279-4b80-9639-003a498acb7c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:56.545447 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ca160320-8279-4b80-9639-003a498acb7c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:56.547780 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ca160320-8279-4b80-9639-003a498acb7c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:56.549063 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ca160320-8279-4b80-9639-003a498acb7c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1740 microversion: 2.20 time: 0.454741 Sep 21 16:25:56.584920 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 215/383] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:25:56 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1740 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:25:56.686937 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-5c140c79-24d6-4d08-a180-b89ccdb8667b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:56.688045 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-5c140c79-24d6-4d08-a180-b89ccdb8667b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:56.727389 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5c140c79-24d6-4d08-a180-b89ccdb8667b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:56.728290 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5c140c79-24d6-4d08-a180-b89ccdb8667b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:56.729088 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5c140c79-24d6-4d08-a180-b89ccdb8667b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:56.730398 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5c140c79-24d6-4d08-a180-b89ccdb8667b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:56.731242 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5c140c79-24d6-4d08-a180-b89ccdb8667b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:56.732040 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5c140c79-24d6-4d08-a180-b89ccdb8667b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:57.129162 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5c140c79-24d6-4d08-a180-b89ccdb8667b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:57.169806 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-5c140c79-24d6-4d08-a180-b89ccdb8667b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1701 microversion: 2.1 time: 0.489817 Sep 21 16:25:57.190974 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 216/384] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:56 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1701 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:25:57.223048 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-6ef51493-0af5-4e32-b218-dff7d68e2582 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:25:57.235472 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6ef51493-0af5-4e32-b218-dff7d68e2582 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:57.239687 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6ef51493-0af5-4e32-b218-dff7d68e2582 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:57.241075 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6ef51493-0af5-4e32-b218-dff7d68e2582 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:57.411767 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-6ef51493-0af5-4e32-b218-dff7d68e2582 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Going to try to start instance {{(pid=120532) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 21 16:25:57.563924 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-6ef51493-0af5-4e32-b218-dff7d68e2582 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "POST /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021/action" status: 202 len: 0 microversion: 2.1 time: 0.349668 Sep 21 16:25:57.583348 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 217/385] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Sep 21 16:25:57 2022] POST /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 21 16:25:57.600497 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-e7d5b208-29b1-4ee5-9777-d47358cc50f2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:57.604269 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-e7d5b208-29b1-4ee5-9777-d47358cc50f2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:57.626696 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e7d5b208-29b1-4ee5-9777-d47358cc50f2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:57.627040 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e7d5b208-29b1-4ee5-9777-d47358cc50f2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:57.630617 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e7d5b208-29b1-4ee5-9777-d47358cc50f2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:57.632077 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e7d5b208-29b1-4ee5-9777-d47358cc50f2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:57.635044 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e7d5b208-29b1-4ee5-9777-d47358cc50f2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:57.637270 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e7d5b208-29b1-4ee5-9777-d47358cc50f2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:58.034842 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-e7d5b208-29b1-4ee5-9777-d47358cc50f2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:58.077356 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-e7d5b208-29b1-4ee5-9777-d47358cc50f2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1710 microversion: 2.1 time: 0.491426 Sep 21 16:25:58.078724 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 218/386] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:25:57 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1710 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:25:58.091498 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-fd442159-b60a-4e82-b7b1-b1bd7724426a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:25:58.113194 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-fd442159-b60a-4e82-b7b1-b1bd7724426a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:25:58.154176 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fd442159-b60a-4e82-b7b1-b1bd7724426a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:58.155565 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fd442159-b60a-4e82-b7b1-b1bd7724426a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:58.157347 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fd442159-b60a-4e82-b7b1-b1bd7724426a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:58.158977 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fd442159-b60a-4e82-b7b1-b1bd7724426a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:25:58.161308 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fd442159-b60a-4e82-b7b1-b1bd7724426a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:25:58.161827 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fd442159-b60a-4e82-b7b1-b1bd7724426a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:25:58.458691 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-fd442159-b60a-4e82-b7b1-b1bd7724426a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:58.495903 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-fd442159-b60a-4e82-b7b1-b1bd7724426a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:58.507081 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-fd442159-b60a-4e82-b7b1-b1bd7724426a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:25:58.509446 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-fd442159-b60a-4e82-b7b1-b1bd7724426a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1740 microversion: 2.20 time: 0.428358 Sep 21 16:25:58.510414 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 219/387] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:25:58 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1740 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:25:58.518756 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-6275a2c9-fd7a-473f-b0c9-828b012cc9c8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-550169412", "imageRef": "600db436-ed6c-41b7-89f7-7dd31852a1a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5eaa1fce-f04b-494b-a504-b5b88bc5ecc1"}], "security_groups": [{"name": "tempest-securitygroup--1349378046"}], "key_name": "tempest-keypair-1452663926", "user_data": "}} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:26:01.694231 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=41 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:26:02.080673 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.network.neutron [None req-3d276e6f-c925-44c2-bba3-f9bfdf127e91 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] validate_networks() for [('8e8cfcce-7266-4377-accc-1ed5295280a6', None, None, None, None, None)] {{(pid=120531) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 16:26:02.123722 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.network.neutron [None req-6275a2c9-fd7a-473f-b0c9-828b012cc9c8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] validate_networks() for [('5eaa1fce-f04b-494b-a504-b5b88bc5ecc1', None, None, None, None, None)] {{(pid=120532) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 16:26:02.570349 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-6275a2c9-fd7a-473f-b0c9-828b012cc9c8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Flavor limits 0:0:0 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 16:26:02.570773 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-6275a2c9-fd7a-473f-b0c9-828b012cc9c8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Image limits 0:0:0 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 16:26:02.571250 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-6275a2c9-fd7a-473f-b0c9-828b012cc9c8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Flavor pref 0:0:0 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 16:26:02.571662 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-6275a2c9-fd7a-473f-b0c9-828b012cc9c8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Image pref 0:0:0 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 16:26:02.572072 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-6275a2c9-fd7a-473f-b0c9-828b012cc9c8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 16:26:02.582097 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-3d276e6f-c925-44c2-bba3-f9bfdf127e91 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Flavor limits 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 16:26:02.582097 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-3d276e6f-c925-44c2-bba3-f9bfdf127e91 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Image limits 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 16:26:02.582477 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-3d276e6f-c925-44c2-bba3-f9bfdf127e91 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Flavor pref 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 16:26:02.582885 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-3d276e6f-c925-44c2-bba3-f9bfdf127e91 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Image pref 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 16:26:02.583298 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-3d276e6f-c925-44c2-bba3-f9bfdf127e91 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 16:26:02.589180 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6275a2c9-fd7a-473f-b0c9-828b012cc9c8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:02.589939 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6275a2c9-fd7a-473f-b0c9-828b012cc9c8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:02.590472 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6275a2c9-fd7a-473f-b0c9-828b012cc9c8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:02.592542 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6275a2c9-fd7a-473f-b0c9-828b012cc9c8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:02.592542 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6275a2c9-fd7a-473f-b0c9-828b012cc9c8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:02.592779 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3d276e6f-c925-44c2-bba3-f9bfdf127e91 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:02.592883 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3d276e6f-c925-44c2-bba3-f9bfdf127e91 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:02.593629 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6275a2c9-fd7a-473f-b0c9-828b012cc9c8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:02.593789 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3d276e6f-c925-44c2-bba3-f9bfdf127e91 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:02.594560 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3d276e6f-c925-44c2-bba3-f9bfdf127e91 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:02.595215 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3d276e6f-c925-44c2-bba3-f9bfdf127e91 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:02.595639 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3d276e6f-c925-44c2-bba3-f9bfdf127e91 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:02.613862 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.quota [None req-6275a2c9-fd7a-473f-b0c9-828b012cc9c8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Getting quotas for project b93e202a295d427a85fdaf0209951bd5. Resources: {'cores', 'ram', 'instances'} {{(pid=120532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 16:26:02.619915 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.quota [None req-3d276e6f-c925-44c2-bba3-f9bfdf127e91 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Getting quotas for project ce7a3e77ddf14b48986752434dda6d33. Resources: {'cores', 'ram', 'instances'} {{(pid=120531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 16:26:02.620823 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.quota [None req-6275a2c9-fd7a-473f-b0c9-828b012cc9c8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Getting quotas for user d2382a6610ae42fa865283ed12dd9982 and project b93e202a295d427a85fdaf0209951bd5. Resources: {'cores', 'ram', 'instances'} {{(pid=120532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 16:26:02.622685 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.quota [None req-3d276e6f-c925-44c2-bba3-f9bfdf127e91 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Getting quotas for user b917d84a650f4355a676e315ea039f0e and project ce7a3e77ddf14b48986752434dda6d33. Resources: {'cores', 'ram', 'instances'} {{(pid=120531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 16:26:02.633387 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-6275a2c9-fd7a-473f-b0c9-828b012cc9c8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Going to run 1 instances... {{(pid=120532) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 16:26:02.634870 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-3d276e6f-c925-44c2-bba3-f9bfdf127e91 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Going to run 1 instances... {{(pid=120531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 16:26:02.635915 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-6275a2c9-fd7a-473f-b0c9-828b012cc9c8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='600db436-ed6c-41b7-89f7-7dd31852a1a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120532) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 16:26:02.637200 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-3d276e6f-c925-44c2-bba3-f9bfdf127e91 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 7ffeddb1-1776-4585-9f48-3920444b4b18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='600db436-ed6c-41b7-89f7-7dd31852a1a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 16:26:02.689600 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-6275a2c9-fd7a-473f-b0c9-828b012cc9c8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 4.177777 Sep 21 16:26:02.690713 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 220/388] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Sep 21 16:25:58 2022] POST /compute/v2.1/servers => generated 409 bytes in 4180 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 21 16:26:02.696618 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-118551a2-6afe-4eea-891d-96cb5445f441 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:02.697561 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-118551a2-6afe-4eea-891d-96cb5445f441 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:02.706589 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-118551a2-6afe-4eea-891d-96cb5445f441 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:02.708354 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-118551a2-6afe-4eea-891d-96cb5445f441 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:02.708712 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-118551a2-6afe-4eea-891d-96cb5445f441 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:02.709833 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-118551a2-6afe-4eea-891d-96cb5445f441 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:02.710626 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-118551a2-6afe-4eea-891d-96cb5445f441 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:02.711352 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-118551a2-6afe-4eea-891d-96cb5445f441 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:02.757299 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-3d276e6f-c925-44c2-bba3-f9bfdf127e91 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 10.319504 Sep 21 16:26:02.766145 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 169/389] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Sep 21 16:25:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 10325 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 21 16:26:02.774902 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d3ee5f5e-467a-42a7-8707-37254ee0e9d9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:02.775533 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d3ee5f5e-467a-42a7-8707-37254ee0e9d9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:02.789024 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d3ee5f5e-467a-42a7-8707-37254ee0e9d9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:02.789618 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d3ee5f5e-467a-42a7-8707-37254ee0e9d9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:02.790091 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d3ee5f5e-467a-42a7-8707-37254ee0e9d9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:02.790983 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d3ee5f5e-467a-42a7-8707-37254ee0e9d9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:02.791489 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d3ee5f5e-467a-42a7-8707-37254ee0e9d9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:02.792207 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d3ee5f5e-467a-42a7-8707-37254ee0e9d9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:03.018783 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-118551a2-6afe-4eea-891d-96cb5445f441 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:03.033285 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-118551a2-6afe-4eea-891d-96cb5445f441 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1714 microversion: 2.1 time: 0.340762 Sep 21 16:26:03.050522 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 221/390] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:02 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1714 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:03.058472 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-2970539b-b76a-4ac1-8f63-83233b66a250 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Action: 'create', calling method: .version_select at 0x7fdb88c2edc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1566029887", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPc3mSrggRdJs7Mcg3I4i2/nOm5fJJsD5nFMzxHkn89bKsntImshbMXxYNka6+DhL3DG1iMPRO6fCw1/A+NA1d17d+6E72KYddFlnQQ466JdLSmqomIDzE7RCC28vcpc/w=="}} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:26:03.079433 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.quota [None req-2970539b-b76a-4ac1-8f63-83233b66a250 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Getting quotas for project f1939a4a2ffd40c49d04b42983fba762. Resources: {'key_pairs'} {{(pid=120532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 16:26:03.090642 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.quota [None req-2970539b-b76a-4ac1-8f63-83233b66a250 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Getting quotas for user 70d318fe37c344649a165ef9a06a7b74 and project f1939a4a2ffd40c49d04b42983fba762. Resources: {'key_pairs'} {{(pid=120532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 16:26:03.093621 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d3ee5f5e-467a-42a7-8707-37254ee0e9d9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:03.123826 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-2970539b-b76a-4ac1-8f63-83233b66a250 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.072060 Sep 21 16:26:03.127152 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 222/391] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Sep 21 16:26:03 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:26:03.130728 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d3ee5f5e-467a-42a7-8707-37254ee0e9d9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:03.133346 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-f3b805fd-223b-4575-8b59-e58dc5ecd9fc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:03.133979 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-f3b805fd-223b-4575-8b59-e58dc5ecd9fc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:03.138908 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d3ee5f5e-467a-42a7-8707-37254ee0e9d9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:03.141539 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d3ee5f5e-467a-42a7-8707-37254ee0e9d9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1740 microversion: 2.20 time: 0.377743 Sep 21 16:26:03.145565 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 170/392] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:26:02 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1740 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:26:03.169887 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-227abb0d-6fa7-4976-83c3-28057d7941cb tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:03.171569 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-227abb0d-6fa7-4976-83c3-28057d7941cb tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 7ffeddb1-1776-4585-9f48-3920444b4b18] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:03.243900 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-f3b805fd-223b-4575-8b59-e58dc5ecd9fc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:03.256829 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-f3b805fd-223b-4575-8b59-e58dc5ecd9fc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1245 microversion: 2.1 time: 0.127690 Sep 21 16:26:03.257857 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 223/393] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:03 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1245 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:03.349371 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-227abb0d-6fa7-4976-83c3-28057d7941cb tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:03.354605 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-d985d45f-63d0-45be-8d9c-e65d582aaa97 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-204701766", "imageRef": "6b19e454-ddcd-411b-bd60-a4b3a8f015c2", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1566029887", "networks": [{"uuid": "586bc970-974b-4c72-bd76-65bdf17f94a4"}]}} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:26:03.365254 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-227abb0d-6fa7-4976-83c3-28057d7941cb tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18" status: 200 len: 1239 microversion: 2.1 time: 0.213597 Sep 21 16:26:03.377388 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 171/394] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:03 2022] GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18 => generated 1239 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:03.458486 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.network.neutron [None req-d985d45f-63d0-45be-8d9c-e65d582aaa97 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] validate_networks() for [('586bc970-974b-4c72-bd76-65bdf17f94a4', None, None, None, None, None)] {{(pid=120532) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 16:26:03.960752 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-d985d45f-63d0-45be-8d9c-e65d582aaa97 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Flavor limits 0:0:0 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 16:26:03.961250 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-d985d45f-63d0-45be-8d9c-e65d582aaa97 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Image limits 0:0:0 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 16:26:03.961789 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-d985d45f-63d0-45be-8d9c-e65d582aaa97 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Flavor pref 0:0:0 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 16:26:03.962292 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-d985d45f-63d0-45be-8d9c-e65d582aaa97 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Image pref 0:0:0 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 16:26:03.963144 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-d985d45f-63d0-45be-8d9c-e65d582aaa97 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 16:26:03.973143 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d985d45f-63d0-45be-8d9c-e65d582aaa97 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:03.973623 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d985d45f-63d0-45be-8d9c-e65d582aaa97 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:03.974072 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d985d45f-63d0-45be-8d9c-e65d582aaa97 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:03.974803 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d985d45f-63d0-45be-8d9c-e65d582aaa97 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:03.975251 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d985d45f-63d0-45be-8d9c-e65d582aaa97 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:03.975665 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d985d45f-63d0-45be-8d9c-e65d582aaa97 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:03.993823 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.quota [None req-d985d45f-63d0-45be-8d9c-e65d582aaa97 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Getting quotas for project f1939a4a2ffd40c49d04b42983fba762. Resources: {'cores', 'ram', 'instances'} {{(pid=120532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 16:26:03.997789 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.quota [None req-d985d45f-63d0-45be-8d9c-e65d582aaa97 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Getting quotas for user 70d318fe37c344649a165ef9a06a7b74 and project f1939a4a2ffd40c49d04b42983fba762. Resources: {'cores', 'ram', 'instances'} {{(pid=120532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 16:26:04.010824 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-d985d45f-63d0-45be-8d9c-e65d582aaa97 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Going to run 1 instances... {{(pid=120532) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 16:26:04.013063 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-d985d45f-63d0-45be-8d9c-e65d582aaa97 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6b19e454-ddcd-411b-bd60-a4b3a8f015c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120532) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 16:26:04.059814 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-d985d45f-63d0-45be-8d9c-e65d582aaa97 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.709804 Sep 21 16:26:04.060486 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 224/395] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Sep 21 16:26:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 21 16:26:04.075892 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-81e9474f-a95b-484a-a795-3a9a6b2376ea tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:04.087988 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-81e9474f-a95b-484a-a795-3a9a6b2376ea tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:04.147626 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-81e9474f-a95b-484a-a795-3a9a6b2376ea tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:04.156324 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-81e9474f-a95b-484a-a795-3a9a6b2376ea tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1258 microversion: 2.1 time: 0.085612 Sep 21 16:26:04.158110 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 172/396] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:04 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1258 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:04.177693 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-79ad6652-603c-4cec-8483-2bee014ca4d5 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:04.178375 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-79ad6652-603c-4cec-8483-2bee014ca4d5 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:04.184791 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-79ad6652-603c-4cec-8483-2bee014ca4d5 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:04.185286 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-79ad6652-603c-4cec-8483-2bee014ca4d5 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:04.185720 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-79ad6652-603c-4cec-8483-2bee014ca4d5 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:04.186452 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-79ad6652-603c-4cec-8483-2bee014ca4d5 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:04.187461 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-79ad6652-603c-4cec-8483-2bee014ca4d5 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:04.187889 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-79ad6652-603c-4cec-8483-2bee014ca4d5 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:04.284894 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-4c6a0c56-68ab-46e0-b108-9f42d9ecd46c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:04.285512 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-4c6a0c56-68ab-46e0-b108-9f42d9ecd46c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:04.293839 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4c6a0c56-68ab-46e0-b108-9f42d9ecd46c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:04.294651 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4c6a0c56-68ab-46e0-b108-9f42d9ecd46c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:04.295093 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4c6a0c56-68ab-46e0-b108-9f42d9ecd46c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:04.295810 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4c6a0c56-68ab-46e0-b108-9f42d9ecd46c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:04.296538 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4c6a0c56-68ab-46e0-b108-9f42d9ecd46c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:04.297946 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4c6a0c56-68ab-46e0-b108-9f42d9ecd46c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:04.375009 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-79ad6652-603c-4cec-8483-2bee014ca4d5 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:04.385707 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-79ad6652-603c-4cec-8483-2bee014ca4d5 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:04.388048 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-79ad6652-603c-4cec-8483-2bee014ca4d5 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:04.388321 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-4c6a0c56-68ab-46e0-b108-9f42d9ecd46c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:04.390295 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-79ad6652-603c-4cec-8483-2bee014ca4d5 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1740 microversion: 2.20 time: 0.216091 Sep 21 16:26:04.391275 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 225/397] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:26:04 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1740 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 16:26:04.397097 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-4c6a0c56-68ab-46e0-b108-9f42d9ecd46c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1249 microversion: 2.1 time: 0.116143 Sep 21 16:26:04.398024 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 173/398] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:04 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1249 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:04.399054 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-5021fc0f-a5be-4509-bb3b-73aef7b31be1 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:04.399800 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-5021fc0f-a5be-4509-bb3b-73aef7b31be1 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 7ffeddb1-1776-4585-9f48-3920444b4b18] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:04.418733 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5021fc0f-a5be-4509-bb3b-73aef7b31be1 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:04.419847 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5021fc0f-a5be-4509-bb3b-73aef7b31be1 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:04.420801 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5021fc0f-a5be-4509-bb3b-73aef7b31be1 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:04.422478 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5021fc0f-a5be-4509-bb3b-73aef7b31be1 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:04.422969 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5021fc0f-a5be-4509-bb3b-73aef7b31be1 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:04.423414 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5021fc0f-a5be-4509-bb3b-73aef7b31be1 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:04.503114 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5021fc0f-a5be-4509-bb3b-73aef7b31be1 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:04.521361 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-5021fc0f-a5be-4509-bb3b-73aef7b31be1 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18" status: 200 len: 1243 microversion: 2.1 time: 0.127610 Sep 21 16:26:04.522302 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 226/399] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:04 2022] GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18 => generated 1243 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:05.179014 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-dc257308-1c2f-4131-86c6-48d2ddfabe54 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:05.181059 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-dc257308-1c2f-4131-86c6-48d2ddfabe54 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:05.189780 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dc257308-1c2f-4131-86c6-48d2ddfabe54 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:05.190292 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dc257308-1c2f-4131-86c6-48d2ddfabe54 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:05.191379 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dc257308-1c2f-4131-86c6-48d2ddfabe54 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:05.192241 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dc257308-1c2f-4131-86c6-48d2ddfabe54 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:05.192839 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dc257308-1c2f-4131-86c6-48d2ddfabe54 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:05.193657 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dc257308-1c2f-4131-86c6-48d2ddfabe54 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:05.322109 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-dc257308-1c2f-4131-86c6-48d2ddfabe54 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:05.343114 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-dc257308-1c2f-4131-86c6-48d2ddfabe54 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1262 microversion: 2.1 time: 0.168142 Sep 21 16:26:05.364940 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 174/400] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:05 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1262 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:05.435645 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-6f321db0-d2a0-40ff-ade0-de338532de70 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:05.436266 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-6f321db0-d2a0-40ff-ade0-de338532de70 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:05.439414 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-38d7090a-b45a-49a6-ada7-0f2bf60bef61 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:05.440083 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-38d7090a-b45a-49a6-ada7-0f2bf60bef61 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:05.463773 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-38d7090a-b45a-49a6-ada7-0f2bf60bef61 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:05.464290 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-38d7090a-b45a-49a6-ada7-0f2bf60bef61 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:05.464725 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-38d7090a-b45a-49a6-ada7-0f2bf60bef61 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:05.469207 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6f321db0-d2a0-40ff-ade0-de338532de70 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:05.469676 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6f321db0-d2a0-40ff-ade0-de338532de70 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:05.470147 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6f321db0-d2a0-40ff-ade0-de338532de70 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:05.475056 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-38d7090a-b45a-49a6-ada7-0f2bf60bef61 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:05.475537 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-38d7090a-b45a-49a6-ada7-0f2bf60bef61 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:05.475979 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-38d7090a-b45a-49a6-ada7-0f2bf60bef61 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:05.483044 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6f321db0-d2a0-40ff-ade0-de338532de70 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:05.490354 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6f321db0-d2a0-40ff-ade0-de338532de70 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:05.491061 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6f321db0-d2a0-40ff-ade0-de338532de70 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:05.616820 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-6f321db0-d2a0-40ff-ade0-de338532de70 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:05.627406 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-6f321db0-d2a0-40ff-ade0-de338532de70 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1241 microversion: 2.1 time: 0.206740 Sep 21 16:26:05.628226 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 227/401] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:05 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1241 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:05.637911 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-d1460384-d52f-476c-ad9b-618110d383b4 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:05.638725 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-d1460384-d52f-476c-ad9b-618110d383b4 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 7ffeddb1-1776-4585-9f48-3920444b4b18] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:05.654929 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d1460384-d52f-476c-ad9b-618110d383b4 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:05.656599 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d1460384-d52f-476c-ad9b-618110d383b4 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:05.657181 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d1460384-d52f-476c-ad9b-618110d383b4 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:05.658177 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d1460384-d52f-476c-ad9b-618110d383b4 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:05.658698 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d1460384-d52f-476c-ad9b-618110d383b4 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:05.659736 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d1460384-d52f-476c-ad9b-618110d383b4 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:05.750437 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d1460384-d52f-476c-ad9b-618110d383b4 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:05.762035 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-d1460384-d52f-476c-ad9b-618110d383b4 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18" status: 200 len: 1291 microversion: 2.1 time: 0.130124 Sep 21 16:26:05.764786 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 228/402] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:05 2022] GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18 => generated 1291 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:05.773529 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-64db06c0-cdfe-4150-9690-afe9ac44bc05 req-ad7786cf-6051-45d6-9fe7-6e55c67044ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f563aac-6055-4b77-b3bb-894ed14c1f64", "name": "network-vif-unplugged", "status": "completed", "tag": "252450c8-e7d3-467d-be6e-17b527b01bb8"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:26:05.788027 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-64db06c0-cdfe-4150-9690-afe9ac44bc05 req-ad7786cf-6051-45d6-9fe7-6e55c67044ee service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:05.788805 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-64db06c0-cdfe-4150-9690-afe9ac44bc05 req-ad7786cf-6051-45d6-9fe7-6e55c67044ee service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:05.789444 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-64db06c0-cdfe-4150-9690-afe9ac44bc05 req-ad7786cf-6051-45d6-9fe7-6e55c67044ee service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:05.814926 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-64db06c0-cdfe-4150-9690-afe9ac44bc05 req-ad7786cf-6051-45d6-9fe7-6e55c67044ee service nova] Creating event network-vif-unplugged:252450c8-e7d3-467d-be6e-17b527b01bb8 for instance 5f563aac-6055-4b77-b3bb-894ed14c1f64 on hv-cinder-85862 Sep 21 16:26:05.821705 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-64db06c0-cdfe-4150-9690-afe9ac44bc05 req-ad7786cf-6051-45d6-9fe7-6e55c67044ee service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055485 Sep 21 16:26:05.822417 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 229/403] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:26:05.851215 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-38d7090a-b45a-49a6-ada7-0f2bf60bef61 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:05.868739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-38d7090a-b45a-49a6-ada7-0f2bf60bef61 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:05.872014 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-38d7090a-b45a-49a6-ada7-0f2bf60bef61 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:05.874233 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-38d7090a-b45a-49a6-ada7-0f2bf60bef61 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1722 microversion: 2.20 time: 0.450170 Sep 21 16:26:05.875188 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 175/404] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:26:05 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1722 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:26:06.377591 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-3a696ac0-e894-460b-94dc-e30c460fbe38 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:06.378651 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-3a696ac0-e894-460b-94dc-e30c460fbe38 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:06.392341 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3a696ac0-e894-460b-94dc-e30c460fbe38 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:06.393481 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3a696ac0-e894-460b-94dc-e30c460fbe38 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:06.394526 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3a696ac0-e894-460b-94dc-e30c460fbe38 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:06.396747 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3a696ac0-e894-460b-94dc-e30c460fbe38 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:06.398242 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3a696ac0-e894-460b-94dc-e30c460fbe38 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:06.399253 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3a696ac0-e894-460b-94dc-e30c460fbe38 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:06.534917 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-3a696ac0-e894-460b-94dc-e30c460fbe38 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:06.548227 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-3a696ac0-e894-460b-94dc-e30c460fbe38 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1254 microversion: 2.1 time: 0.176589 Sep 21 16:26:06.551293 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 230/405] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:06 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1254 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:06.657134 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-10a84300-8e06-48a5-9ec1-6e1ea62e0a9b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:06.659162 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-10a84300-8e06-48a5-9ec1-6e1ea62e0a9b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:06.678880 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-10a84300-8e06-48a5-9ec1-6e1ea62e0a9b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:06.680123 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-10a84300-8e06-48a5-9ec1-6e1ea62e0a9b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:06.680860 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-10a84300-8e06-48a5-9ec1-6e1ea62e0a9b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:06.681878 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-10a84300-8e06-48a5-9ec1-6e1ea62e0a9b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:06.682966 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-10a84300-8e06-48a5-9ec1-6e1ea62e0a9b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:06.684202 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-10a84300-8e06-48a5-9ec1-6e1ea62e0a9b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:06.795152 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-276200e5-6cfd-4764-9725-5706016168d1 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:06.796301 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-276200e5-6cfd-4764-9725-5706016168d1 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 7ffeddb1-1776-4585-9f48-3920444b4b18] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:06.811254 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-276200e5-6cfd-4764-9725-5706016168d1 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:06.812659 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-276200e5-6cfd-4764-9725-5706016168d1 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:06.813985 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-276200e5-6cfd-4764-9725-5706016168d1 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:06.814971 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-276200e5-6cfd-4764-9725-5706016168d1 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:06.815839 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-276200e5-6cfd-4764-9725-5706016168d1 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:06.816521 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-276200e5-6cfd-4764-9725-5706016168d1 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:06.898225 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-276200e5-6cfd-4764-9725-5706016168d1 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:06.906937 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-276200e5-6cfd-4764-9725-5706016168d1 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18" status: 200 len: 1299 microversion: 2.1 time: 0.115601 Sep 21 16:26:06.924162 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 231/406] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:06 2022] GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18 => generated 1299 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:26:06.929103 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-68cbf7ba-1566-4e4a-9627-adfff6454efb tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:06.929705 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-68cbf7ba-1566-4e4a-9627-adfff6454efb tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:06.939742 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-68cbf7ba-1566-4e4a-9627-adfff6454efb tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:06.940569 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-68cbf7ba-1566-4e4a-9627-adfff6454efb tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:06.941004 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-68cbf7ba-1566-4e4a-9627-adfff6454efb tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:06.941932 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-68cbf7ba-1566-4e4a-9627-adfff6454efb tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:06.942761 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-68cbf7ba-1566-4e4a-9627-adfff6454efb tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:06.943640 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-68cbf7ba-1566-4e4a-9627-adfff6454efb tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:07.036581 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-10a84300-8e06-48a5-9ec1-6e1ea62e0a9b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:07.046399 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-10a84300-8e06-48a5-9ec1-6e1ea62e0a9b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1241 microversion: 2.1 time: 0.396702 Sep 21 16:26:07.050328 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 176/407] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:06 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1241 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:07.127841 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-68cbf7ba-1566-4e4a-9627-adfff6454efb tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:07.138326 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-68cbf7ba-1566-4e4a-9627-adfff6454efb tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:07.140409 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-68cbf7ba-1566-4e4a-9627-adfff6454efb tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:07.141628 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-68cbf7ba-1566-4e4a-9627-adfff6454efb tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1722 microversion: 2.20 time: 0.216454 Sep 21 16:26:07.142238 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 232/408] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:26:06 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:26:07.577527 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-606a880a-1c8c-4d20-939b-3b3eff4849da tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:07.578630 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-606a880a-1c8c-4d20-939b-3b3eff4849da tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:07.586912 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-606a880a-1c8c-4d20-939b-3b3eff4849da tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:07.588319 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-606a880a-1c8c-4d20-939b-3b3eff4849da tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:07.589048 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-606a880a-1c8c-4d20-939b-3b3eff4849da tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:07.590170 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-606a880a-1c8c-4d20-939b-3b3eff4849da tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:07.591142 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-606a880a-1c8c-4d20-939b-3b3eff4849da tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:07.591827 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-606a880a-1c8c-4d20-939b-3b3eff4849da tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:07.685813 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-606a880a-1c8c-4d20-939b-3b3eff4849da tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:07.706678 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-606a880a-1c8c-4d20-939b-3b3eff4849da tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1254 microversion: 2.1 time: 0.134929 Sep 21 16:26:07.707275 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 177/409] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:07 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1254 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:07.938228 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-3daaf06d-deb1-4f62-862c-6628e4a3fff9 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:07.938877 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-3daaf06d-deb1-4f62-862c-6628e4a3fff9 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 7ffeddb1-1776-4585-9f48-3920444b4b18] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:07.943090 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:26:07.949663 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3daaf06d-deb1-4f62-862c-6628e4a3fff9 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:07.950400 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3daaf06d-deb1-4f62-862c-6628e4a3fff9 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:07.951077 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3daaf06d-deb1-4f62-862c-6628e4a3fff9 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:07.951823 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3daaf06d-deb1-4f62-862c-6628e4a3fff9 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:07.953004 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3daaf06d-deb1-4f62-862c-6628e4a3fff9 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:07.953441 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3daaf06d-deb1-4f62-862c-6628e4a3fff9 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:08.079127 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-edaf7af3-ae6c-45a8-a05f-bc25631dcf96 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:08.080173 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-edaf7af3-ae6c-45a8-a05f-bc25631dcf96 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:08.100411 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-edaf7af3-ae6c-45a8-a05f-bc25631dcf96 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:08.101050 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-edaf7af3-ae6c-45a8-a05f-bc25631dcf96 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:08.106303 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-3daaf06d-deb1-4f62-862c-6628e4a3fff9 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:08.107452 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:26:08.110069 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-edaf7af3-ae6c-45a8-a05f-bc25631dcf96 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:08.115673 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-edaf7af3-ae6c-45a8-a05f-bc25631dcf96 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:08.116478 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-edaf7af3-ae6c-45a8-a05f-bc25631dcf96 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:08.117154 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-edaf7af3-ae6c-45a8-a05f-bc25631dcf96 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:08.119868 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-3daaf06d-deb1-4f62-862c-6628e4a3fff9 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18" status: 200 len: 1299 microversion: 2.1 time: 0.187961 Sep 21 16:26:08.135697 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 233/410] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:07 2022] GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18 => generated 1299 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:08.175373 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-46689a6c-4861-4fb7-bd2e-94a3fb7afac1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:08.175991 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-46689a6c-4861-4fb7-bd2e-94a3fb7afac1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:08.197245 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-46689a6c-4861-4fb7-bd2e-94a3fb7afac1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:08.202262 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-46689a6c-4861-4fb7-bd2e-94a3fb7afac1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:08.202847 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-46689a6c-4861-4fb7-bd2e-94a3fb7afac1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:08.203618 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-46689a6c-4861-4fb7-bd2e-94a3fb7afac1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:08.204093 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-46689a6c-4861-4fb7-bd2e-94a3fb7afac1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:08.204521 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-46689a6c-4861-4fb7-bd2e-94a3fb7afac1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:08.292848 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-edaf7af3-ae6c-45a8-a05f-bc25631dcf96 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:08.331743 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-edaf7af3-ae6c-45a8-a05f-bc25631dcf96 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1297 microversion: 2.1 time: 0.259099 Sep 21 16:26:08.336045 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 178/411] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:08 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1297 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:08.560379 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-46689a6c-4861-4fb7-bd2e-94a3fb7afac1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:08.579542 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-46689a6c-4861-4fb7-bd2e-94a3fb7afac1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:08.582686 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-46689a6c-4861-4fb7-bd2e-94a3fb7afac1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:08.584154 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-46689a6c-4861-4fb7-bd2e-94a3fb7afac1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1722 microversion: 2.20 time: 0.418616 Sep 21 16:26:08.599352 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 234/412] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:26:08 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1722 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:26:08.730818 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-1643211e-b07e-46cb-abe7-4feb6c9ef8f9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:08.732103 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-1643211e-b07e-46cb-abe7-4feb6c9ef8f9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:08.751164 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1643211e-b07e-46cb-abe7-4feb6c9ef8f9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:08.754843 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1643211e-b07e-46cb-abe7-4feb6c9ef8f9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:08.755814 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1643211e-b07e-46cb-abe7-4feb6c9ef8f9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:08.760471 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1643211e-b07e-46cb-abe7-4feb6c9ef8f9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:08.763687 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1643211e-b07e-46cb-abe7-4feb6c9ef8f9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:08.764020 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1643211e-b07e-46cb-abe7-4feb6c9ef8f9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:08.971529 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-1643211e-b07e-46cb-abe7-4feb6c9ef8f9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:08.997405 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-1643211e-b07e-46cb-abe7-4feb6c9ef8f9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1254 microversion: 2.1 time: 0.270778 Sep 21 16:26:09.000387 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 179/413] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:08 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1254 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:09.156755 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-e9398b3d-1044-46d6-bac0-998f4e3d4ade tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:09.158440 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-e9398b3d-1044-46d6-bac0-998f4e3d4ade tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 7ffeddb1-1776-4585-9f48-3920444b4b18] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:09.206204 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e9398b3d-1044-46d6-bac0-998f4e3d4ade tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:09.207069 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e9398b3d-1044-46d6-bac0-998f4e3d4ade tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:09.207779 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e9398b3d-1044-46d6-bac0-998f4e3d4ade tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:09.209307 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e9398b3d-1044-46d6-bac0-998f4e3d4ade tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:09.210014 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e9398b3d-1044-46d6-bac0-998f4e3d4ade tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:09.210860 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e9398b3d-1044-46d6-bac0-998f4e3d4ade tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:09.313377 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-e9398b3d-1044-46d6-bac0-998f4e3d4ade tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:09.326336 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-e9398b3d-1044-46d6-bac0-998f4e3d4ade tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18" status: 200 len: 1297 microversion: 2.1 time: 0.177026 Sep 21 16:26:09.329484 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 235/414] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:09 2022] GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18 => generated 1297 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:09.372491 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-b5047d5a-ece6-419b-87e9-d6b4c9867328 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:09.373397 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-b5047d5a-ece6-419b-87e9-d6b4c9867328 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:09.393181 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b5047d5a-ece6-419b-87e9-d6b4c9867328 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:09.394097 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b5047d5a-ece6-419b-87e9-d6b4c9867328 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:09.394863 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b5047d5a-ece6-419b-87e9-d6b4c9867328 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:09.401289 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b5047d5a-ece6-419b-87e9-d6b4c9867328 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:09.405262 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b5047d5a-ece6-419b-87e9-d6b4c9867328 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:09.406624 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b5047d5a-ece6-419b-87e9-d6b4c9867328 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:09.603582 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-b5047d5a-ece6-419b-87e9-d6b4c9867328 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:09.619110 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-edd3d67c-daaf-4325-85bb-c8126cc4feb3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:09.619825 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-edd3d67c-daaf-4325-85bb-c8126cc4feb3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:09.627929 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-edd3d67c-daaf-4325-85bb-c8126cc4feb3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:09.628712 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-edd3d67c-daaf-4325-85bb-c8126cc4feb3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:09.629529 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-edd3d67c-daaf-4325-85bb-c8126cc4feb3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:09.631116 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-edd3d67c-daaf-4325-85bb-c8126cc4feb3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:09.633364 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-edd3d67c-daaf-4325-85bb-c8126cc4feb3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:09.634256 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-edd3d67c-daaf-4325-85bb-c8126cc4feb3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:09.638643 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-b5047d5a-ece6-419b-87e9-d6b4c9867328 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1305 microversion: 2.1 time: 0.263265 Sep 21 16:26:09.643696 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 180/415] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:09 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1305 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:26:09.949602 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-edd3d67c-daaf-4325-85bb-c8126cc4feb3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:09.960691 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-edd3d67c-daaf-4325-85bb-c8126cc4feb3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:09.964202 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-edd3d67c-daaf-4325-85bb-c8126cc4feb3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:09.965517 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-edd3d67c-daaf-4325-85bb-c8126cc4feb3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1725 microversion: 2.20 time: 0.352138 Sep 21 16:26:09.966124 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 236/416] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:26:09 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1725 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:26:09.992950 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-5c8098d1-5cff-4bfe-b14a-5f5dd3b83f50 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "936592df-02ad-46d1-924d-1ff3cccbc49e"}} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:26:09.995389 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-5c8098d1-5cff-4bfe-b14a-5f5dd3b83f50 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:10.011712 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5c8098d1-5cff-4bfe-b14a-5f5dd3b83f50 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:10.012211 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5c8098d1-5cff-4bfe-b14a-5f5dd3b83f50 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:10.012651 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5c8098d1-5cff-4bfe-b14a-5f5dd3b83f50 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:10.013383 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5c8098d1-5cff-4bfe-b14a-5f5dd3b83f50 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:10.013858 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5c8098d1-5cff-4bfe-b14a-5f5dd3b83f50 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:10.014385 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5c8098d1-5cff-4bfe-b14a-5f5dd3b83f50 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:10.028484 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-a616c4ff-f61c-453d-96f6-e9b493f93f4b tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:10.029260 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-a616c4ff-f61c-453d-96f6-e9b493f93f4b tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:10.038344 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a616c4ff-f61c-453d-96f6-e9b493f93f4b tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:10.039985 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a616c4ff-f61c-453d-96f6-e9b493f93f4b tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:10.040909 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a616c4ff-f61c-453d-96f6-e9b493f93f4b tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:10.042113 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a616c4ff-f61c-453d-96f6-e9b493f93f4b tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:10.042937 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a616c4ff-f61c-453d-96f6-e9b493f93f4b tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:10.044443 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a616c4ff-f61c-453d-96f6-e9b493f93f4b tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:10.177700 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a616c4ff-f61c-453d-96f6-e9b493f93f4b tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:10.199852 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-a616c4ff-f61c-453d-96f6-e9b493f93f4b tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1310 microversion: 2.1 time: 0.175479 Sep 21 16:26:10.220297 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 237/417] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:10 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1310 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:10.353900 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c0564f3c-7ca1-4f3e-8ee6-8a78edf4d003 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:10.354690 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-c0564f3c-7ca1-4f3e-8ee6-8a78edf4d003 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 7ffeddb1-1776-4585-9f48-3920444b4b18] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:10.365218 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c0564f3c-7ca1-4f3e-8ee6-8a78edf4d003 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:10.366183 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c0564f3c-7ca1-4f3e-8ee6-8a78edf4d003 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:10.366814 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c0564f3c-7ca1-4f3e-8ee6-8a78edf4d003 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:10.367768 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c0564f3c-7ca1-4f3e-8ee6-8a78edf4d003 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:10.368421 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c0564f3c-7ca1-4f3e-8ee6-8a78edf4d003 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:10.369085 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c0564f3c-7ca1-4f3e-8ee6-8a78edf4d003 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:10.558332 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-5c8098d1-5cff-4bfe-b14a-5f5dd3b83f50 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "POST /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.569775 Sep 21 16:26:10.559332 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 181/418] 10.222.0.64 () {62 vars in 1364 bytes} [Wed Sep 21 16:26:09 2022] POST /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64/os-volume_attachments => generated 188 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 16:26:10.686327 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-4d7ec341-5a4f-4b30-941a-19266f4c36b4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:10.689543 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-4d7ec341-5a4f-4b30-941a-19266f4c36b4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:10.728119 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4d7ec341-5a4f-4b30-941a-19266f4c36b4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:10.732997 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4d7ec341-5a4f-4b30-941a-19266f4c36b4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:10.736192 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4d7ec341-5a4f-4b30-941a-19266f4c36b4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:10.739638 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4d7ec341-5a4f-4b30-941a-19266f4c36b4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:10.742853 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4d7ec341-5a4f-4b30-941a-19266f4c36b4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:10.746861 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-c0564f3c-7ca1-4f3e-8ee6-8a78edf4d003 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:10.747198 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4d7ec341-5a4f-4b30-941a-19266f4c36b4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:10.782270 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-c0564f3c-7ca1-4f3e-8ee6-8a78edf4d003 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18" status: 200 len: 1365 microversion: 2.1 time: 0.433295 Sep 21 16:26:10.783615 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 238/419] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:10 2022] GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18 => generated 1365 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:26:10.899571 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-4d7ec341-5a4f-4b30-941a-19266f4c36b4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:10.905340 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-bd8c5b4c-f6e0-4529-bf35-b85ed0e27e8f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:26:10.906121 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-bd8c5b4c-f6e0-4529-bf35-b85ed0e27e8f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:10.917812 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-4d7ec341-5a4f-4b30-941a-19266f4c36b4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1303 microversion: 2.1 time: 0.253834 Sep 21 16:26:10.921145 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 182/420] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:10 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1303 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:26:10.924219 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bd8c5b4c-f6e0-4529-bf35-b85ed0e27e8f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:10.925568 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bd8c5b4c-f6e0-4529-bf35-b85ed0e27e8f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:10.929828 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bd8c5b4c-f6e0-4529-bf35-b85ed0e27e8f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:10.932819 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bd8c5b4c-f6e0-4529-bf35-b85ed0e27e8f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:10.941194 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bd8c5b4c-f6e0-4529-bf35-b85ed0e27e8f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:10.943352 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bd8c5b4c-f6e0-4529-bf35-b85ed0e27e8f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:11.115539 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-bd8c5b4c-f6e0-4529-bf35-b85ed0e27e8f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120532) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 21 16:26:11.229270 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-7ec7e99d-43c8-4212-99c7-ae3aeb0d5518 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:11.231409 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-7ec7e99d-43c8-4212-99c7-ae3aeb0d5518 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:11.270157 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7ec7e99d-43c8-4212-99c7-ae3aeb0d5518 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:11.274631 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7ec7e99d-43c8-4212-99c7-ae3aeb0d5518 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:11.277129 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7ec7e99d-43c8-4212-99c7-ae3aeb0d5518 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:11.279617 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7ec7e99d-43c8-4212-99c7-ae3aeb0d5518 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:11.281645 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7ec7e99d-43c8-4212-99c7-ae3aeb0d5518 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:11.282510 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7ec7e99d-43c8-4212-99c7-ae3aeb0d5518 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:11.356384 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-bd8c5b4c-f6e0-4529-bf35-b85ed0e27e8f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "POST /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64/action" status: 202 len: 0 microversion: 2.20 time: 0.461375 Sep 21 16:26:11.359532 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 239/421] 10.222.0.64 () {62 vars in 1319 bytes} [Wed Sep 21 16:26:10 2022] POST /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64/action => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 21 16:26:11.374629 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-68c586cb-bc1a-47eb-bcfc-879347127a43 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:11.376777 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-68c586cb-bc1a-47eb-bcfc-879347127a43 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:11.387017 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-68c586cb-bc1a-47eb-bcfc-879347127a43 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:11.387877 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-68c586cb-bc1a-47eb-bcfc-879347127a43 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:11.388514 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-68c586cb-bc1a-47eb-bcfc-879347127a43 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:11.389666 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-68c586cb-bc1a-47eb-bcfc-879347127a43 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:11.390822 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-68c586cb-bc1a-47eb-bcfc-879347127a43 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:11.392386 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-68c586cb-bc1a-47eb-bcfc-879347127a43 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:11.557399 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-7ec7e99d-43c8-4212-99c7-ae3aeb0d5518 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:11.574937 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-7ec7e99d-43c8-4212-99c7-ae3aeb0d5518 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1316 microversion: 2.1 time: 0.351931 Sep 21 16:26:11.577225 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 183/422] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:11 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1316 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:11.822603 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-c6fc2df3-0d04-4792-ac42-10dfaae9fcc1 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:11.829414 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-c6fc2df3-0d04-4792-ac42-10dfaae9fcc1 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 7ffeddb1-1776-4585-9f48-3920444b4b18] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:11.857166 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:26:11.860534 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c6fc2df3-0d04-4792-ac42-10dfaae9fcc1 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:11.875153 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c6fc2df3-0d04-4792-ac42-10dfaae9fcc1 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:11.903200 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c6fc2df3-0d04-4792-ac42-10dfaae9fcc1 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:11.908285 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c6fc2df3-0d04-4792-ac42-10dfaae9fcc1 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:11.915902 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c6fc2df3-0d04-4792-ac42-10dfaae9fcc1 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:11.922574 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c6fc2df3-0d04-4792-ac42-10dfaae9fcc1 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:12.007487 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-68c586cb-bc1a-47eb-bcfc-879347127a43 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:12.021289 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-68c586cb-bc1a-47eb-bcfc-879347127a43 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:12.026890 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-68c586cb-bc1a-47eb-bcfc-879347127a43 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:12.026890 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-68c586cb-bc1a-47eb-bcfc-879347127a43 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1811 microversion: 2.20 time: 0.659111 Sep 21 16:26:12.048459 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 240/423] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:26:11 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1811 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:26:12.067521 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-e65f2f93-03b1-4d2d-97fc-6f44270d1104 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:12.068154 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-e65f2f93-03b1-4d2d-97fc-6f44270d1104 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:12.088620 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e65f2f93-03b1-4d2d-97fc-6f44270d1104 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:12.089126 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e65f2f93-03b1-4d2d-97fc-6f44270d1104 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:12.089564 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e65f2f93-03b1-4d2d-97fc-6f44270d1104 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:12.090366 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e65f2f93-03b1-4d2d-97fc-6f44270d1104 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:12.091033 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e65f2f93-03b1-4d2d-97fc-6f44270d1104 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:12.091462 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e65f2f93-03b1-4d2d-97fc-6f44270d1104 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:12.235258 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-e65f2f93-03b1-4d2d-97fc-6f44270d1104 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:12.256125 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-e65f2f93-03b1-4d2d-97fc-6f44270d1104 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1303 microversion: 2.1 time: 0.206467 Sep 21 16:26:12.260106 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 241/424] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:12 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1303 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:12.606830 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell0:SELECT=2 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:26:12.609600 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-23bd19c2-d2d8-4626-b576-17844607e100 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:12.610393 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-23bd19c2-d2d8-4626-b576-17844607e100 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:12.632219 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-23bd19c2-d2d8-4626-b576-17844607e100 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:12.635232 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-23bd19c2-d2d8-4626-b576-17844607e100 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:12.637811 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-23bd19c2-d2d8-4626-b576-17844607e100 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:12.638835 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-23bd19c2-d2d8-4626-b576-17844607e100 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:12.645850 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-23bd19c2-d2d8-4626-b576-17844607e100 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:12.648134 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-23bd19c2-d2d8-4626-b576-17844607e100 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:12.931231 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-23bd19c2-d2d8-4626-b576-17844607e100 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:12.970699 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-23bd19c2-d2d8-4626-b576-17844607e100 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1316 microversion: 2.1 time: 0.368919 Sep 21 16:26:12.978685 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 242/425] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:12 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1316 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:13.062115 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-d4c62646-b3e4-4eb6-aa11-74201872a657 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:13.063491 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-d4c62646-b3e4-4eb6-aa11-74201872a657 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:13.108939 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d4c62646-b3e4-4eb6-aa11-74201872a657 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:13.110189 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d4c62646-b3e4-4eb6-aa11-74201872a657 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:13.111049 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d4c62646-b3e4-4eb6-aa11-74201872a657 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:13.118863 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d4c62646-b3e4-4eb6-aa11-74201872a657 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:13.131223 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d4c62646-b3e4-4eb6-aa11-74201872a657 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:13.132057 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d4c62646-b3e4-4eb6-aa11-74201872a657 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:13.651383 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-c6fc2df3-0d04-4792-ac42-10dfaae9fcc1 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:13.681154 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-c6fc2df3-0d04-4792-ac42-10dfaae9fcc1 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18" status: 200 len: 1365 microversion: 2.1 time: 1.869262 Sep 21 16:26:13.682479 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 184/426] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:11 2022] GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18 => generated 1365 bytes in 1878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:13.705455 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-7502a60e-cb24-4890-b72a-92e2991835ea tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:13.706944 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-7502a60e-cb24-4890-b72a-92e2991835ea tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:13.727184 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7502a60e-cb24-4890-b72a-92e2991835ea tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:13.731676 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7502a60e-cb24-4890-b72a-92e2991835ea tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:13.732337 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7502a60e-cb24-4890-b72a-92e2991835ea tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:13.734309 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7502a60e-cb24-4890-b72a-92e2991835ea tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:13.736754 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7502a60e-cb24-4890-b72a-92e2991835ea tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:13.738084 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7502a60e-cb24-4890-b72a-92e2991835ea tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:13.800766 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:26:13.981920 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell0:SELECT=4 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:26:14.006279 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell0:SELECT=26 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:26:14.155775 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell0:SELECT=10 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:26:14.282528 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d4c62646-b3e4-4eb6-aa11-74201872a657 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:14.341552 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d4c62646-b3e4-4eb6-aa11-74201872a657 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:14.357566 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d4c62646-b3e4-4eb6-aa11-74201872a657 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:14.360341 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-d4c62646-b3e4-4eb6-aa11-74201872a657 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1751 microversion: 2.20 time: 1.306713 Sep 21 16:26:14.371845 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 243/427] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:26:13 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1751 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 16:26:14.384816 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-5738c21a-872b-4fd9-a32b-df443a8b35d3 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:14.384816 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-5738c21a-872b-4fd9-a32b-df443a8b35d3 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:14.426084 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5738c21a-872b-4fd9-a32b-df443a8b35d3 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:14.427189 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5738c21a-872b-4fd9-a32b-df443a8b35d3 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:14.428038 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5738c21a-872b-4fd9-a32b-df443a8b35d3 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:14.429418 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5738c21a-872b-4fd9-a32b-df443a8b35d3 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:14.438861 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5738c21a-872b-4fd9-a32b-df443a8b35d3 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:14.440539 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5738c21a-872b-4fd9-a32b-df443a8b35d3 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:14.759644 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5738c21a-872b-4fd9-a32b-df443a8b35d3 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:14.817862 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-5738c21a-872b-4fd9-a32b-df443a8b35d3 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1316 microversion: 2.1 time: 0.454566 Sep 21 16:26:14.824169 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 244/428] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:14 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1316 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:14.844927 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-1f614780-31db-4103-8987-c35c30584c31 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:14.852503 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-1f614780-31db-4103-8987-c35c30584c31 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 7ffeddb1-1776-4585-9f48-3920444b4b18] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:14.890567 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1f614780-31db-4103-8987-c35c30584c31 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:14.891098 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1f614780-31db-4103-8987-c35c30584c31 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:14.891556 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1f614780-31db-4103-8987-c35c30584c31 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:14.893369 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1f614780-31db-4103-8987-c35c30584c31 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:14.894216 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1f614780-31db-4103-8987-c35c30584c31 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:14.895029 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1f614780-31db-4103-8987-c35c30584c31 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:15.067698 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-7502a60e-cb24-4890-b72a-92e2991835ea tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:15.107966 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-7502a60e-cb24-4890-b72a-92e2991835ea tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1303 microversion: 2.1 time: 1.418673 Sep 21 16:26:15.110835 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 185/429] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:13 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1303 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:15.404618 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-581820b6-eba0-4a65-9801-bfbbd1e58096 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:15.405247 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-581820b6-eba0-4a65-9801-bfbbd1e58096 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:15.420453 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-581820b6-eba0-4a65-9801-bfbbd1e58096 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:15.420740 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-581820b6-eba0-4a65-9801-bfbbd1e58096 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:15.429163 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-581820b6-eba0-4a65-9801-bfbbd1e58096 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:15.431175 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-581820b6-eba0-4a65-9801-bfbbd1e58096 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:15.432385 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-581820b6-eba0-4a65-9801-bfbbd1e58096 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:15.434159 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-581820b6-eba0-4a65-9801-bfbbd1e58096 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:15.548653 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-1f614780-31db-4103-8987-c35c30584c31 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:15.562202 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-1f614780-31db-4103-8987-c35c30584c31 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18" status: 200 len: 1365 microversion: 2.1 time: 0.733606 Sep 21 16:26:15.563365 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 245/430] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:14 2022] GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18 => generated 1365 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:15.844898 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-102732e3-5b31-4367-b640-5e788d0791ab tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:15.847937 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-102732e3-5b31-4367-b640-5e788d0791ab tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:15.861391 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-102732e3-5b31-4367-b640-5e788d0791ab tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:15.862226 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-102732e3-5b31-4367-b640-5e788d0791ab tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:15.862840 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-102732e3-5b31-4367-b640-5e788d0791ab tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:15.863765 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-102732e3-5b31-4367-b640-5e788d0791ab tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:15.867181 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-102732e3-5b31-4367-b640-5e788d0791ab tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:15.880307 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-102732e3-5b31-4367-b640-5e788d0791ab tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:16.449853 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-102732e3-5b31-4367-b640-5e788d0791ab tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:16.526946 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-102732e3-5b31-4367-b640-5e788d0791ab tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1316 microversion: 2.1 time: 0.658370 Sep 21 16:26:16.550972 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-581820b6-eba0-4a65-9801-bfbbd1e58096 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:16.562592 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-581820b6-eba0-4a65-9801-bfbbd1e58096 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:16.564601 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-581820b6-eba0-4a65-9801-bfbbd1e58096 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:16.566106 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-581820b6-eba0-4a65-9801-bfbbd1e58096 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1751 microversion: 2.20 time: 1.169119 Sep 21 16:26:16.566425 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 246/431] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:15 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1316 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:16.569432 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 186/432] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:26:15 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1751 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 16:26:16.587048 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-c5234647-7213-479d-af28-3cb9585c3cc3 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:16.588096 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-c5234647-7213-479d-af28-3cb9585c3cc3 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 7ffeddb1-1776-4585-9f48-3920444b4b18] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:16.591085 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-91f7afa0-e6f8-40ba-adf1-f25cf29c46ce tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:16.591734 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-91f7afa0-e6f8-40ba-adf1-f25cf29c46ce tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:16.596038 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c5234647-7213-479d-af28-3cb9585c3cc3 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:16.610485 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c5234647-7213-479d-af28-3cb9585c3cc3 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:16.612646 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c5234647-7213-479d-af28-3cb9585c3cc3 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:16.612646 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c5234647-7213-479d-af28-3cb9585c3cc3 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:16.613765 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c5234647-7213-479d-af28-3cb9585c3cc3 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:16.622594 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c5234647-7213-479d-af28-3cb9585c3cc3 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:16.637626 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-91f7afa0-e6f8-40ba-adf1-f25cf29c46ce tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:16.638204 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-91f7afa0-e6f8-40ba-adf1-f25cf29c46ce tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:16.638619 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-91f7afa0-e6f8-40ba-adf1-f25cf29c46ce tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:16.639884 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-91f7afa0-e6f8-40ba-adf1-f25cf29c46ce tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:16.640509 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-91f7afa0-e6f8-40ba-adf1-f25cf29c46ce tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:16.640954 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-91f7afa0-e6f8-40ba-adf1-f25cf29c46ce tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:17.496027 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-91f7afa0-e6f8-40ba-adf1-f25cf29c46ce tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:17.511733 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-91f7afa0-e6f8-40ba-adf1-f25cf29c46ce tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1371 microversion: 2.1 time: 0.943840 Sep 21 16:26:17.520562 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 247/433] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:16 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1371 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:17.525862 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-573463b4-313a-4d55-b437-876fc668ce22 req-f44fa1a0-8e75-435e-a22d-62e41aaf7c9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ffeddb1-1776-4585-9f48-3920444b4b18", "tag": "a15d4d58-da23-48ff-988c-d87d69afffc5"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:26:17.567053 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-573463b4-313a-4d55-b437-876fc668ce22 req-f44fa1a0-8e75-435e-a22d-62e41aaf7c9a service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:17.568227 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-573463b4-313a-4d55-b437-876fc668ce22 req-f44fa1a0-8e75-435e-a22d-62e41aaf7c9a service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:17.568964 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-573463b4-313a-4d55-b437-876fc668ce22 req-f44fa1a0-8e75-435e-a22d-62e41aaf7c9a service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:17.583999 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-573463b4-313a-4d55-b437-876fc668ce22 req-f44fa1a0-8e75-435e-a22d-62e41aaf7c9a service nova] Creating event network-changed:a15d4d58-da23-48ff-988c-d87d69afffc5 for instance 7ffeddb1-1776-4585-9f48-3920444b4b18 on hv-cinder-85862 Sep 21 16:26:17.595827 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-573463b4-313a-4d55-b437-876fc668ce22 req-f44fa1a0-8e75-435e-a22d-62e41aaf7c9a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072014 Sep 21 16:26:17.597148 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 248/434] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:26:17.610476 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-73cc4ddd-6a00-4838-ac45-048218214193 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:17.613101 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-73cc4ddd-6a00-4838-ac45-048218214193 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:17.630559 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-73cc4ddd-6a00-4838-ac45-048218214193 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:17.631372 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-73cc4ddd-6a00-4838-ac45-048218214193 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:17.632217 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-73cc4ddd-6a00-4838-ac45-048218214193 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:17.633313 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-73cc4ddd-6a00-4838-ac45-048218214193 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:17.638417 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-73cc4ddd-6a00-4838-ac45-048218214193 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:17.639817 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-73cc4ddd-6a00-4838-ac45-048218214193 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:17.646244 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-c5234647-7213-479d-af28-3cb9585c3cc3 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:17.655459 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-c5234647-7213-479d-af28-3cb9585c3cc3 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18" status: 200 len: 1365 microversion: 2.1 time: 1.072218 Sep 21 16:26:17.679767 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 187/435] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:16 2022] GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18 => generated 1365 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:26:17.690094 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-e4dc1628-44b8-4e81-9e59-d16e363409c7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:17.695050 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-e4dc1628-44b8-4e81-9e59-d16e363409c7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:17.707982 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e4dc1628-44b8-4e81-9e59-d16e363409c7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:17.708845 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e4dc1628-44b8-4e81-9e59-d16e363409c7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:17.714884 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e4dc1628-44b8-4e81-9e59-d16e363409c7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:17.716101 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e4dc1628-44b8-4e81-9e59-d16e363409c7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:17.717465 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e4dc1628-44b8-4e81-9e59-d16e363409c7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:17.718266 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e4dc1628-44b8-4e81-9e59-d16e363409c7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:17.935988 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-73cc4ddd-6a00-4838-ac45-048218214193 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:17.944947 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-73cc4ddd-6a00-4838-ac45-048218214193 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1358 microversion: 2.1 time: 0.345206 Sep 21 16:26:17.947618 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 249/436] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:17 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1358 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:18.536823 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-11f8ff64-c921-46c2-af3a-81d532628632 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:18.537441 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-11f8ff64-c921-46c2-af3a-81d532628632 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:18.551269 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-11f8ff64-c921-46c2-af3a-81d532628632 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:18.551773 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-11f8ff64-c921-46c2-af3a-81d532628632 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:18.552214 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-11f8ff64-c921-46c2-af3a-81d532628632 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:18.552979 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-11f8ff64-c921-46c2-af3a-81d532628632 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:18.553406 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-11f8ff64-c921-46c2-af3a-81d532628632 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:18.553846 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-11f8ff64-c921-46c2-af3a-81d532628632 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:18.643280 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:26:19.130228 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-e4dc1628-44b8-4e81-9e59-d16e363409c7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:19.141087 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-e4dc1628-44b8-4e81-9e59-d16e363409c7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:19.148175 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-e4dc1628-44b8-4e81-9e59-d16e363409c7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:19.151626 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-e4dc1628-44b8-4e81-9e59-d16e363409c7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1751 microversion: 2.20 time: 1.470463 Sep 21 16:26:19.156346 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 188/437] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:26:17 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1751 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:26:19.176677 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-f95027ad-b96c-4120-bb30-30c0296a136d tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:19.177654 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-f95027ad-b96c-4120-bb30-30c0296a136d tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 7ffeddb1-1776-4585-9f48-3920444b4b18] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:19.191955 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f95027ad-b96c-4120-bb30-30c0296a136d tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:19.198428 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f95027ad-b96c-4120-bb30-30c0296a136d tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:19.199163 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f95027ad-b96c-4120-bb30-30c0296a136d tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:19.200081 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f95027ad-b96c-4120-bb30-30c0296a136d tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:19.200701 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f95027ad-b96c-4120-bb30-30c0296a136d tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:19.209301 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f95027ad-b96c-4120-bb30-30c0296a136d tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:19.311843 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-11f8ff64-c921-46c2-af3a-81d532628632 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:19.329337 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-11f8ff64-c921-46c2-af3a-81d532628632 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1371 microversion: 2.1 time: 0.796226 Sep 21 16:26:19.333091 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 250/438] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:18 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1371 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:19.350322 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-9e60463b-be85-4ed2-8083-96fd56ac5e51 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:19.351431 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-9e60463b-be85-4ed2-8083-96fd56ac5e51 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:19.370086 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9e60463b-be85-4ed2-8083-96fd56ac5e51 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:19.370627 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9e60463b-be85-4ed2-8083-96fd56ac5e51 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:19.371139 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9e60463b-be85-4ed2-8083-96fd56ac5e51 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:19.371921 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9e60463b-be85-4ed2-8083-96fd56ac5e51 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:19.372374 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9e60463b-be85-4ed2-8083-96fd56ac5e51 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:19.373156 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9e60463b-be85-4ed2-8083-96fd56ac5e51 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:19.940214 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-9e60463b-be85-4ed2-8083-96fd56ac5e51 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:19.955187 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-9e60463b-be85-4ed2-8083-96fd56ac5e51 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1358 microversion: 2.1 time: 0.620955 Sep 21 16:26:19.974505 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 251/439] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:19 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1358 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:20.158206 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-f95027ad-b96c-4120-bb30-30c0296a136d tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:20.169099 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-f95027ad-b96c-4120-bb30-30c0296a136d tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18" status: 200 len: 1365 microversion: 2.1 time: 1.011230 Sep 21 16:26:20.173222 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 189/440] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:19 2022] GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18 => generated 1365 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:20.196730 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-42138015-10aa-482e-95ec-9a1fca0c0f57 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:20.197625 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-42138015-10aa-482e-95ec-9a1fca0c0f57 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:20.208580 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-42138015-10aa-482e-95ec-9a1fca0c0f57 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:20.210014 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-42138015-10aa-482e-95ec-9a1fca0c0f57 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:20.213163 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-42138015-10aa-482e-95ec-9a1fca0c0f57 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:20.214199 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-42138015-10aa-482e-95ec-9a1fca0c0f57 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:20.219499 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-42138015-10aa-482e-95ec-9a1fca0c0f57 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:20.220245 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-42138015-10aa-482e-95ec-9a1fca0c0f57 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:20.354960 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-8ea459c2-75c6-4546-b994-c1c4e3abedc2 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:20.356171 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-8ea459c2-75c6-4546-b994-c1c4e3abedc2 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:20.368026 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8ea459c2-75c6-4546-b994-c1c4e3abedc2 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:20.368874 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8ea459c2-75c6-4546-b994-c1c4e3abedc2 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:20.369540 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8ea459c2-75c6-4546-b994-c1c4e3abedc2 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:20.370525 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8ea459c2-75c6-4546-b994-c1c4e3abedc2 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:20.371190 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8ea459c2-75c6-4546-b994-c1c4e3abedc2 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:20.371868 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8ea459c2-75c6-4546-b994-c1c4e3abedc2 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:20.704033 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-42138015-10aa-482e-95ec-9a1fca0c0f57 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:20.715138 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-42138015-10aa-482e-95ec-9a1fca0c0f57 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:20.721611 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-42138015-10aa-482e-95ec-9a1fca0c0f57 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:20.724506 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-42138015-10aa-482e-95ec-9a1fca0c0f57 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1751 microversion: 2.20 time: 0.532645 Sep 21 16:26:20.728085 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 252/441] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:26:20 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1751 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 16:26:20.940558 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-8ea459c2-75c6-4546-b994-c1c4e3abedc2 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:20.962228 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-8ea459c2-75c6-4546-b994-c1c4e3abedc2 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1371 microversion: 2.1 time: 0.610922 Sep 21 16:26:20.972580 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 190/442] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:20 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1371 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:20.989373 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-6658189b-6198-4054-a824-7c8d7988f0eb tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:20.999497 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-6658189b-6198-4054-a824-7c8d7988f0eb tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:21.025955 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6658189b-6198-4054-a824-7c8d7988f0eb tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:21.027006 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6658189b-6198-4054-a824-7c8d7988f0eb tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:21.028140 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6658189b-6198-4054-a824-7c8d7988f0eb tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:21.029905 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6658189b-6198-4054-a824-7c8d7988f0eb tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:21.030732 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6658189b-6198-4054-a824-7c8d7988f0eb tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:21.039204 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6658189b-6198-4054-a824-7c8d7988f0eb tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:21.208480 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-8b926690-5e37-460b-8f46-3d1cf3f80e59 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:21.210978 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-8b926690-5e37-460b-8f46-3d1cf3f80e59 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 7ffeddb1-1776-4585-9f48-3920444b4b18] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:21.237407 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8b926690-5e37-460b-8f46-3d1cf3f80e59 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:21.238255 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8b926690-5e37-460b-8f46-3d1cf3f80e59 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:21.240945 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8b926690-5e37-460b-8f46-3d1cf3f80e59 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:21.241689 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8b926690-5e37-460b-8f46-3d1cf3f80e59 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:21.245075 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8b926690-5e37-460b-8f46-3d1cf3f80e59 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:21.245860 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8b926690-5e37-460b-8f46-3d1cf3f80e59 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:21.700429 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-6658189b-6198-4054-a824-7c8d7988f0eb tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:21.729631 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-6658189b-6198-4054-a824-7c8d7988f0eb tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1358 microversion: 2.1 time: 0.741326 Sep 21 16:26:21.731941 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 253/443] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:20 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1358 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:21.754290 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-698856e7-7ea2-4db4-b460-5e711003b85a req-08362819-1bf2-4b39-b5d7-e94536c99e9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec70a608-9135-4656-a030-6429493b68fd", "tag": "e9fd8d4f-e98f-46e3-af56-5c8429307f9b"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:26:21.802509 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-698856e7-7ea2-4db4-b460-5e711003b85a req-08362819-1bf2-4b39-b5d7-e94536c99e9d service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:21.803506 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-698856e7-7ea2-4db4-b460-5e711003b85a req-08362819-1bf2-4b39-b5d7-e94536c99e9d service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:21.804207 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-698856e7-7ea2-4db4-b460-5e711003b85a req-08362819-1bf2-4b39-b5d7-e94536c99e9d service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:21.841167 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-698856e7-7ea2-4db4-b460-5e711003b85a req-08362819-1bf2-4b39-b5d7-e94536c99e9d service nova] Creating event network-changed:e9fd8d4f-e98f-46e3-af56-5c8429307f9b for instance ec70a608-9135-4656-a030-6429493b68fd on hv-cinder-85862 Sep 21 16:26:21.863546 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-698856e7-7ea2-4db4-b460-5e711003b85a req-08362819-1bf2-4b39-b5d7-e94536c99e9d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124433 Sep 21 16:26:21.871081 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 254/444] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:26:21.891075 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-d1810d0a-b3ed-43cc-9707-ac3e02305751 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:21.895888 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-d1810d0a-b3ed-43cc-9707-ac3e02305751 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:21.908442 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d1810d0a-b3ed-43cc-9707-ac3e02305751 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:21.915468 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d1810d0a-b3ed-43cc-9707-ac3e02305751 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:21.916216 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d1810d0a-b3ed-43cc-9707-ac3e02305751 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:21.917270 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d1810d0a-b3ed-43cc-9707-ac3e02305751 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:21.918021 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d1810d0a-b3ed-43cc-9707-ac3e02305751 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:21.918654 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d1810d0a-b3ed-43cc-9707-ac3e02305751 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:22.273113 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d1810d0a-b3ed-43cc-9707-ac3e02305751 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:22.294183 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d1810d0a-b3ed-43cc-9707-ac3e02305751 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:22.297386 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d1810d0a-b3ed-43cc-9707-ac3e02305751 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:22.311804 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-d1810d0a-b3ed-43cc-9707-ac3e02305751 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1751 microversion: 2.20 time: 0.436837 Sep 21 16:26:22.313269 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 255/445] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:26:21 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1751 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:26:22.333442 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-5782941b-0812-4449-b742-31c59414200f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:22.334233 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-5782941b-0812-4449-b742-31c59414200f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:22.362158 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5782941b-0812-4449-b742-31c59414200f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:22.362807 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5782941b-0812-4449-b742-31c59414200f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:22.367046 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5782941b-0812-4449-b742-31c59414200f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:22.374741 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5782941b-0812-4449-b742-31c59414200f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:22.375252 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5782941b-0812-4449-b742-31c59414200f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:22.376864 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5782941b-0812-4449-b742-31c59414200f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:23.221406 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-8b926690-5e37-460b-8f46-3d1cf3f80e59 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:23.237678 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-8b926690-5e37-460b-8f46-3d1cf3f80e59 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18" status: 200 len: 1365 microversion: 2.1 time: 2.033301 Sep 21 16:26:23.240490 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 191/446] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:21 2022] GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18 => generated 1365 bytes in 2040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:23.257638 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-0549cd65-b480-468e-87c8-ea1371270418 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:23.271082 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-0549cd65-b480-468e-87c8-ea1371270418 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:23.292223 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0549cd65-b480-468e-87c8-ea1371270418 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:23.296000 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0549cd65-b480-468e-87c8-ea1371270418 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:23.296673 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0549cd65-b480-468e-87c8-ea1371270418 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:23.298705 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0549cd65-b480-468e-87c8-ea1371270418 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:23.303581 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0549cd65-b480-468e-87c8-ea1371270418 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:23.304299 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0549cd65-b480-468e-87c8-ea1371270418 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:23.449164 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5782941b-0812-4449-b742-31c59414200f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:23.476389 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-5782941b-0812-4449-b742-31c59414200f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1371 microversion: 2.1 time: 1.161957 Sep 21 16:26:23.496336 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 256/447] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:22 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1371 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:23.510064 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-47753a00-74a8-4daf-b826-04b6a775486c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:23.510971 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-47753a00-74a8-4daf-b826-04b6a775486c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:23.530462 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-47753a00-74a8-4daf-b826-04b6a775486c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:23.531373 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-47753a00-74a8-4daf-b826-04b6a775486c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:23.532003 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-47753a00-74a8-4daf-b826-04b6a775486c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:23.533059 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-47753a00-74a8-4daf-b826-04b6a775486c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:23.533699 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-47753a00-74a8-4daf-b826-04b6a775486c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:23.535973 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-47753a00-74a8-4daf-b826-04b6a775486c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:24.035719 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-47753a00-74a8-4daf-b826-04b6a775486c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:24.057321 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-47753a00-74a8-4daf-b826-04b6a775486c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:24.063494 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-47753a00-74a8-4daf-b826-04b6a775486c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:24.066485 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-47753a00-74a8-4daf-b826-04b6a775486c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1751 microversion: 2.20 time: 0.568820 Sep 21 16:26:24.070245 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 257/448] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:26:23 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1751 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:26:24.274222 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-119f2270-b344-4507-bb23-c0e8e2662285 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:24.275144 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-119f2270-b344-4507-bb23-c0e8e2662285 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 7ffeddb1-1776-4585-9f48-3920444b4b18] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:24.293624 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-119f2270-b344-4507-bb23-c0e8e2662285 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:24.294254 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-119f2270-b344-4507-bb23-c0e8e2662285 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:24.302419 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-119f2270-b344-4507-bb23-c0e8e2662285 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:24.303440 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-119f2270-b344-4507-bb23-c0e8e2662285 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:24.304087 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-119f2270-b344-4507-bb23-c0e8e2662285 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:24.305990 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-119f2270-b344-4507-bb23-c0e8e2662285 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:24.746608 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-119f2270-b344-4507-bb23-c0e8e2662285 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:24.759261 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-119f2270-b344-4507-bb23-c0e8e2662285 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18" status: 200 len: 1365 microversion: 2.1 time: 0.491359 Sep 21 16:26:24.770721 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 258/449] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:24 2022] GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18 => generated 1365 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:26:24.788966 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-0549cd65-b480-468e-87c8-ea1371270418 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:24.803903 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-8a41b402-cfa3-4980-9392-40339a780a49 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:24.808986 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-0549cd65-b480-468e-87c8-ea1371270418 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1358 microversion: 2.1 time: 1.567084 Sep 21 16:26:24.809520 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-8a41b402-cfa3-4980-9392-40339a780a49 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:24.814485 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 192/450] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:23 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1358 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:24.832404 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-f8b526fa-9535-44ba-864e-44cf0ba3dd41 req-e341b1e1-4b36-4f4a-b0b4-edeac1bce81c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c95f478c-11b2-4097-b4b1-551d61fa9664", "tag": "7cbba0ad-56a3-429e-97a5-3e5eae0b9c40"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:26:24.832966 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8a41b402-cfa3-4980-9392-40339a780a49 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:24.833850 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8a41b402-cfa3-4980-9392-40339a780a49 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:24.834884 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8a41b402-cfa3-4980-9392-40339a780a49 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:24.835863 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8a41b402-cfa3-4980-9392-40339a780a49 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:24.837064 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8a41b402-cfa3-4980-9392-40339a780a49 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:24.837741 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8a41b402-cfa3-4980-9392-40339a780a49 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:24.859161 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-f8b526fa-9535-44ba-864e-44cf0ba3dd41 req-e341b1e1-4b36-4f4a-b0b4-edeac1bce81c service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:24.866812 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-f8b526fa-9535-44ba-864e-44cf0ba3dd41 req-e341b1e1-4b36-4f4a-b0b4-edeac1bce81c service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:24.867434 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-f8b526fa-9535-44ba-864e-44cf0ba3dd41 req-e341b1e1-4b36-4f4a-b0b4-edeac1bce81c service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:24.887963 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-f8b526fa-9535-44ba-864e-44cf0ba3dd41 req-e341b1e1-4b36-4f4a-b0b4-edeac1bce81c service nova] Creating event network-changed:7cbba0ad-56a3-429e-97a5-3e5eae0b9c40 for instance c95f478c-11b2-4097-b4b1-551d61fa9664 on hv-cinder-85862 Sep 21 16:26:24.903771 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-f8b526fa-9535-44ba-864e-44cf0ba3dd41 req-e341b1e1-4b36-4f4a-b0b4-edeac1bce81c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084562 Sep 21 16:26:24.906122 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 193/451] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:26:25.118599 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-96cc16cc-46db-4536-8aae-271d84561878 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:25.119995 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-96cc16cc-46db-4536-8aae-271d84561878 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:25.147805 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-96cc16cc-46db-4536-8aae-271d84561878 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:25.148500 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-96cc16cc-46db-4536-8aae-271d84561878 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:25.149130 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-96cc16cc-46db-4536-8aae-271d84561878 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:25.150032 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-96cc16cc-46db-4536-8aae-271d84561878 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:25.152107 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-96cc16cc-46db-4536-8aae-271d84561878 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:25.154282 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-96cc16cc-46db-4536-8aae-271d84561878 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:25.296294 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-8a41b402-cfa3-4980-9392-40339a780a49 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:25.312867 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-8a41b402-cfa3-4980-9392-40339a780a49 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1371 microversion: 2.1 time: 0.540918 Sep 21 16:26:25.319596 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 259/452] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:24 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1371 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:25.795919 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-1c05c232-c8b4-4d89-8b65-3c1a5f1ef276 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:25.801285 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-1c05c232-c8b4-4d89-8b65-3c1a5f1ef276 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 7ffeddb1-1776-4585-9f48-3920444b4b18] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:25.834203 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1c05c232-c8b4-4d89-8b65-3c1a5f1ef276 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:25.836629 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1c05c232-c8b4-4d89-8b65-3c1a5f1ef276 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:25.841133 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1c05c232-c8b4-4d89-8b65-3c1a5f1ef276 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:25.846405 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1c05c232-c8b4-4d89-8b65-3c1a5f1ef276 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:25.847877 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1c05c232-c8b4-4d89-8b65-3c1a5f1ef276 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:25.849724 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1c05c232-c8b4-4d89-8b65-3c1a5f1ef276 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:26.264448 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-1c05c232-c8b4-4d89-8b65-3c1a5f1ef276 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:26.286811 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-1c05c232-c8b4-4d89-8b65-3c1a5f1ef276 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18" status: 200 len: 1365 microversion: 2.1 time: 0.499110 Sep 21 16:26:26.292099 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 260/453] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:25 2022] GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18 => generated 1365 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:26.319483 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-f1eba553-7715-4471-b9e6-b7d7b946247f tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:26.320642 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-f1eba553-7715-4471-b9e6-b7d7b946247f tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:26.346670 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f1eba553-7715-4471-b9e6-b7d7b946247f tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:26.355301 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f1eba553-7715-4471-b9e6-b7d7b946247f tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:26.359234 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f1eba553-7715-4471-b9e6-b7d7b946247f tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:26.361919 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f1eba553-7715-4471-b9e6-b7d7b946247f tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:26.370940 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f1eba553-7715-4471-b9e6-b7d7b946247f tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:26.373954 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f1eba553-7715-4471-b9e6-b7d7b946247f tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:26.529805 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-96cc16cc-46db-4536-8aae-271d84561878 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:26.540494 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-96cc16cc-46db-4536-8aae-271d84561878 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:26.554021 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-96cc16cc-46db-4536-8aae-271d84561878 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:26.566125 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-96cc16cc-46db-4536-8aae-271d84561878 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1751 microversion: 2.20 time: 1.449582 Sep 21 16:26:26.569702 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 194/454] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:26:25 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1751 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 16:26:26.589669 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d18f70e3-af32-4ff0-9760-e4066bb86553 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:26.590962 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d18f70e3-af32-4ff0-9760-e4066bb86553 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:26.614374 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d18f70e3-af32-4ff0-9760-e4066bb86553 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:26.617435 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d18f70e3-af32-4ff0-9760-e4066bb86553 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:26.626889 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d18f70e3-af32-4ff0-9760-e4066bb86553 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:26.628276 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d18f70e3-af32-4ff0-9760-e4066bb86553 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:26.631122 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d18f70e3-af32-4ff0-9760-e4066bb86553 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:26.631987 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d18f70e3-af32-4ff0-9760-e4066bb86553 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:27.890731 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-f1eba553-7715-4471-b9e6-b7d7b946247f tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:27.960926 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-f1eba553-7715-4471-b9e6-b7d7b946247f tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1358 microversion: 2.1 time: 1.667131 Sep 21 16:26:27.965968 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 261/455] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:26 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1358 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:27.979375 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-50426b26-4eb7-4722-aab2-40de63e44aa8 req-cbcc2b28-b553-4808-84ea-d560519ac4bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ffeddb1-1776-4585-9f48-3920444b4b18", "name": "network-vif-plugged", "status": "completed", "tag": "a15d4d58-da23-48ff-988c-d87d69afffc5"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:26:28.016618 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-50426b26-4eb7-4722-aab2-40de63e44aa8 req-cbcc2b28-b553-4808-84ea-d560519ac4bd service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:28.022914 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d18f70e3-af32-4ff0-9760-e4066bb86553 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:28.033664 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d18f70e3-af32-4ff0-9760-e4066bb86553 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1371 microversion: 2.1 time: 1.456746 Sep 21 16:26:28.035089 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-50426b26-4eb7-4722-aab2-40de63e44aa8 req-cbcc2b28-b553-4808-84ea-d560519ac4bd service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:28.036628 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-50426b26-4eb7-4722-aab2-40de63e44aa8 req-cbcc2b28-b553-4808-84ea-d560519ac4bd service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:28.042846 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 195/456] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:26 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1371 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:28.067505 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d147fc3e-67d3-4799-94a9-f394850d3a26 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:28.068525 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d147fc3e-67d3-4799-94a9-f394850d3a26 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 7ffeddb1-1776-4585-9f48-3920444b4b18] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:28.079840 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-50426b26-4eb7-4722-aab2-40de63e44aa8 req-cbcc2b28-b553-4808-84ea-d560519ac4bd service nova] Creating event network-vif-plugged:a15d4d58-da23-48ff-988c-d87d69afffc5 for instance 7ffeddb1-1776-4585-9f48-3920444b4b18 on hv-cinder-85862 Sep 21 16:26:28.084454 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d147fc3e-67d3-4799-94a9-f394850d3a26 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:28.090900 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d147fc3e-67d3-4799-94a9-f394850d3a26 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:28.092722 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d147fc3e-67d3-4799-94a9-f394850d3a26 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:28.093720 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d147fc3e-67d3-4799-94a9-f394850d3a26 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:28.096545 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d147fc3e-67d3-4799-94a9-f394850d3a26 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:28.099521 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-50426b26-4eb7-4722-aab2-40de63e44aa8 req-cbcc2b28-b553-4808-84ea-d560519ac4bd service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126147 Sep 21 16:26:28.100268 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d147fc3e-67d3-4799-94a9-f394850d3a26 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:28.109233 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 262/457] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:26:28.122152 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-86be7255-e60e-424c-80f9-b6337f7234ce tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:28.142332 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-86be7255-e60e-424c-80f9-b6337f7234ce tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:28.156753 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-86be7255-e60e-424c-80f9-b6337f7234ce tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:28.165123 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-86be7255-e60e-424c-80f9-b6337f7234ce tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:28.177462 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-86be7255-e60e-424c-80f9-b6337f7234ce tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:28.178562 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-86be7255-e60e-424c-80f9-b6337f7234ce tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:28.179168 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-86be7255-e60e-424c-80f9-b6337f7234ce tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:28.180160 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-86be7255-e60e-424c-80f9-b6337f7234ce tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:28.524836 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-86be7255-e60e-424c-80f9-b6337f7234ce tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:28.538869 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-86be7255-e60e-424c-80f9-b6337f7234ce tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:28.542396 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-86be7255-e60e-424c-80f9-b6337f7234ce tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:28.545118 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-86be7255-e60e-424c-80f9-b6337f7234ce tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1751 microversion: 2.20 time: 0.433789 Sep 21 16:26:28.546535 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 263/458] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:26:28 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1751 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:26:28.750284 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d147fc3e-67d3-4799-94a9-f394850d3a26 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:28.761749 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d147fc3e-67d3-4799-94a9-f394850d3a26 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18" status: 200 len: 1365 microversion: 2.1 time: 0.715462 Sep 21 16:26:28.778259 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 196/459] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:28 2022] GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18 => generated 1365 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:28.996396 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-b6785082-d0ce-4e84-9ff7-df7b830d02ad tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:28.997886 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-b6785082-d0ce-4e84-9ff7-df7b830d02ad tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:29.009550 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b6785082-d0ce-4e84-9ff7-df7b830d02ad tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:29.011316 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b6785082-d0ce-4e84-9ff7-df7b830d02ad tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:29.013110 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b6785082-d0ce-4e84-9ff7-df7b830d02ad tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:29.015124 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b6785082-d0ce-4e84-9ff7-df7b830d02ad tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:29.017629 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b6785082-d0ce-4e84-9ff7-df7b830d02ad tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:29.018278 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b6785082-d0ce-4e84-9ff7-df7b830d02ad tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:29.081607 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d7bfe5b0-fa7b-4243-8438-625b2ea3f0b4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:29.083048 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d7bfe5b0-fa7b-4243-8438-625b2ea3f0b4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:29.098869 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d7bfe5b0-fa7b-4243-8438-625b2ea3f0b4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:29.099714 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d7bfe5b0-fa7b-4243-8438-625b2ea3f0b4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:29.100318 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d7bfe5b0-fa7b-4243-8438-625b2ea3f0b4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:29.101552 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d7bfe5b0-fa7b-4243-8438-625b2ea3f0b4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:29.102198 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d7bfe5b0-fa7b-4243-8438-625b2ea3f0b4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:29.102775 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d7bfe5b0-fa7b-4243-8438-625b2ea3f0b4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:29.333092 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-b6785082-d0ce-4e84-9ff7-df7b830d02ad tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:29.346545 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-b6785082-d0ce-4e84-9ff7-df7b830d02ad tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1358 microversion: 2.1 time: 0.354362 Sep 21 16:26:29.348947 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 264/460] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:28 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1358 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:29.471594 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d7bfe5b0-fa7b-4243-8438-625b2ea3f0b4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:29.482764 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d7bfe5b0-fa7b-4243-8438-625b2ea3f0b4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1371 microversion: 2.1 time: 0.405510 Sep 21 16:26:29.483608 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 197/461] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:29 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1371 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:26:29.589999 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-3f572384-96c4-482d-9773-cdb8997482f4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:29.590676 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-3f572384-96c4-482d-9773-cdb8997482f4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:29.606252 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3f572384-96c4-482d-9773-cdb8997482f4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:29.612380 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3f572384-96c4-482d-9773-cdb8997482f4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:29.615496 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3f572384-96c4-482d-9773-cdb8997482f4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:29.618244 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3f572384-96c4-482d-9773-cdb8997482f4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:29.620961 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3f572384-96c4-482d-9773-cdb8997482f4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:29.621450 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3f572384-96c4-482d-9773-cdb8997482f4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:29.794091 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-0a76fe51-e018-481c-a490-57a8aea6469f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:29.796482 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-0a76fe51-e018-481c-a490-57a8aea6469f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 7ffeddb1-1776-4585-9f48-3920444b4b18] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:29.879081 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0a76fe51-e018-481c-a490-57a8aea6469f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:29.879592 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0a76fe51-e018-481c-a490-57a8aea6469f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:29.880037 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0a76fe51-e018-481c-a490-57a8aea6469f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:29.880767 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0a76fe51-e018-481c-a490-57a8aea6469f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:29.881227 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0a76fe51-e018-481c-a490-57a8aea6469f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:29.881657 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0a76fe51-e018-481c-a490-57a8aea6469f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:30.006875 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-3f572384-96c4-482d-9773-cdb8997482f4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:30.018206 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-3f572384-96c4-482d-9773-cdb8997482f4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:30.025554 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-3f572384-96c4-482d-9773-cdb8997482f4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:30.028516 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-3f572384-96c4-482d-9773-cdb8997482f4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1751 microversion: 2.20 time: 0.442910 Sep 21 16:26:30.029400 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 265/462] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:26:29 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1751 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:26:30.381031 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-8996cdec-6267-4e76-bbba-2f8fe14720cc tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:30.381850 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-8996cdec-6267-4e76-bbba-2f8fe14720cc tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:30.414770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8996cdec-6267-4e76-bbba-2f8fe14720cc tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:30.415661 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8996cdec-6267-4e76-bbba-2f8fe14720cc tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:30.416526 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8996cdec-6267-4e76-bbba-2f8fe14720cc tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:30.417993 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8996cdec-6267-4e76-bbba-2f8fe14720cc tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:30.419031 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8996cdec-6267-4e76-bbba-2f8fe14720cc tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:30.427210 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8996cdec-6267-4e76-bbba-2f8fe14720cc tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:30.897166 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-8996cdec-6267-4e76-bbba-2f8fe14720cc tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:30.911412 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-8996cdec-6267-4e76-bbba-2f8fe14720cc tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1358 microversion: 2.1 time: 0.535936 Sep 21 16:26:30.940804 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 266/463] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:30 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1358 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:30.952168 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-b018f735-ee66-44e9-93fa-60204ca02a15 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:30.953086 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-b018f735-ee66-44e9-93fa-60204ca02a15 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:30.970943 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b018f735-ee66-44e9-93fa-60204ca02a15 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:30.971443 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b018f735-ee66-44e9-93fa-60204ca02a15 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:30.971882 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b018f735-ee66-44e9-93fa-60204ca02a15 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:30.972604 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b018f735-ee66-44e9-93fa-60204ca02a15 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:30.973061 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b018f735-ee66-44e9-93fa-60204ca02a15 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:30.973482 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b018f735-ee66-44e9-93fa-60204ca02a15 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:31.402332 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-b018f735-ee66-44e9-93fa-60204ca02a15 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:31.423394 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-b018f735-ee66-44e9-93fa-60204ca02a15 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1371 microversion: 2.1 time: 0.473874 Sep 21 16:26:31.440588 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 267/464] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:30 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1371 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:31.454725 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-9cf4157b-0d78-4e2e-9437-cc4bac898981 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:31.459437 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-9cf4157b-0d78-4e2e-9437-cc4bac898981 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:31.477285 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9cf4157b-0d78-4e2e-9437-cc4bac898981 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:31.477785 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9cf4157b-0d78-4e2e-9437-cc4bac898981 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:31.478283 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9cf4157b-0d78-4e2e-9437-cc4bac898981 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:31.484122 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9cf4157b-0d78-4e2e-9437-cc4bac898981 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:31.484682 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9cf4157b-0d78-4e2e-9437-cc4bac898981 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:31.485140 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9cf4157b-0d78-4e2e-9437-cc4bac898981 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:31.526299 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=100 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:26:31.599508 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-0a76fe51-e018-481c-a490-57a8aea6469f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:31.617134 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-0a76fe51-e018-481c-a490-57a8aea6469f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18" status: 200 len: 1365 microversion: 2.1 time: 1.833776 Sep 21 16:26:31.618355 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 198/465] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:29 2022] GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18 => generated 1365 bytes in 1837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:26:31.787965 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-9cf4157b-0d78-4e2e-9437-cc4bac898981 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:31.805701 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-9cf4157b-0d78-4e2e-9437-cc4bac898981 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:31.806781 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-9cf4157b-0d78-4e2e-9437-cc4bac898981 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:31.807993 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-9cf4157b-0d78-4e2e-9437-cc4bac898981 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1751 microversion: 2.20 time: 0.363663 Sep 21 16:26:31.808749 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 268/466] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:26:31 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1751 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:26:31.952873 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-b112714d-3224-4be8-b28f-3e90185b83ef tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:31.952873 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-b112714d-3224-4be8-b28f-3e90185b83ef tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:31.959552 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b112714d-3224-4be8-b28f-3e90185b83ef tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:31.960049 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b112714d-3224-4be8-b28f-3e90185b83ef tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:31.960491 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b112714d-3224-4be8-b28f-3e90185b83ef tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:31.961221 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b112714d-3224-4be8-b28f-3e90185b83ef tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:31.966006 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b112714d-3224-4be8-b28f-3e90185b83ef tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:31.969286 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b112714d-3224-4be8-b28f-3e90185b83ef tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:32.414081 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-b112714d-3224-4be8-b28f-3e90185b83ef tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:32.425581 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-b112714d-3224-4be8-b28f-3e90185b83ef tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1358 microversion: 2.1 time: 0.484362 Sep 21 16:26:32.429992 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 199/467] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:31 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1358 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:32.466309 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-5d6ec2e0-1974-44a3-a5ae-d508358344a4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:32.467083 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-5d6ec2e0-1974-44a3-a5ae-d508358344a4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:32.476430 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5d6ec2e0-1974-44a3-a5ae-d508358344a4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:32.478151 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5d6ec2e0-1974-44a3-a5ae-d508358344a4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:32.480172 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5d6ec2e0-1974-44a3-a5ae-d508358344a4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:32.486784 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5d6ec2e0-1974-44a3-a5ae-d508358344a4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:32.486784 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5d6ec2e0-1974-44a3-a5ae-d508358344a4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:32.486784 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5d6ec2e0-1974-44a3-a5ae-d508358344a4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:32.648556 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-eb087522-bf11-4a5f-bd93-de87ff369cce tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:32.649685 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-eb087522-bf11-4a5f-bd93-de87ff369cce tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 7ffeddb1-1776-4585-9f48-3920444b4b18] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:32.673338 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-eb087522-bf11-4a5f-bd93-de87ff369cce tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:32.673830 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-eb087522-bf11-4a5f-bd93-de87ff369cce tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:32.678536 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-eb087522-bf11-4a5f-bd93-de87ff369cce tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:32.682390 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-eb087522-bf11-4a5f-bd93-de87ff369cce tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:32.684597 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-eb087522-bf11-4a5f-bd93-de87ff369cce tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:32.694435 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-eb087522-bf11-4a5f-bd93-de87ff369cce tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:32.864990 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5d6ec2e0-1974-44a3-a5ae-d508358344a4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:32.892364 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-5d6ec2e0-1974-44a3-a5ae-d508358344a4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1371 microversion: 2.1 time: 0.439106 Sep 21 16:26:32.893247 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 269/468] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:32 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1371 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:32.909182 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-72063979-3e7a-47dc-85ae-ce6304bed275 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:32.909182 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-72063979-3e7a-47dc-85ae-ce6304bed275 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:32.931990 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-72063979-3e7a-47dc-85ae-ce6304bed275 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:32.940436 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-72063979-3e7a-47dc-85ae-ce6304bed275 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:32.940951 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-72063979-3e7a-47dc-85ae-ce6304bed275 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:32.941860 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-72063979-3e7a-47dc-85ae-ce6304bed275 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:32.942591 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-72063979-3e7a-47dc-85ae-ce6304bed275 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:32.943067 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-72063979-3e7a-47dc-85ae-ce6304bed275 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:33.265057 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-72063979-3e7a-47dc-85ae-ce6304bed275 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:33.274490 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-72063979-3e7a-47dc-85ae-ce6304bed275 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:33.275902 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-72063979-3e7a-47dc-85ae-ce6304bed275 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:33.277413 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-72063979-3e7a-47dc-85ae-ce6304bed275 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1751 microversion: 2.20 time: 0.383208 Sep 21 16:26:33.278637 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 270/469] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:26:32 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1751 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:26:33.436470 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-eb087522-bf11-4a5f-bd93-de87ff369cce tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:33.448596 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-eb087522-bf11-4a5f-bd93-de87ff369cce tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18" status: 200 len: 1365 microversion: 2.1 time: 0.805681 Sep 21 16:26:33.450001 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 200/470] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:32 2022] GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18 => generated 1365 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:26:33.473049 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c2169024-53c8-48e1-92f6-48c281d5e7ce tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:33.488744 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-c2169024-53c8-48e1-92f6-48c281d5e7ce tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:33.508619 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c2169024-53c8-48e1-92f6-48c281d5e7ce tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:33.509474 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c2169024-53c8-48e1-92f6-48c281d5e7ce tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:33.512285 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c2169024-53c8-48e1-92f6-48c281d5e7ce tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:33.515516 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c2169024-53c8-48e1-92f6-48c281d5e7ce tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:33.516245 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c2169024-53c8-48e1-92f6-48c281d5e7ce tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:33.519518 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c2169024-53c8-48e1-92f6-48c281d5e7ce tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:33.800769 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-c2169024-53c8-48e1-92f6-48c281d5e7ce tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:33.808984 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-c2169024-53c8-48e1-92f6-48c281d5e7ce tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1358 microversion: 2.1 time: 0.352870 Sep 21 16:26:33.809628 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 271/471] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:33 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1358 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:33.926836 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-978611ef-e661-4eed-abd7-620503988a1f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:33.926836 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-978611ef-e661-4eed-abd7-620503988a1f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:33.937050 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-978611ef-e661-4eed-abd7-620503988a1f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:33.937528 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-978611ef-e661-4eed-abd7-620503988a1f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:33.940250 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-978611ef-e661-4eed-abd7-620503988a1f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:33.941006 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-978611ef-e661-4eed-abd7-620503988a1f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:33.943816 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-978611ef-e661-4eed-abd7-620503988a1f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:33.944326 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-978611ef-e661-4eed-abd7-620503988a1f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:33.964629 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-18ceca36-0d13-4eb8-b94e-380799ada6a9 req-da2e578a-a6ba-4981-903d-c7a90a14d819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c95f478c-11b2-4097-b4b1-551d61fa9664", "name": "network-vif-plugged", "status": "completed", "tag": "7cbba0ad-56a3-429e-97a5-3e5eae0b9c40"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:26:33.993137 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-18ceca36-0d13-4eb8-b94e-380799ada6a9 req-da2e578a-a6ba-4981-903d-c7a90a14d819 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:33.993621 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-18ceca36-0d13-4eb8-b94e-380799ada6a9 req-da2e578a-a6ba-4981-903d-c7a90a14d819 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:33.994069 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-18ceca36-0d13-4eb8-b94e-380799ada6a9 req-da2e578a-a6ba-4981-903d-c7a90a14d819 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:34.052724 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-18ceca36-0d13-4eb8-b94e-380799ada6a9 req-da2e578a-a6ba-4981-903d-c7a90a14d819 service nova] Creating event network-vif-plugged:7cbba0ad-56a3-429e-97a5-3e5eae0b9c40 for instance c95f478c-11b2-4097-b4b1-551d61fa9664 on hv-cinder-85862 Sep 21 16:26:34.063862 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-18ceca36-0d13-4eb8-b94e-380799ada6a9 req-da2e578a-a6ba-4981-903d-c7a90a14d819 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104811 Sep 21 16:26:34.064830 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 272/472] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:26:34.304040 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ddac5f3f-1251-4b76-886f-84ff1305ec22 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:34.305041 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ddac5f3f-1251-4b76-886f-84ff1305ec22 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:34.318636 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ddac5f3f-1251-4b76-886f-84ff1305ec22 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:34.319266 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ddac5f3f-1251-4b76-886f-84ff1305ec22 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:34.324042 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ddac5f3f-1251-4b76-886f-84ff1305ec22 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:34.325920 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ddac5f3f-1251-4b76-886f-84ff1305ec22 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:34.326596 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ddac5f3f-1251-4b76-886f-84ff1305ec22 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:34.327045 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ddac5f3f-1251-4b76-886f-84ff1305ec22 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:34.479559 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-978611ef-e661-4eed-abd7-620503988a1f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:34.490125 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-978611ef-e661-4eed-abd7-620503988a1f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1371 microversion: 2.1 time: 0.571163 Sep 21 16:26:34.491701 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 201/473] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:33 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1371 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:34.496875 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-169ab0f9-f19a-4f96-900e-6f9ddaa86049 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:34.498425 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-169ab0f9-f19a-4f96-900e-6f9ddaa86049 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 7ffeddb1-1776-4585-9f48-3920444b4b18] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:34.507236 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-169ab0f9-f19a-4f96-900e-6f9ddaa86049 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:34.509332 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-169ab0f9-f19a-4f96-900e-6f9ddaa86049 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:34.510294 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-169ab0f9-f19a-4f96-900e-6f9ddaa86049 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:34.511862 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-169ab0f9-f19a-4f96-900e-6f9ddaa86049 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:34.512983 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-169ab0f9-f19a-4f96-900e-6f9ddaa86049 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:34.513768 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-169ab0f9-f19a-4f96-900e-6f9ddaa86049 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:34.784183 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ddac5f3f-1251-4b76-886f-84ff1305ec22 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:34.795712 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ddac5f3f-1251-4b76-886f-84ff1305ec22 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:34.809904 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ddac5f3f-1251-4b76-886f-84ff1305ec22 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:34.814084 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ddac5f3f-1251-4b76-886f-84ff1305ec22 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1751 microversion: 2.20 time: 0.513958 Sep 21 16:26:34.816749 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 273/474] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:26:34 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1751 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:26:34.842033 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-38994600-1dee-4719-9f81-7cdd24310994 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:34.842981 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-38994600-1dee-4719-9f81-7cdd24310994 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:34.851677 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-38994600-1dee-4719-9f81-7cdd24310994 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:34.852539 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-38994600-1dee-4719-9f81-7cdd24310994 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:34.853196 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-38994600-1dee-4719-9f81-7cdd24310994 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:34.854193 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-38994600-1dee-4719-9f81-7cdd24310994 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:34.854955 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-38994600-1dee-4719-9f81-7cdd24310994 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:34.855580 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-38994600-1dee-4719-9f81-7cdd24310994 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:35.175164 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-38994600-1dee-4719-9f81-7cdd24310994 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:35.188961 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-38994600-1dee-4719-9f81-7cdd24310994 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1358 microversion: 2.1 time: 0.359105 Sep 21 16:26:35.193818 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 274/475] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:34 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1358 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:35.528854 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-58a7f9dc-f263-4680-ad37-4dbb42865fe7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:35.533089 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-58a7f9dc-f263-4680-ad37-4dbb42865fe7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:35.548691 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-58a7f9dc-f263-4680-ad37-4dbb42865fe7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:35.549273 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-58a7f9dc-f263-4680-ad37-4dbb42865fe7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:35.550009 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-58a7f9dc-f263-4680-ad37-4dbb42865fe7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:35.552628 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-58a7f9dc-f263-4680-ad37-4dbb42865fe7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:35.553187 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-58a7f9dc-f263-4680-ad37-4dbb42865fe7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:35.554492 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-58a7f9dc-f263-4680-ad37-4dbb42865fe7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:35.632647 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-169ab0f9-f19a-4f96-900e-6f9ddaa86049 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:35.639970 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=100 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:26:35.664912 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-169ab0f9-f19a-4f96-900e-6f9ddaa86049 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18" status: 200 len: 1554 microversion: 2.1 time: 1.171794 Sep 21 16:26:35.666407 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 202/476] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:34 2022] GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18 => generated 1554 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:35.691541 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-751560b8-f4bf-45ab-9ede-02b1e1d08849 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:35.692436 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-751560b8-f4bf-45ab-9ede-02b1e1d08849 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 7ffeddb1-1776-4585-9f48-3920444b4b18] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:35.710367 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-751560b8-f4bf-45ab-9ede-02b1e1d08849 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:35.711346 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-751560b8-f4bf-45ab-9ede-02b1e1d08849 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:35.712001 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-751560b8-f4bf-45ab-9ede-02b1e1d08849 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:35.713314 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-751560b8-f4bf-45ab-9ede-02b1e1d08849 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:35.714011 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-751560b8-f4bf-45ab-9ede-02b1e1d08849 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:35.714765 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-751560b8-f4bf-45ab-9ede-02b1e1d08849 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:35.890170 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-58a7f9dc-f263-4680-ad37-4dbb42865fe7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:35.906554 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-58a7f9dc-f263-4680-ad37-4dbb42865fe7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1371 microversion: 2.1 time: 0.388467 Sep 21 16:26:35.907717 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 275/477] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:35 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1371 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:26:35.913573 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-42f772a8-5c7c-42c9-8b52-ff587d477201 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:35.914768 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-42f772a8-5c7c-42c9-8b52-ff587d477201 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:35.923359 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-42f772a8-5c7c-42c9-8b52-ff587d477201 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:35.925690 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-42f772a8-5c7c-42c9-8b52-ff587d477201 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:35.927972 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-42f772a8-5c7c-42c9-8b52-ff587d477201 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:35.929889 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-42f772a8-5c7c-42c9-8b52-ff587d477201 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:35.930802 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-42f772a8-5c7c-42c9-8b52-ff587d477201 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:35.931601 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-42f772a8-5c7c-42c9-8b52-ff587d477201 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:35.971960 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-751560b8-f4bf-45ab-9ede-02b1e1d08849 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.284827 Sep 21 16:26:35.988733 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 203/478] 10.222.0.64 () {58 vars in 1275 bytes} [Wed Sep 21 16:26:35 2022] GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18/os-interface => generated 284 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:26:36.177304 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-42f772a8-5c7c-42c9-8b52-ff587d477201 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:36.189766 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-42f772a8-5c7c-42c9-8b52-ff587d477201 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:36.197336 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-42f772a8-5c7c-42c9-8b52-ff587d477201 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:36.200494 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-42f772a8-5c7c-42c9-8b52-ff587d477201 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1753 microversion: 2.20 time: 0.291023 Sep 21 16:26:36.214095 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 276/479] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:26:35 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1753 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:26:36.243446 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-248e42ec-407d-4788-a4dd-aa643216a61d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:36.244397 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-248e42ec-407d-4788-a4dd-aa643216a61d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:36.269310 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-248e42ec-407d-4788-a4dd-aa643216a61d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:36.272412 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-248e42ec-407d-4788-a4dd-aa643216a61d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:36.274650 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-248e42ec-407d-4788-a4dd-aa643216a61d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:36.275707 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-248e42ec-407d-4788-a4dd-aa643216a61d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:36.278716 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-248e42ec-407d-4788-a4dd-aa643216a61d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:36.279496 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-248e42ec-407d-4788-a4dd-aa643216a61d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:36.758897 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-248e42ec-407d-4788-a4dd-aa643216a61d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:36.773460 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-248e42ec-407d-4788-a4dd-aa643216a61d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1358 microversion: 2.1 time: 0.547639 Sep 21 16:26:36.779444 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 204/480] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:36 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1358 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:36.947500 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-457bc9b8-30a1-4ca6-8264-f10750a2ed1c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:36.948238 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-457bc9b8-30a1-4ca6-8264-f10750a2ed1c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:36.963194 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-457bc9b8-30a1-4ca6-8264-f10750a2ed1c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:36.972881 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-457bc9b8-30a1-4ca6-8264-f10750a2ed1c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:36.975760 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-457bc9b8-30a1-4ca6-8264-f10750a2ed1c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:36.979133 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-457bc9b8-30a1-4ca6-8264-f10750a2ed1c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:36.990684 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-457bc9b8-30a1-4ca6-8264-f10750a2ed1c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:36.991400 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-457bc9b8-30a1-4ca6-8264-f10750a2ed1c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:37.228223 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-89e1e264-b4ef-409e-8e66-18029ae49b74 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:37.229149 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-89e1e264-b4ef-409e-8e66-18029ae49b74 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:37.246406 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-89e1e264-b4ef-409e-8e66-18029ae49b74 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:37.247293 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-89e1e264-b4ef-409e-8e66-18029ae49b74 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:37.247908 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-89e1e264-b4ef-409e-8e66-18029ae49b74 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:37.249124 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-89e1e264-b4ef-409e-8e66-18029ae49b74 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:37.249943 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-89e1e264-b4ef-409e-8e66-18029ae49b74 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:37.250654 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-89e1e264-b4ef-409e-8e66-18029ae49b74 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:37.745020 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-89e1e264-b4ef-409e-8e66-18029ae49b74 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:37.750900 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-457bc9b8-30a1-4ca6-8264-f10750a2ed1c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:37.759861 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-89e1e264-b4ef-409e-8e66-18029ae49b74 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:37.761371 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-89e1e264-b4ef-409e-8e66-18029ae49b74 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:37.763916 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-457bc9b8-30a1-4ca6-8264-f10750a2ed1c tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1371 microversion: 2.1 time: 0.821503 Sep 21 16:26:37.764579 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 277/481] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:36 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1371 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:37.785807 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-89e1e264-b4ef-409e-8e66-18029ae49b74 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1809 microversion: 2.20 time: 0.538673 Sep 21 16:26:37.788353 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 205/482] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:26:37 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1809 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:26:37.804697 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-66197b39-3e2b-473b-be7c-fd2ff37ae7fd tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:37.806256 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-66197b39-3e2b-473b-be7c-fd2ff37ae7fd tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:37.814370 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-66197b39-3e2b-473b-be7c-fd2ff37ae7fd tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:37.816330 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-66197b39-3e2b-473b-be7c-fd2ff37ae7fd tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:37.816950 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-66197b39-3e2b-473b-be7c-fd2ff37ae7fd tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:37.818179 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-66197b39-3e2b-473b-be7c-fd2ff37ae7fd tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:37.818804 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-66197b39-3e2b-473b-be7c-fd2ff37ae7fd tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:37.820743 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-66197b39-3e2b-473b-be7c-fd2ff37ae7fd tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:38.108212 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-66197b39-3e2b-473b-be7c-fd2ff37ae7fd tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:38.124652 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-66197b39-3e2b-473b-be7c-fd2ff37ae7fd tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1358 microversion: 2.1 time: 0.322007 Sep 21 16:26:38.125974 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 278/483] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:37 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1358 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:38.285630 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-322fc47e-600d-4591-87a2-55806dc16069 req-46daa156-ce34-4443-80a8-d0af5079fb1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ffeddb1-1776-4585-9f48-3920444b4b18", "tag": "a15d4d58-da23-48ff-988c-d87d69afffc5"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:26:38.310462 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-322fc47e-600d-4591-87a2-55806dc16069 req-46daa156-ce34-4443-80a8-d0af5079fb1a service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:38.311577 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-322fc47e-600d-4591-87a2-55806dc16069 req-46daa156-ce34-4443-80a8-d0af5079fb1a service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:38.312595 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-322fc47e-600d-4591-87a2-55806dc16069 req-46daa156-ce34-4443-80a8-d0af5079fb1a service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:38.344000 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-322fc47e-600d-4591-87a2-55806dc16069 req-46daa156-ce34-4443-80a8-d0af5079fb1a service nova] Creating event network-changed:a15d4d58-da23-48ff-988c-d87d69afffc5 for instance 7ffeddb1-1776-4585-9f48-3920444b4b18 on hv-cinder-85862 Sep 21 16:26:38.358961 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-322fc47e-600d-4591-87a2-55806dc16069 req-46daa156-ce34-4443-80a8-d0af5079fb1a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079262 Sep 21 16:26:38.365960 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 206/484] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:26:38.397828 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-c933d1f4-f12b-4f34-9018-c93ac6f2ca17 req-8046ddac-9324-44a8-9382-6377a1553370 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec70a608-9135-4656-a030-6429493b68fd", "name": "network-vif-plugged", "status": "completed", "tag": "e9fd8d4f-e98f-46e3-af56-5c8429307f9b"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:26:38.416153 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:26:38.440301 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-c933d1f4-f12b-4f34-9018-c93ac6f2ca17 req-8046ddac-9324-44a8-9382-6377a1553370 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:38.443814 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-c933d1f4-f12b-4f34-9018-c93ac6f2ca17 req-8046ddac-9324-44a8-9382-6377a1553370 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:38.445158 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-c933d1f4-f12b-4f34-9018-c93ac6f2ca17 req-8046ddac-9324-44a8-9382-6377a1553370 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:38.492621 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-c933d1f4-f12b-4f34-9018-c93ac6f2ca17 req-8046ddac-9324-44a8-9382-6377a1553370 service nova] Creating event network-vif-plugged:e9fd8d4f-e98f-46e3-af56-5c8429307f9b for instance ec70a608-9135-4656-a030-6429493b68fd on hv-cinder-85862 Sep 21 16:26:38.508645 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-c933d1f4-f12b-4f34-9018-c93ac6f2ca17 req-8046ddac-9324-44a8-9382-6377a1553370 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117229 Sep 21 16:26:38.511263 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 279/485] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:26:38.796308 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-f865d4ce-0b83-4974-ad83-c20a8712ee40 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:38.805836 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-f865d4ce-0b83-4974-ad83-c20a8712ee40 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:38.820961 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-aa8511ea-da22-4837-9c41-1c725b8f9f2c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:38.821838 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-aa8511ea-da22-4837-9c41-1c725b8f9f2c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:38.848696 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f865d4ce-0b83-4974-ad83-c20a8712ee40 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:38.857094 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-aa8511ea-da22-4837-9c41-1c725b8f9f2c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:38.858306 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f865d4ce-0b83-4974-ad83-c20a8712ee40 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:38.864232 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-aa8511ea-da22-4837-9c41-1c725b8f9f2c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:38.872284 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-aa8511ea-da22-4837-9c41-1c725b8f9f2c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:38.874954 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f865d4ce-0b83-4974-ad83-c20a8712ee40 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:38.883633 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-aa8511ea-da22-4837-9c41-1c725b8f9f2c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:38.884092 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-aa8511ea-da22-4837-9c41-1c725b8f9f2c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:38.884755 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-aa8511ea-da22-4837-9c41-1c725b8f9f2c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:38.888596 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f865d4ce-0b83-4974-ad83-c20a8712ee40 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:38.889856 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f865d4ce-0b83-4974-ad83-c20a8712ee40 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:38.890962 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f865d4ce-0b83-4974-ad83-c20a8712ee40 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:39.562542 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-aa8511ea-da22-4837-9c41-1c725b8f9f2c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:39.591070 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-aa8511ea-da22-4837-9c41-1c725b8f9f2c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:39.598667 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-aa8511ea-da22-4837-9c41-1c725b8f9f2c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:39.604386 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-aa8511ea-da22-4837-9c41-1c725b8f9f2c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1809 microversion: 2.20 time: 0.788192 Sep 21 16:26:39.605356 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 280/486] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:26:38 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1809 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:26:39.621053 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-56580605-37ab-4423-99a8-7049c142ef0d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:39.622916 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-56580605-37ab-4423-99a8-7049c142ef0d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:39.650613 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-56580605-37ab-4423-99a8-7049c142ef0d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:39.655496 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-56580605-37ab-4423-99a8-7049c142ef0d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:39.656150 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-56580605-37ab-4423-99a8-7049c142ef0d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:39.656922 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-56580605-37ab-4423-99a8-7049c142ef0d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:39.657434 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-56580605-37ab-4423-99a8-7049c142ef0d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:39.657875 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-56580605-37ab-4423-99a8-7049c142ef0d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:39.946016 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-f865d4ce-0b83-4974-ad83-c20a8712ee40 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:39.955812 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-f865d4ce-0b83-4974-ad83-c20a8712ee40 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1565 microversion: 2.1 time: 1.169121 Sep 21 16:26:39.960318 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 207/487] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:38 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1565 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:39.985013 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-66672425-0c7c-444a-ab57-8cc4be8798d6 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:39.985894 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-66672425-0c7c-444a-ab57-8cc4be8798d6 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:40.000282 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-66672425-0c7c-444a-ab57-8cc4be8798d6 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:40.003708 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-66672425-0c7c-444a-ab57-8cc4be8798d6 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:40.004421 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-66672425-0c7c-444a-ab57-8cc4be8798d6 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:40.005429 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-66672425-0c7c-444a-ab57-8cc4be8798d6 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:40.008497 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-66672425-0c7c-444a-ab57-8cc4be8798d6 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:40.009359 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-66672425-0c7c-444a-ab57-8cc4be8798d6 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:40.183636 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-56580605-37ab-4423-99a8-7049c142ef0d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:40.197947 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-56580605-37ab-4423-99a8-7049c142ef0d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1358 microversion: 2.1 time: 0.587067 Sep 21 16:26:40.198588 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 281/488] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:39 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1358 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:40.257029 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-66672425-0c7c-444a-ab57-8cc4be8798d6 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.276441 Sep 21 16:26:40.268104 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 208/489] 10.222.0.64 () {58 vars in 1275 bytes} [Wed Sep 21 16:26:39 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664/os-interface => generated 284 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:26:40.639354 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-d4cb95ae-e848-48d7-a9aa-8a9595dfb162 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:40.640707 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-d4cb95ae-e848-48d7-a9aa-8a9595dfb162 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:40.653687 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d4cb95ae-e848-48d7-a9aa-8a9595dfb162 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:40.654678 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d4cb95ae-e848-48d7-a9aa-8a9595dfb162 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:40.657090 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d4cb95ae-e848-48d7-a9aa-8a9595dfb162 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:40.658312 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d4cb95ae-e848-48d7-a9aa-8a9595dfb162 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:40.664232 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d4cb95ae-e848-48d7-a9aa-8a9595dfb162 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:40.665057 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d4cb95ae-e848-48d7-a9aa-8a9595dfb162 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:41.103108 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d4cb95ae-e848-48d7-a9aa-8a9595dfb162 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:41.126366 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d4cb95ae-e848-48d7-a9aa-8a9595dfb162 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:41.129020 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d4cb95ae-e848-48d7-a9aa-8a9595dfb162 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:41.132508 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-d4cb95ae-e848-48d7-a9aa-8a9595dfb162 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1809 microversion: 2.20 time: 0.497641 Sep 21 16:26:41.139073 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 282/490] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:26:40 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1809 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:26:41.226591 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-444739df-9433-48b2-8874-506cdad6d637 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:41.229188 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-444739df-9433-48b2-8874-506cdad6d637 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:41.250808 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-444739df-9433-48b2-8874-506cdad6d637 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:41.253088 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-444739df-9433-48b2-8874-506cdad6d637 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:41.255590 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-444739df-9433-48b2-8874-506cdad6d637 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:41.258654 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-444739df-9433-48b2-8874-506cdad6d637 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:41.260205 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-444739df-9433-48b2-8874-506cdad6d637 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:41.261664 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-444739df-9433-48b2-8874-506cdad6d637 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:41.525686 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-15218225-ef76-4a86-ae03-d7c90ed8a80e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Action: 'create', calling method: .version_select at 0x7fdb88bc1310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1166440784", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvH5lyZ1CKJVWPVNrqiW7JVtudb3n8FfJu13Bf5SXUl/QoJqSV08y6luuz7O2ZztkZHXoosx9W+c4Q8e0Hh9b3tgFc0MNa08dohb7819H9jtskoroO8uh6+okcwqqLnKg=="}} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:26:41.563907 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.quota [None req-15218225-ef76-4a86-ae03-d7c90ed8a80e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Getting quotas for project d529e1f3de6944f881c7fc572b1dc78e. Resources: {'key_pairs'} {{(pid=120532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 16:26:41.578312 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.quota [None req-15218225-ef76-4a86-ae03-d7c90ed8a80e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Getting quotas for user f619261c21204ea3b5ba624177eb8747 and project d529e1f3de6944f881c7fc572b1dc78e. Resources: {'key_pairs'} {{(pid=120532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 16:26:41.623509 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-15218225-ef76-4a86-ae03-d7c90ed8a80e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.294349 Sep 21 16:26:41.625164 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 283/491] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Sep 21 16:26:41 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:26:42.135568 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-444739df-9433-48b2-8874-506cdad6d637 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:42.144532 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-444739df-9433-48b2-8874-506cdad6d637 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1358 microversion: 2.1 time: 0.922069 Sep 21 16:26:42.158350 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 209/492] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:41 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1358 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:42.165273 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-e35c7587-4fde-4637-9515-31e3a419aaf4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:42.165928 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-e35c7587-4fde-4637-9515-31e3a419aaf4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:42.177124 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e35c7587-4fde-4637-9515-31e3a419aaf4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:42.177626 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e35c7587-4fde-4637-9515-31e3a419aaf4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:42.178106 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e35c7587-4fde-4637-9515-31e3a419aaf4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:42.178820 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e35c7587-4fde-4637-9515-31e3a419aaf4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:42.179280 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e35c7587-4fde-4637-9515-31e3a419aaf4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:42.179807 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e35c7587-4fde-4637-9515-31e3a419aaf4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:42.722223 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-e35c7587-4fde-4637-9515-31e3a419aaf4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:42.736093 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-e35c7587-4fde-4637-9515-31e3a419aaf4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:42.737688 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-e35c7587-4fde-4637-9515-31e3a419aaf4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:42.738965 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-e35c7587-4fde-4637-9515-31e3a419aaf4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1809 microversion: 2.20 time: 0.577903 Sep 21 16:26:42.741907 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 284/493] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:26:42 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1809 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:26:43.174796 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-abbe0944-f589-4d5c-bcd1-f4e0e3908f79 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:43.175529 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-abbe0944-f589-4d5c-bcd1-f4e0e3908f79 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:43.190224 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_api:SELECT=52 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:26:43.192940 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-abbe0944-f589-4d5c-bcd1-f4e0e3908f79 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:43.193713 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-abbe0944-f589-4d5c-bcd1-f4e0e3908f79 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:43.194488 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-abbe0944-f589-4d5c-bcd1-f4e0e3908f79 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:43.196614 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-abbe0944-f589-4d5c-bcd1-f4e0e3908f79 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:43.197610 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-abbe0944-f589-4d5c-bcd1-f4e0e3908f79 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:43.198470 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-abbe0944-f589-4d5c-bcd1-f4e0e3908f79 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:43.619272 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-4fe6d1f0-4ec2-4726-ac97-54a074444a05 req-8ba80b26-d256-43a9-a2fb-628b3aa641e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c95f478c-11b2-4097-b4b1-551d61fa9664", "tag": "7cbba0ad-56a3-429e-97a5-3e5eae0b9c40"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:26:43.661414 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-4fe6d1f0-4ec2-4726-ac97-54a074444a05 req-8ba80b26-d256-43a9-a2fb-628b3aa641e3 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:43.661938 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-4fe6d1f0-4ec2-4726-ac97-54a074444a05 req-8ba80b26-d256-43a9-a2fb-628b3aa641e3 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:43.665576 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-4fe6d1f0-4ec2-4726-ac97-54a074444a05 req-8ba80b26-d256-43a9-a2fb-628b3aa641e3 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:43.705896 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-abbe0944-f589-4d5c-bcd1-f4e0e3908f79 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:43.711068 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-4fe6d1f0-4ec2-4726-ac97-54a074444a05 req-8ba80b26-d256-43a9-a2fb-628b3aa641e3 service nova] Creating event network-changed:7cbba0ad-56a3-429e-97a5-3e5eae0b9c40 for instance c95f478c-11b2-4097-b4b1-551d61fa9664 on hv-cinder-85862 Sep 21 16:26:43.717903 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-abbe0944-f589-4d5c-bcd1-f4e0e3908f79 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1548 microversion: 2.1 time: 0.550056 Sep 21 16:26:43.718609 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-4fe6d1f0-4ec2-4726-ac97-54a074444a05 req-8ba80b26-d256-43a9-a2fb-628b3aa641e3 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104740 Sep 21 16:26:43.722851 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 285/494] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:26:43.736696 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 210/495] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:43 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1548 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:43.748542 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-b188ae28-ce75-4c90-b0a3-cc151acc80ff tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:43.749825 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-b188ae28-ce75-4c90-b0a3-cc151acc80ff tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:43.760115 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b188ae28-ce75-4c90-b0a3-cc151acc80ff tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:43.760869 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b188ae28-ce75-4c90-b0a3-cc151acc80ff tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:43.761489 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b188ae28-ce75-4c90-b0a3-cc151acc80ff tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:43.762528 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b188ae28-ce75-4c90-b0a3-cc151acc80ff tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:43.763207 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b188ae28-ce75-4c90-b0a3-cc151acc80ff tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:43.764459 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b188ae28-ce75-4c90-b0a3-cc151acc80ff tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:43.777172 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-2c88cb76-7d46-4f56-a925-72694b4dbeed tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:43.779032 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-2c88cb76-7d46-4f56-a925-72694b4dbeed tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:43.790095 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2c88cb76-7d46-4f56-a925-72694b4dbeed tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:43.790995 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2c88cb76-7d46-4f56-a925-72694b4dbeed tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:43.795675 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2c88cb76-7d46-4f56-a925-72694b4dbeed tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:43.797474 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2c88cb76-7d46-4f56-a925-72694b4dbeed tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:43.798179 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2c88cb76-7d46-4f56-a925-72694b4dbeed tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:43.799236 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2c88cb76-7d46-4f56-a925-72694b4dbeed tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:44.068159 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-b188ae28-ce75-4c90-b0a3-cc151acc80ff tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:44.080239 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-b188ae28-ce75-4c90-b0a3-cc151acc80ff tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1548 microversion: 2.1 time: 0.338508 Sep 21 16:26:44.081489 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 286/496] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:43 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1548 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:44.107792 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-bb9cffc4-3e05-4ef9-9156-b255679d16ac tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:44.124113 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-bb9cffc4-3e05-4ef9-9156-b255679d16ac tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:44.130956 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-bb9cffc4-3e05-4ef9-9156-b255679d16ac tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Searching by: {'deleted': False, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762'} {{(pid=120532) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 21 16:26:44.169660 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb9cffc4-3e05-4ef9-9156-b255679d16ac tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:44.170675 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb9cffc4-3e05-4ef9-9156-b255679d16ac tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:44.178109 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb9cffc4-3e05-4ef9-9156-b255679d16ac tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:44.179389 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb9cffc4-3e05-4ef9-9156-b255679d16ac tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:44.181835 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb9cffc4-3e05-4ef9-9156-b255679d16ac tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:44.186282 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb9cffc4-3e05-4ef9-9156-b255679d16ac tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:44.279947 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-2c88cb76-7d46-4f56-a925-72694b4dbeed tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:44.310207 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-2c88cb76-7d46-4f56-a925-72694b4dbeed tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:44.322431 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-2c88cb76-7d46-4f56-a925-72694b4dbeed tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:44.330122 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-2c88cb76-7d46-4f56-a925-72694b4dbeed tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1809 microversion: 2.20 time: 0.554159 Sep 21 16:26:44.331963 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 211/497] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:26:43 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1809 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 16:26:44.509691 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.multi_cell_list [None req-bb9cffc4-3e05-4ef9-9156-b255679d16ac tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120532) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 21 16:26:44.582454 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=100 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:26:44.646982 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-62ffc3fa-d4d3-4cc9-989c-031b3e4fa166 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:44.647867 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-62ffc3fa-d4d3-4cc9-989c-031b3e4fa166 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:44.679277 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-62ffc3fa-d4d3-4cc9-989c-031b3e4fa166 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:44.680145 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-62ffc3fa-d4d3-4cc9-989c-031b3e4fa166 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:44.681557 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-62ffc3fa-d4d3-4cc9-989c-031b3e4fa166 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:44.683438 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-62ffc3fa-d4d3-4cc9-989c-031b3e4fa166 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:44.685213 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-62ffc3fa-d4d3-4cc9-989c-031b3e4fa166 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:44.686615 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-62ffc3fa-d4d3-4cc9-989c-031b3e4fa166 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:44.813932 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-bb9cffc4-3e05-4ef9-9156-b255679d16ac tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.711543 Sep 21 16:26:44.823218 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 287/498] 10.222.0.64 () {58 vars in 1125 bytes} [Wed Sep 21 16:26:44 2022] GET /compute/v2.1/servers => generated 342 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:26:44.852015 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-eff1dba9-966b-4de8-a64c-981795035de0 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:44.857704 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-eff1dba9-966b-4de8-a64c-981795035de0 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:44.886139 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-eff1dba9-966b-4de8-a64c-981795035de0 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:44.888022 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-eff1dba9-966b-4de8-a64c-981795035de0 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:44.891020 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-eff1dba9-966b-4de8-a64c-981795035de0 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:44.892918 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-eff1dba9-966b-4de8-a64c-981795035de0 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:44.893402 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-eff1dba9-966b-4de8-a64c-981795035de0 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:44.902942 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-eff1dba9-966b-4de8-a64c-981795035de0 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:45.311843 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.objects.instance [None req-62ffc3fa-d4d3-4cc9-989c-031b3e4fa166 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lazy-loading 'services' on Instance uuid 1c1436cc-a3f6-4683-abf2-e8835aa53021 {{(pid=120531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 16:26:45.409818 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-eff1dba9-966b-4de8-a64c-981795035de0 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:45.452389 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-eff1dba9-966b-4de8-a64c-981795035de0 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1548 microversion: 2.1 time: 0.621326 Sep 21 16:26:45.453871 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 288/499] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:44 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1548 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:45.471449 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-2c29416c-4f21-448f-9069-0ead8bcc5e8f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:45.474174 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-2c29416c-4f21-448f-9069-0ead8bcc5e8f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:45.492839 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2c29416c-4f21-448f-9069-0ead8bcc5e8f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:45.498859 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2c29416c-4f21-448f-9069-0ead8bcc5e8f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:45.499923 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2c29416c-4f21-448f-9069-0ead8bcc5e8f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:45.503451 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2c29416c-4f21-448f-9069-0ead8bcc5e8f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:45.506822 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2c29416c-4f21-448f-9069-0ead8bcc5e8f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:45.508615 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2c29416c-4f21-448f-9069-0ead8bcc5e8f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:45.907650 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-62ffc3fa-d4d3-4cc9-989c-031b3e4fa166 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "DELETE /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021/os-volume_attachments/4258fd83-4b8c-4a03-aa95-28011ca4364f" status: 202 len: 0 microversion: 2.1 time: 1.269308 Sep 21 16:26:45.908267 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 212/500] 10.222.0.64 () {58 vars in 1416 bytes} [Wed Sep 21 16:26:44 2022] DELETE /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021/os-volume_attachments/4258fd83-4b8c-4a03-aa95-28011ca4364f => generated 0 bytes in 1272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 16:26:46.165087 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-2c29416c-4f21-448f-9069-0ead8bcc5e8f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:46.176056 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-2c29416c-4f21-448f-9069-0ead8bcc5e8f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:46.182072 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-2c29416c-4f21-448f-9069-0ead8bcc5e8f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:46.184432 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-2c29416c-4f21-448f-9069-0ead8bcc5e8f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1809 microversion: 2.20 time: 0.729190 Sep 21 16:26:46.185362 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 289/501] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:26:45 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1809 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:26:47.219580 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-56990b7d-add6-4cd6-b4a5-db74809e4ede tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:47.221282 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-56990b7d-add6-4cd6-b4a5-db74809e4ede tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:47.241265 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-56990b7d-add6-4cd6-b4a5-db74809e4ede tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:47.243254 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-56990b7d-add6-4cd6-b4a5-db74809e4ede tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:47.244024 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-56990b7d-add6-4cd6-b4a5-db74809e4ede tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:47.246842 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-56990b7d-add6-4cd6-b4a5-db74809e4ede tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:47.247756 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-56990b7d-add6-4cd6-b4a5-db74809e4ede tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:47.248648 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-56990b7d-add6-4cd6-b4a5-db74809e4ede tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:47.732913 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-56990b7d-add6-4cd6-b4a5-db74809e4ede tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:47.745435 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-56990b7d-add6-4cd6-b4a5-db74809e4ede tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:47.749089 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-56990b7d-add6-4cd6-b4a5-db74809e4ede tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:47.749089 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-56990b7d-add6-4cd6-b4a5-db74809e4ede tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1809 microversion: 2.20 time: 0.533860 Sep 21 16:26:47.749089 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 213/502] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:26:47 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1809 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:26:48.197290 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-b4be3413-8d4c-41a0-b10d-d66711405ced tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1943197-77d4-4241-bb47-1797a34a37a6"}} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:26:48.205274 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-b4be3413-8d4c-41a0-b10d-d66711405ced tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:48.226683 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b4be3413-8d4c-41a0-b10d-d66711405ced tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:48.226683 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b4be3413-8d4c-41a0-b10d-d66711405ced tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:48.226683 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b4be3413-8d4c-41a0-b10d-d66711405ced tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:48.228129 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b4be3413-8d4c-41a0-b10d-d66711405ced tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:48.228775 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b4be3413-8d4c-41a0-b10d-d66711405ced tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:48.229303 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b4be3413-8d4c-41a0-b10d-d66711405ced tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:48.504613 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-3c959181-b861-4f09-b361-f3ab95ca7551 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:26:48.543802 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3c959181-b861-4f09-b361-f3ab95ca7551 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:48.561944 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3c959181-b861-4f09-b361-f3ab95ca7551 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:48.563012 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3c959181-b861-4f09-b361-f3ab95ca7551 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:48.655161 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-3c959181-b861-4f09-b361-f3ab95ca7551 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Going to try to stop instance {{(pid=120531) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 21 16:26:48.818964 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-3c959181-b861-4f09-b361-f3ab95ca7551 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "POST /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021/action" status: 202 len: 0 microversion: 2.1 time: 0.313286 Sep 21 16:26:48.820883 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 214/503] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Sep 21 16:26:48 2022] POST /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 16:26:48.830789 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-9e3dcf15-fc85-4f06-9588-2958d77e16ea tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:48.832727 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-9e3dcf15-fc85-4f06-9588-2958d77e16ea tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:48.843842 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9e3dcf15-fc85-4f06-9588-2958d77e16ea tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:48.844638 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9e3dcf15-fc85-4f06-9588-2958d77e16ea tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:48.845860 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9e3dcf15-fc85-4f06-9588-2958d77e16ea tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:48.846832 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9e3dcf15-fc85-4f06-9588-2958d77e16ea tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:48.847479 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9e3dcf15-fc85-4f06-9588-2958d77e16ea tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:48.848367 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9e3dcf15-fc85-4f06-9588-2958d77e16ea tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:49.318475 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-b4be3413-8d4c-41a0-b10d-d66711405ced tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "POST /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.139424 Sep 21 16:26:49.320618 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 290/504] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Sep 21 16:26:48 2022] POST /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd/os-volume_attachments => generated 194 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:26:49.329465 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-90d66b66-3ed6-4aa0-a1c0-09e22e53b547 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:49.330410 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-90d66b66-3ed6-4aa0-a1c0-09e22e53b547 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:49.338367 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-90d66b66-3ed6-4aa0-a1c0-09e22e53b547 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:49.340514 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-90d66b66-3ed6-4aa0-a1c0-09e22e53b547 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:49.341171 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-90d66b66-3ed6-4aa0-a1c0-09e22e53b547 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:49.342325 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-90d66b66-3ed6-4aa0-a1c0-09e22e53b547 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:49.343130 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-90d66b66-3ed6-4aa0-a1c0-09e22e53b547 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:49.344081 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-90d66b66-3ed6-4aa0-a1c0-09e22e53b547 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:49.479483 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-9e3dcf15-fc85-4f06-9588-2958d77e16ea tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:49.545990 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-9e3dcf15-fc85-4f06-9588-2958d77e16ea tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:49.567843 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-9e3dcf15-fc85-4f06-9588-2958d77e16ea tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:49.590685 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-9e3dcf15-fc85-4f06-9588-2958d77e16ea tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1809 microversion: 2.20 time: 0.747572 Sep 21 16:26:49.592672 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 215/505] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:26:48 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1809 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:26:49.670613 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-90d66b66-3ed6-4aa0-a1c0-09e22e53b547 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:49.681655 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-90d66b66-3ed6-4aa0-a1c0-09e22e53b547 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1678 microversion: 2.1 time: 0.359324 Sep 21 16:26:49.702088 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 291/506] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:49 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1678 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:50.623937 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-5265e93f-d422-41a1-b821-bddb934b64da tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:50.625525 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-5265e93f-d422-41a1-b821-bddb934b64da tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:50.637229 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5265e93f-d422-41a1-b821-bddb934b64da tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:50.639852 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5265e93f-d422-41a1-b821-bddb934b64da tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:50.642909 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5265e93f-d422-41a1-b821-bddb934b64da tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:50.644211 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5265e93f-d422-41a1-b821-bddb934b64da tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:50.644742 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5265e93f-d422-41a1-b821-bddb934b64da tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:50.645372 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5265e93f-d422-41a1-b821-bddb934b64da tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:50.715082 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c64bbef4-0724-470f-8361-8aa6fef4b7ff tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:50.719085 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-c64bbef4-0724-470f-8361-8aa6fef4b7ff tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:50.763695 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c64bbef4-0724-470f-8361-8aa6fef4b7ff tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:50.764954 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c64bbef4-0724-470f-8361-8aa6fef4b7ff tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:50.766033 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c64bbef4-0724-470f-8361-8aa6fef4b7ff tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:50.767310 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c64bbef4-0724-470f-8361-8aa6fef4b7ff tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:50.768188 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c64bbef4-0724-470f-8361-8aa6fef4b7ff tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:50.773726 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c64bbef4-0724-470f-8361-8aa6fef4b7ff tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:50.932233 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-5265e93f-d422-41a1-b821-bddb934b64da tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:50.982004 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-5265e93f-d422-41a1-b821-bddb934b64da tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:51.001475 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-5265e93f-d422-41a1-b821-bddb934b64da tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:51.004687 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-5265e93f-d422-41a1-b821-bddb934b64da tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1809 microversion: 2.20 time: 0.385861 Sep 21 16:26:51.009335 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-c64bbef4-0724-470f-8361-8aa6fef4b7ff tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:51.035499 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-c64bbef4-0724-470f-8361-8aa6fef4b7ff tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1678 microversion: 2.1 time: 0.327089 Sep 21 16:26:51.039374 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 216/507] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:26:50 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1809 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:26:51.046767 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 292/508] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:50 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1678 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:52.062070 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-44c49702-d4c5-4455-a283-5b507d73918a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:52.063031 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-44c49702-d4c5-4455-a283-5b507d73918a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:52.087560 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-44c49702-d4c5-4455-a283-5b507d73918a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:52.088465 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-44c49702-d4c5-4455-a283-5b507d73918a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:52.088650 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-e39c9a23-d02f-4f52-8f46-09e41abbf221 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:52.090539 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-e39c9a23-d02f-4f52-8f46-09e41abbf221 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:52.090710 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-44c49702-d4c5-4455-a283-5b507d73918a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:52.091038 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-44c49702-d4c5-4455-a283-5b507d73918a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:52.091833 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-44c49702-d4c5-4455-a283-5b507d73918a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:52.092592 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-44c49702-d4c5-4455-a283-5b507d73918a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:52.095078 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell0:SELECT=4 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:26:52.104354 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e39c9a23-d02f-4f52-8f46-09e41abbf221 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:52.104354 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e39c9a23-d02f-4f52-8f46-09e41abbf221 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:52.104696 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e39c9a23-d02f-4f52-8f46-09e41abbf221 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:52.106075 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e39c9a23-d02f-4f52-8f46-09e41abbf221 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:52.106853 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e39c9a23-d02f-4f52-8f46-09e41abbf221 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:52.107450 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e39c9a23-d02f-4f52-8f46-09e41abbf221 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:52.329475 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-e39c9a23-d02f-4f52-8f46-09e41abbf221 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:52.341863 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-e39c9a23-d02f-4f52-8f46-09e41abbf221 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1678 microversion: 2.1 time: 0.260049 Sep 21 16:26:52.341863 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 293/509] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:52 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1678 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:52.345594 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-44c49702-d4c5-4455-a283-5b507d73918a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:52.365130 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-44c49702-d4c5-4455-a283-5b507d73918a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:52.367238 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-44c49702-d4c5-4455-a283-5b507d73918a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:52.372465 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-44c49702-d4c5-4455-a283-5b507d73918a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1809 microversion: 2.20 time: 0.315384 Sep 21 16:26:52.385654 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 217/510] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:26:52 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1809 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:26:53.387011 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ca70393e-4862-456b-b7e3-68783fbb17cd tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:53.388086 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ca70393e-4862-456b-b7e3-68783fbb17cd tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:53.395319 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ca70393e-4862-456b-b7e3-68783fbb17cd tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:53.395809 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ca70393e-4862-456b-b7e3-68783fbb17cd tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:53.396253 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ca70393e-4862-456b-b7e3-68783fbb17cd tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:53.396960 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ca70393e-4862-456b-b7e3-68783fbb17cd tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:53.397410 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ca70393e-4862-456b-b7e3-68783fbb17cd tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:53.397877 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ca70393e-4862-456b-b7e3-68783fbb17cd tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:53.421265 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-faf381d5-f8c8-4cf5-a597-9f8a148dfdb8 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:53.424902 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-faf381d5-f8c8-4cf5-a597-9f8a148dfdb8 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:53.451513 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-faf381d5-f8c8-4cf5-a597-9f8a148dfdb8 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:53.452993 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-faf381d5-f8c8-4cf5-a597-9f8a148dfdb8 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:53.454167 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-faf381d5-f8c8-4cf5-a597-9f8a148dfdb8 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:53.456066 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-faf381d5-f8c8-4cf5-a597-9f8a148dfdb8 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:53.457133 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-faf381d5-f8c8-4cf5-a597-9f8a148dfdb8 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:53.458703 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-faf381d5-f8c8-4cf5-a597-9f8a148dfdb8 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:53.669215 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ca70393e-4862-456b-b7e3-68783fbb17cd tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:53.694960 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ca70393e-4862-456b-b7e3-68783fbb17cd tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1678 microversion: 2.1 time: 0.308996 Sep 21 16:26:53.699162 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 294/511] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:53 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1678 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:26:53.782902 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-faf381d5-f8c8-4cf5-a597-9f8a148dfdb8 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:53.792257 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-faf381d5-f8c8-4cf5-a597-9f8a148dfdb8 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:53.794369 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-faf381d5-f8c8-4cf5-a597-9f8a148dfdb8 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:53.795568 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-faf381d5-f8c8-4cf5-a597-9f8a148dfdb8 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1809 microversion: 2.20 time: 0.386575 Sep 21 16:26:53.796149 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 218/512] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:26:53 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1809 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:26:54.721303 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-cda5aef6-0d93-45e7-b6ca-179b6c1d4fd7 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:54.722319 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-cda5aef6-0d93-45e7-b6ca-179b6c1d4fd7 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:54.724545 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell0:SELECT=2 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:26:54.732859 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cda5aef6-0d93-45e7-b6ca-179b6c1d4fd7 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:54.733354 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cda5aef6-0d93-45e7-b6ca-179b6c1d4fd7 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:54.733926 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cda5aef6-0d93-45e7-b6ca-179b6c1d4fd7 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:54.734669 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cda5aef6-0d93-45e7-b6ca-179b6c1d4fd7 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:54.735132 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cda5aef6-0d93-45e7-b6ca-179b6c1d4fd7 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:54.735562 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cda5aef6-0d93-45e7-b6ca-179b6c1d4fd7 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:54.821887 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-48ae04a7-11e6-4f08-9d82-daa644b7e9ef tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:54.822649 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-48ae04a7-11e6-4f08-9d82-daa644b7e9ef tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:54.829999 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-48ae04a7-11e6-4f08-9d82-daa644b7e9ef tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:54.830635 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-48ae04a7-11e6-4f08-9d82-daa644b7e9ef tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:54.831094 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-48ae04a7-11e6-4f08-9d82-daa644b7e9ef tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:54.831816 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-48ae04a7-11e6-4f08-9d82-daa644b7e9ef tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:54.832284 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-48ae04a7-11e6-4f08-9d82-daa644b7e9ef tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:54.832706 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-48ae04a7-11e6-4f08-9d82-daa644b7e9ef tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:54.837475 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:26:55.040461 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-cda5aef6-0d93-45e7-b6ca-179b6c1d4fd7 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:55.054674 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-cda5aef6-0d93-45e7-b6ca-179b6c1d4fd7 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1678 microversion: 2.1 time: 0.337204 Sep 21 16:26:55.063988 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 295/513] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:54 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1678 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:55.064389 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-48ae04a7-11e6-4f08-9d82-daa644b7e9ef tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:55.078462 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-48ae04a7-11e6-4f08-9d82-daa644b7e9ef tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:55.081478 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-48ae04a7-11e6-4f08-9d82-daa644b7e9ef tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:55.083106 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-48ae04a7-11e6-4f08-9d82-daa644b7e9ef tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1809 microversion: 2.20 time: 0.265208 Sep 21 16:26:55.084143 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 219/514] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:26:54 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1809 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 16:26:56.081044 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-6d4101a1-2907-49a2-a8db-5525fca7279e tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:56.082541 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-6d4101a1-2907-49a2-a8db-5525fca7279e tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:56.089806 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6d4101a1-2907-49a2-a8db-5525fca7279e tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:56.090702 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6d4101a1-2907-49a2-a8db-5525fca7279e tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:56.091385 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6d4101a1-2907-49a2-a8db-5525fca7279e tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:56.092352 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6d4101a1-2907-49a2-a8db-5525fca7279e tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:56.093036 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6d4101a1-2907-49a2-a8db-5525fca7279e tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:56.093710 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6d4101a1-2907-49a2-a8db-5525fca7279e tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:56.111557 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-327d11b7-251e-4f96-b109-dbed61198f8c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:56.114626 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-327d11b7-251e-4f96-b109-dbed61198f8c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:56.124673 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-327d11b7-251e-4f96-b109-dbed61198f8c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:56.124673 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-327d11b7-251e-4f96-b109-dbed61198f8c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:56.126507 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-327d11b7-251e-4f96-b109-dbed61198f8c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:56.127330 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-327d11b7-251e-4f96-b109-dbed61198f8c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:56.127862 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-327d11b7-251e-4f96-b109-dbed61198f8c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:56.128346 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-327d11b7-251e-4f96-b109-dbed61198f8c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:56.278254 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-6d4101a1-2907-49a2-a8db-5525fca7279e tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:56.286933 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-6d4101a1-2907-49a2-a8db-5525fca7279e tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1678 microversion: 2.1 time: 0.209829 Sep 21 16:26:56.289892 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 296/515] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:56 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1678 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:56.326316 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-327d11b7-251e-4f96-b109-dbed61198f8c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:56.341611 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-327d11b7-251e-4f96-b109-dbed61198f8c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:56.345187 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-327d11b7-251e-4f96-b109-dbed61198f8c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:56.347298 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-327d11b7-251e-4f96-b109-dbed61198f8c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1809 microversion: 2.20 time: 0.239684 Sep 21 16:26:56.348133 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 220/516] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:26:56 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1809 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 16:26:57.316844 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-5a835ee6-613e-4754-9fff-029065f5d34b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:57.318080 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-5a835ee6-613e-4754-9fff-029065f5d34b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:57.326653 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5a835ee6-613e-4754-9fff-029065f5d34b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:57.327141 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5a835ee6-613e-4754-9fff-029065f5d34b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:57.327578 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5a835ee6-613e-4754-9fff-029065f5d34b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:57.328287 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5a835ee6-613e-4754-9fff-029065f5d34b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:57.328744 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5a835ee6-613e-4754-9fff-029065f5d34b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:57.329163 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5a835ee6-613e-4754-9fff-029065f5d34b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:57.376258 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-bc577988-9bce-4e05-a617-75e4a05d55f9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:57.377138 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-bc577988-9bce-4e05-a617-75e4a05d55f9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:57.388508 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bc577988-9bce-4e05-a617-75e4a05d55f9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:57.389446 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bc577988-9bce-4e05-a617-75e4a05d55f9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:57.390114 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bc577988-9bce-4e05-a617-75e4a05d55f9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:57.391077 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bc577988-9bce-4e05-a617-75e4a05d55f9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:57.391709 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bc577988-9bce-4e05-a617-75e4a05d55f9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:57.392305 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bc577988-9bce-4e05-a617-75e4a05d55f9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:57.517077 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5a835ee6-613e-4754-9fff-029065f5d34b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:57.525647 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-5a835ee6-613e-4754-9fff-029065f5d34b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1678 microversion: 2.1 time: 0.213987 Sep 21 16:26:57.526669 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 297/517] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:57 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1678 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:57.602125 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-bc577988-9bce-4e05-a617-75e4a05d55f9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:57.613395 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-bc577988-9bce-4e05-a617-75e4a05d55f9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:57.615348 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-bc577988-9bce-4e05-a617-75e4a05d55f9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:57.616248 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-bc577988-9bce-4e05-a617-75e4a05d55f9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1809 microversion: 2.20 time: 0.244532 Sep 21 16:26:57.616824 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 221/518] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:26:57 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1809 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:26:58.558808 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-dec89c59-c64e-41fc-8b86-75aaeaddb7b2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:58.560045 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-dec89c59-c64e-41fc-8b86-75aaeaddb7b2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:58.567153 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dec89c59-c64e-41fc-8b86-75aaeaddb7b2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:58.567777 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dec89c59-c64e-41fc-8b86-75aaeaddb7b2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:58.568215 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dec89c59-c64e-41fc-8b86-75aaeaddb7b2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:58.569446 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dec89c59-c64e-41fc-8b86-75aaeaddb7b2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:58.570163 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dec89c59-c64e-41fc-8b86-75aaeaddb7b2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:58.570835 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dec89c59-c64e-41fc-8b86-75aaeaddb7b2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:58.643352 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-05c51761-1c42-4d0f-8619-26da6b0a012e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:58.644034 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-05c51761-1c42-4d0f-8619-26da6b0a012e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:58.652483 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-05c51761-1c42-4d0f-8619-26da6b0a012e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:58.652483 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-05c51761-1c42-4d0f-8619-26da6b0a012e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:58.652981 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-05c51761-1c42-4d0f-8619-26da6b0a012e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:58.654279 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-05c51761-1c42-4d0f-8619-26da6b0a012e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:58.654279 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-05c51761-1c42-4d0f-8619-26da6b0a012e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:58.654649 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-05c51761-1c42-4d0f-8619-26da6b0a012e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:58.743824 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-dec89c59-c64e-41fc-8b86-75aaeaddb7b2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:58.754356 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-dec89c59-c64e-41fc-8b86-75aaeaddb7b2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1678 microversion: 2.1 time: 0.200704 Sep 21 16:26:58.754978 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 298/519] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:58 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1678 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:26:58.832838 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-05c51761-1c42-4d0f-8619-26da6b0a012e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:58.843006 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-05c51761-1c42-4d0f-8619-26da6b0a012e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:58.845105 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-05c51761-1c42-4d0f-8619-26da6b0a012e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:26:58.847175 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-05c51761-1c42-4d0f-8619-26da6b0a012e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1809 microversion: 2.20 time: 0.207862 Sep 21 16:26:58.848130 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 222/520] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:26:58 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1809 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 16:26:59.794086 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-12ddfd3d-80f5-4445-9fef-6266838ce36f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:59.794979 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-12ddfd3d-80f5-4445-9fef-6266838ce36f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:59.802221 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-12ddfd3d-80f5-4445-9fef-6266838ce36f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:59.802712 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-12ddfd3d-80f5-4445-9fef-6266838ce36f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:59.803156 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-12ddfd3d-80f5-4445-9fef-6266838ce36f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:59.803864 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-12ddfd3d-80f5-4445-9fef-6266838ce36f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:59.804321 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-12ddfd3d-80f5-4445-9fef-6266838ce36f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:59.804746 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-12ddfd3d-80f5-4445-9fef-6266838ce36f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:59.891954 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-90f3d6aa-0a76-431a-b229-9a06d0ba6604 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:26:59.892593 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-90f3d6aa-0a76-431a-b229-9a06d0ba6604 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:26:59.899060 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-90f3d6aa-0a76-431a-b229-9a06d0ba6604 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:59.899553 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-90f3d6aa-0a76-431a-b229-9a06d0ba6604 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:59.899990 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-90f3d6aa-0a76-431a-b229-9a06d0ba6604 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:26:59.900972 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-90f3d6aa-0a76-431a-b229-9a06d0ba6604 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:26:59.902284 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-90f3d6aa-0a76-431a-b229-9a06d0ba6604 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:26:59.902733 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-90f3d6aa-0a76-431a-b229-9a06d0ba6604 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:00.021275 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-12ddfd3d-80f5-4445-9fef-6266838ce36f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:00.030286 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-12ddfd3d-80f5-4445-9fef-6266838ce36f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1678 microversion: 2.1 time: 0.241707 Sep 21 16:27:00.030888 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 299/521] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:26:59 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1678 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:00.096567 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-90f3d6aa-0a76-431a-b229-9a06d0ba6604 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:00.107931 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-90f3d6aa-0a76-431a-b229-9a06d0ba6604 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:00.110035 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-90f3d6aa-0a76-431a-b229-9a06d0ba6604 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:00.111527 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-90f3d6aa-0a76-431a-b229-9a06d0ba6604 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1809 microversion: 2.20 time: 0.232073 Sep 21 16:27:00.112112 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 223/522] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:26:59 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1809 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 16:27:01.065104 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-06f49f02-332d-40c0-afa1-ed07f7e3b0a1 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:01.066320 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-06f49f02-332d-40c0-afa1-ed07f7e3b0a1 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:01.077486 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-06f49f02-332d-40c0-afa1-ed07f7e3b0a1 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:01.078772 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-06f49f02-332d-40c0-afa1-ed07f7e3b0a1 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:01.079509 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-06f49f02-332d-40c0-afa1-ed07f7e3b0a1 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:01.081318 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-06f49f02-332d-40c0-afa1-ed07f7e3b0a1 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:01.082145 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-06f49f02-332d-40c0-afa1-ed07f7e3b0a1 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:01.082604 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-06f49f02-332d-40c0-afa1-ed07f7e3b0a1 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:01.141356 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-cb2cec6d-01b2-4e96-b4e3-041dc698fb1f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:01.142289 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-cb2cec6d-01b2-4e96-b4e3-041dc698fb1f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:01.152761 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cb2cec6d-01b2-4e96-b4e3-041dc698fb1f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:01.153898 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cb2cec6d-01b2-4e96-b4e3-041dc698fb1f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:01.155157 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cb2cec6d-01b2-4e96-b4e3-041dc698fb1f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:01.157013 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cb2cec6d-01b2-4e96-b4e3-041dc698fb1f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:01.158175 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cb2cec6d-01b2-4e96-b4e3-041dc698fb1f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:01.159087 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cb2cec6d-01b2-4e96-b4e3-041dc698fb1f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:01.258616 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-06f49f02-332d-40c0-afa1-ed07f7e3b0a1 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:01.271277 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-06f49f02-332d-40c0-afa1-ed07f7e3b0a1 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1678 microversion: 2.1 time: 0.210853 Sep 21 16:27:01.272247 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 300/523] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:01 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1678 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:01.625015 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-0c89e737-c5cb-4e25-ba1d-55278e0f9bb0 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:01.625635 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-0c89e737-c5cb-4e25-ba1d-55278e0f9bb0 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:01.632428 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0c89e737-c5cb-4e25-ba1d-55278e0f9bb0 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:01.632941 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0c89e737-c5cb-4e25-ba1d-55278e0f9bb0 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:01.633390 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0c89e737-c5cb-4e25-ba1d-55278e0f9bb0 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:01.634180 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0c89e737-c5cb-4e25-ba1d-55278e0f9bb0 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:01.634648 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0c89e737-c5cb-4e25-ba1d-55278e0f9bb0 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:01.635075 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0c89e737-c5cb-4e25-ba1d-55278e0f9bb0 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:01.678769 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-cb2cec6d-01b2-4e96-b4e3-041dc698fb1f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:01.690809 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-cb2cec6d-01b2-4e96-b4e3-041dc698fb1f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:01.693729 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-cb2cec6d-01b2-4e96-b4e3-041dc698fb1f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:01.695459 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-cb2cec6d-01b2-4e96-b4e3-041dc698fb1f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1809 microversion: 2.20 time: 0.560898 Sep 21 16:27:01.696382 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 224/524] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:27:01 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1809 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:27:01.802904 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-0c89e737-c5cb-4e25-ba1d-55278e0f9bb0 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:01.818636 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-0c89e737-c5cb-4e25-ba1d-55278e0f9bb0 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1594 microversion: 2.1 time: 0.197627 Sep 21 16:27:01.819729 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 301/525] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:01 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1594 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:27:02.317196 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-45c89f57-a57e-4558-99e8-679e718dafbd tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:02.317982 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-45c89f57-a57e-4558-99e8-679e718dafbd tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:02.326295 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-45c89f57-a57e-4558-99e8-679e718dafbd tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:02.326901 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-45c89f57-a57e-4558-99e8-679e718dafbd tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:02.327343 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-45c89f57-a57e-4558-99e8-679e718dafbd tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:02.328064 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-45c89f57-a57e-4558-99e8-679e718dafbd tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:02.328520 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-45c89f57-a57e-4558-99e8-679e718dafbd tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:02.328945 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-45c89f57-a57e-4558-99e8-679e718dafbd tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:02.533593 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-45c89f57-a57e-4558-99e8-679e718dafbd tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:02.543554 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-45c89f57-a57e-4558-99e8-679e718dafbd tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1678 microversion: 2.1 time: 0.231143 Sep 21 16:27:02.544614 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 225/526] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:02 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1678 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:02.724321 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-5a9ce8d4-b378-4bde-9356-ff1cf2a424a8 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:02.724934 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-5a9ce8d4-b378-4bde-9356-ff1cf2a424a8 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:02.732037 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5a9ce8d4-b378-4bde-9356-ff1cf2a424a8 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:02.732522 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5a9ce8d4-b378-4bde-9356-ff1cf2a424a8 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:02.732954 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5a9ce8d4-b378-4bde-9356-ff1cf2a424a8 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:02.733653 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5a9ce8d4-b378-4bde-9356-ff1cf2a424a8 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:02.734161 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5a9ce8d4-b378-4bde-9356-ff1cf2a424a8 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:02.734586 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5a9ce8d4-b378-4bde-9356-ff1cf2a424a8 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:03.016677 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5a9ce8d4-b378-4bde-9356-ff1cf2a424a8 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:03.019526 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:27:03.031706 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5a9ce8d4-b378-4bde-9356-ff1cf2a424a8 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:03.033241 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5a9ce8d4-b378-4bde-9356-ff1cf2a424a8 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:03.034464 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-5a9ce8d4-b378-4bde-9356-ff1cf2a424a8 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1809 microversion: 2.20 time: 0.314616 Sep 21 16:27:03.035060 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 302/527] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:27:02 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1809 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:27:03.573794 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-b3e4477e-1da5-456b-98b1-588c153b1841 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:03.575130 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-b3e4477e-1da5-456b-98b1-588c153b1841 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:03.588671 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b3e4477e-1da5-456b-98b1-588c153b1841 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:03.589435 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b3e4477e-1da5-456b-98b1-588c153b1841 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:03.590221 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b3e4477e-1da5-456b-98b1-588c153b1841 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:03.592073 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b3e4477e-1da5-456b-98b1-588c153b1841 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:03.593307 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b3e4477e-1da5-456b-98b1-588c153b1841 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:03.594110 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b3e4477e-1da5-456b-98b1-588c153b1841 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:03.779539 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-b3e4477e-1da5-456b-98b1-588c153b1841 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:03.796169 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-b3e4477e-1da5-456b-98b1-588c153b1841 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1678 microversion: 2.1 time: 0.230555 Sep 21 16:27:03.804199 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 226/528] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:03 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1678 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:04.021490 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-49739ad9-93ad-4dd6-9a5f-11ecaec3876b req-d330433b-e56b-495d-b75e-acb5385d1ffe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f563aac-6055-4b77-b3bb-894ed14c1f64", "name": "network-vif-plugged", "status": "completed", "tag": "252450c8-e7d3-467d-be6e-17b527b01bb8"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:27:04.037019 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-49739ad9-93ad-4dd6-9a5f-11ecaec3876b req-d330433b-e56b-495d-b75e-acb5385d1ffe service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:04.038002 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-49739ad9-93ad-4dd6-9a5f-11ecaec3876b req-d330433b-e56b-495d-b75e-acb5385d1ffe service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:04.038969 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-49739ad9-93ad-4dd6-9a5f-11ecaec3876b req-d330433b-e56b-495d-b75e-acb5385d1ffe service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:04.056306 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-49739ad9-93ad-4dd6-9a5f-11ecaec3876b req-d330433b-e56b-495d-b75e-acb5385d1ffe service nova] Creating event network-vif-plugged:252450c8-e7d3-467d-be6e-17b527b01bb8 for instance 5f563aac-6055-4b77-b3bb-894ed14c1f64 on hv-cinder-85862 Sep 21 16:27:04.062094 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-49739ad9-93ad-4dd6-9a5f-11ecaec3876b req-d330433b-e56b-495d-b75e-acb5385d1ffe service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047185 Sep 21 16:27:04.063064 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 303/529] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:27:04.079132 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-931cb6c2-94a3-4f92-8803-f2469792311f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:04.080560 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-931cb6c2-94a3-4f92-8803-f2469792311f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:04.087355 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-931cb6c2-94a3-4f92-8803-f2469792311f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:04.088096 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-931cb6c2-94a3-4f92-8803-f2469792311f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:04.089305 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-931cb6c2-94a3-4f92-8803-f2469792311f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:04.090213 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-931cb6c2-94a3-4f92-8803-f2469792311f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:04.091195 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-931cb6c2-94a3-4f92-8803-f2469792311f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:04.091903 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-931cb6c2-94a3-4f92-8803-f2469792311f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:04.239293 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-931cb6c2-94a3-4f92-8803-f2469792311f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:04.249632 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-931cb6c2-94a3-4f92-8803-f2469792311f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:04.252880 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-931cb6c2-94a3-4f92-8803-f2469792311f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:04.254204 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-931cb6c2-94a3-4f92-8803-f2469792311f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1809 microversion: 2.20 time: 0.178976 Sep 21 16:27:04.254688 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 227/530] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:27:04 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:27:04.321954 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-f6369432-b425-4cbf-8c58-cd65fc4b9b70 req-b30add5e-4bf4-47fc-bf51-4ea5010b8e1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec70a608-9135-4656-a030-6429493b68fd", "tag": "e9fd8d4f-e98f-46e3-af56-5c8429307f9b"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:27:04.334641 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-f6369432-b425-4cbf-8c58-cd65fc4b9b70 req-b30add5e-4bf4-47fc-bf51-4ea5010b8e1b service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:04.334838 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-f6369432-b425-4cbf-8c58-cd65fc4b9b70 req-b30add5e-4bf4-47fc-bf51-4ea5010b8e1b service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:04.335443 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-f6369432-b425-4cbf-8c58-cd65fc4b9b70 req-b30add5e-4bf4-47fc-bf51-4ea5010b8e1b service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:04.351661 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-f6369432-b425-4cbf-8c58-cd65fc4b9b70 req-b30add5e-4bf4-47fc-bf51-4ea5010b8e1b service nova] Creating event network-changed:e9fd8d4f-e98f-46e3-af56-5c8429307f9b for instance ec70a608-9135-4656-a030-6429493b68fd on hv-cinder-85862 Sep 21 16:27:04.359621 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-f6369432-b425-4cbf-8c58-cd65fc4b9b70 req-b30add5e-4bf4-47fc-bf51-4ea5010b8e1b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040841 Sep 21 16:27:04.360470 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 304/531] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:27:04.545597 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-471512ed-6166-4644-963f-27776a10cf89 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2146488816", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1166440784", "security_groups": [{"name": "tempest-secgroup-smoke-523103579"}], "block_device_mapping_v2": [{"uuid": "5d19ce10-af24-480a-9148-bc29a992f83e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0481ac20-ccdd-4b47-94c7-01261137c9c9"}]}} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:27:04.819866 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-44534839-142b-4cc8-9a14-00cd31f97f11 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:04.821506 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-44534839-142b-4cc8-9a14-00cd31f97f11 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:04.830434 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-44534839-142b-4cc8-9a14-00cd31f97f11 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:04.831343 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-44534839-142b-4cc8-9a14-00cd31f97f11 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:04.832020 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-44534839-142b-4cc8-9a14-00cd31f97f11 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:04.833024 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-44534839-142b-4cc8-9a14-00cd31f97f11 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:04.833742 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-44534839-142b-4cc8-9a14-00cd31f97f11 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:04.834451 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-44534839-142b-4cc8-9a14-00cd31f97f11 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:04.899393 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.network.neutron [None req-471512ed-6166-4644-963f-27776a10cf89 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] validate_networks() for [('0481ac20-ccdd-4b47-94c7-01261137c9c9', None, None, None, None, None)] {{(pid=120531) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 16:27:05.068393 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-44534839-142b-4cc8-9a14-00cd31f97f11 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:05.085650 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-44534839-142b-4cc8-9a14-00cd31f97f11 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1678 microversion: 2.1 time: 0.270012 Sep 21 16:27:05.086605 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 305/532] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:04 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1678 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:27:05.293311 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-68a737cb-eebd-46bf-8096-8faf36ddc73a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:05.298954 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-68a737cb-eebd-46bf-8096-8faf36ddc73a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:05.325665 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-68a737cb-eebd-46bf-8096-8faf36ddc73a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:05.329163 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-68a737cb-eebd-46bf-8096-8faf36ddc73a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:05.330560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-68a737cb-eebd-46bf-8096-8faf36ddc73a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:05.332851 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-68a737cb-eebd-46bf-8096-8faf36ddc73a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:05.344205 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-68a737cb-eebd-46bf-8096-8faf36ddc73a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:05.345576 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-68a737cb-eebd-46bf-8096-8faf36ddc73a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:05.552217 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-68a737cb-eebd-46bf-8096-8faf36ddc73a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:05.563450 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-68a737cb-eebd-46bf-8096-8faf36ddc73a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:05.565514 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-68a737cb-eebd-46bf-8096-8faf36ddc73a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:05.567312 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-68a737cb-eebd-46bf-8096-8faf36ddc73a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1809 microversion: 2.20 time: 0.287379 Sep 21 16:27:05.568166 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 306/533] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:27:05 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1809 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:27:05.821265 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-471512ed-6166-4644-963f-27776a10cf89 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Flavor limits 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 16:27:05.822337 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-471512ed-6166-4644-963f-27776a10cf89 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Image limits 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 16:27:05.823258 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-471512ed-6166-4644-963f-27776a10cf89 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Flavor pref 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 16:27:05.824029 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-471512ed-6166-4644-963f-27776a10cf89 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Image pref 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 16:27:05.825853 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-471512ed-6166-4644-963f-27776a10cf89 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 16:27:05.842539 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-471512ed-6166-4644-963f-27776a10cf89 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:05.844458 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-471512ed-6166-4644-963f-27776a10cf89 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:05.845925 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-471512ed-6166-4644-963f-27776a10cf89 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:05.847551 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-471512ed-6166-4644-963f-27776a10cf89 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:05.848265 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-471512ed-6166-4644-963f-27776a10cf89 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:05.848758 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-471512ed-6166-4644-963f-27776a10cf89 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:05.868333 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.quota [None req-471512ed-6166-4644-963f-27776a10cf89 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Getting quotas for project d529e1f3de6944f881c7fc572b1dc78e. Resources: {'cores', 'ram', 'instances'} {{(pid=120531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 16:27:05.873810 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.quota [None req-471512ed-6166-4644-963f-27776a10cf89 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Getting quotas for user f619261c21204ea3b5ba624177eb8747 and project d529e1f3de6944f881c7fc572b1dc78e. Resources: {'cores', 'ram', 'instances'} {{(pid=120531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 16:27:05.949565 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-471512ed-6166-4644-963f-27776a10cf89 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Going to run 1 instances... {{(pid=120531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 16:27:05.951759 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-471512ed-6166-4644-963f-27776a10cf89 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 19567338-1f72-414d-b6d7-7ab9d4fe94bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5d19ce10-af24-480a-9148-bc29a992f83e',volume_size=None,volume_type=None)] {{(pid=120531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 16:27:06.114892 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-471512ed-6166-4644-963f-27776a10cf89 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.578173 Sep 21 16:27:06.115757 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 228/534] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Sep 21 16:27:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 1581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 21 16:27:06.129917 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-9de70094-b226-4dd1-97f8-7dc383b69fd8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:06.130195 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c2ced657-3c94-48b5-80bc-4a8f61f3e666 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:06.130639 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-c2ced657-3c94-48b5-80bc-4a8f61f3e666 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 19567338-1f72-414d-b6d7-7ab9d4fe94bc] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:06.131409 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-9de70094-b226-4dd1-97f8-7dc383b69fd8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:06.149504 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9de70094-b226-4dd1-97f8-7dc383b69fd8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:06.151535 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9de70094-b226-4dd1-97f8-7dc383b69fd8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:06.152854 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9de70094-b226-4dd1-97f8-7dc383b69fd8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:06.154360 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9de70094-b226-4dd1-97f8-7dc383b69fd8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:06.155908 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9de70094-b226-4dd1-97f8-7dc383b69fd8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:06.156806 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9de70094-b226-4dd1-97f8-7dc383b69fd8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:06.204323 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-c2ced657-3c94-48b5-80bc-4a8f61f3e666 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:06.222709 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-c2ced657-3c94-48b5-80bc-4a8f61f3e666 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc" status: 200 len: 1095 microversion: 2.1 time: 0.096537 Sep 21 16:27:06.223732 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 307/535] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:06 2022] GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc => generated 1095 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:06.336004 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-9de70094-b226-4dd1-97f8-7dc383b69fd8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:06.349740 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-9de70094-b226-4dd1-97f8-7dc383b69fd8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1655 microversion: 2.1 time: 0.222258 Sep 21 16:27:06.357383 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 229/536] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:06 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1655 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:06.387487 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-27e0e041-5d11-41f6-bf59-afdd8c56f048 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:27:06.393701 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-27e0e041-5d11-41f6-bf59-afdd8c56f048 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:06.394466 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-27e0e041-5d11-41f6-bf59-afdd8c56f048 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:06.394905 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-27e0e041-5d11-41f6-bf59-afdd8c56f048 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:06.423034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-27e0e041-5d11-41f6-bf59-afdd8c56f048 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Going to try to start instance {{(pid=120532) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 21 16:27:06.451993 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-dfe15162-a7ef-4f3b-b032-c1eb279877c1 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-262557277"}} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:27:06.452520 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-dfe15162-a7ef-4f3b-b032-c1eb279877c1 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:06.459990 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dfe15162-a7ef-4f3b-b032-c1eb279877c1 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:06.460865 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dfe15162-a7ef-4f3b-b032-c1eb279877c1 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:06.461534 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dfe15162-a7ef-4f3b-b032-c1eb279877c1 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:06.462410 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dfe15162-a7ef-4f3b-b032-c1eb279877c1 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:06.463088 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dfe15162-a7ef-4f3b-b032-c1eb279877c1 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:06.463707 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dfe15162-a7ef-4f3b-b032-c1eb279877c1 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:06.479798 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-27e0e041-5d11-41f6-bf59-afdd8c56f048 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "POST /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021/action" status: 202 len: 0 microversion: 2.1 time: 0.096713 Sep 21 16:27:06.486667 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 308/537] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Sep 21 16:27:06 2022] POST /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 16:27:06.496597 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-5a0705b5-2460-451e-9ae2-f32da401db92 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:06.497336 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-5a0705b5-2460-451e-9ae2-f32da401db92 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:06.503738 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5a0705b5-2460-451e-9ae2-f32da401db92 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:06.504301 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5a0705b5-2460-451e-9ae2-f32da401db92 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:06.504661 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5a0705b5-2460-451e-9ae2-f32da401db92 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:06.505375 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5a0705b5-2460-451e-9ae2-f32da401db92 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:06.505837 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5a0705b5-2460-451e-9ae2-f32da401db92 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:06.506478 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5a0705b5-2460-451e-9ae2-f32da401db92 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:06.634520 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.network.security_group_api [None req-dfe15162-a7ef-4f3b-b032-c1eb279877c1 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Adding security group 88c546e3-3110-4dd8-98ff-d254a32672bb to port e9fd8d4f-e98f-46e3-af56-5c8429307f9b Sep 21 16:27:06.671916 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5a0705b5-2460-451e-9ae2-f32da401db92 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:06.684095 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-5a0705b5-2460-451e-9ae2-f32da401db92 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1664 microversion: 2.1 time: 0.190672 Sep 21 16:27:06.685025 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 309/538] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:06 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1664 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:06.690599 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-5b1461f4-543e-4841-8c5e-8ce92b3ef478 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:06.691246 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-5b1461f4-543e-4841-8c5e-8ce92b3ef478 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:06.697315 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5b1461f4-543e-4841-8c5e-8ce92b3ef478 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:06.698502 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5b1461f4-543e-4841-8c5e-8ce92b3ef478 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:06.698947 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5b1461f4-543e-4841-8c5e-8ce92b3ef478 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:06.699864 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5b1461f4-543e-4841-8c5e-8ce92b3ef478 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:06.700334 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5b1461f4-543e-4841-8c5e-8ce92b3ef478 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:06.700757 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5b1461f4-543e-4841-8c5e-8ce92b3ef478 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:06.839970 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5b1461f4-543e-4841-8c5e-8ce92b3ef478 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:06.849218 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5b1461f4-543e-4841-8c5e-8ce92b3ef478 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:06.850697 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5b1461f4-543e-4841-8c5e-8ce92b3ef478 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:06.851897 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-5b1461f4-543e-4841-8c5e-8ce92b3ef478 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1809 microversion: 2.20 time: 0.165212 Sep 21 16:27:06.866274 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 310/539] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:27:06 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:27:06.985808 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-dfe15162-a7ef-4f3b-b032-c1eb279877c1 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "POST /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd/action" status: 202 len: 0 microversion: 2.1 time: 0.538576 Sep 21 16:27:06.986463 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 230/540] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Sep 21 16:27:06 2022] POST /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd/action => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 21 16:27:07.001326 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-f04e5516-8526-43c2-9c39-88b9b9f53503 req-45c7d1d5-06c5-45c4-bcbf-134c0f3c1831 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec70a608-9135-4656-a030-6429493b68fd", "tag": "e9fd8d4f-e98f-46e3-af56-5c8429307f9b"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:27:07.024922 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-9eb7b829-cec3-4207-ba6e-6ff56eb4eda2 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:07.027226 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-9eb7b829-cec3-4207-ba6e-6ff56eb4eda2 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:07.044336 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-f04e5516-8526-43c2-9c39-88b9b9f53503 req-45c7d1d5-06c5-45c4-bcbf-134c0f3c1831 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:07.044815 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-f04e5516-8526-43c2-9c39-88b9b9f53503 req-45c7d1d5-06c5-45c4-bcbf-134c0f3c1831 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:07.052387 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-f04e5516-8526-43c2-9c39-88b9b9f53503 req-45c7d1d5-06c5-45c4-bcbf-134c0f3c1831 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:07.058493 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9eb7b829-cec3-4207-ba6e-6ff56eb4eda2 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:07.059026 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9eb7b829-cec3-4207-ba6e-6ff56eb4eda2 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:07.059664 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9eb7b829-cec3-4207-ba6e-6ff56eb4eda2 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:07.060387 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9eb7b829-cec3-4207-ba6e-6ff56eb4eda2 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:07.060983 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9eb7b829-cec3-4207-ba6e-6ff56eb4eda2 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:07.061567 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9eb7b829-cec3-4207-ba6e-6ff56eb4eda2 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:07.100488 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-f04e5516-8526-43c2-9c39-88b9b9f53503 req-45c7d1d5-06c5-45c4-bcbf-134c0f3c1831 service nova] Creating event network-changed:e9fd8d4f-e98f-46e3-af56-5c8429307f9b for instance ec70a608-9135-4656-a030-6429493b68fd on hv-cinder-85862 Sep 21 16:27:07.112771 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-f04e5516-8526-43c2-9c39-88b9b9f53503 req-45c7d1d5-06c5-45c4-bcbf-134c0f3c1831 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116216 Sep 21 16:27:07.113793 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 311/541] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:27:07.247024 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-da84f76c-4b04-4cb6-9aaf-9308a4c816d8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:07.247797 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-da84f76c-4b04-4cb6-9aaf-9308a4c816d8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 19567338-1f72-414d-b6d7-7ab9d4fe94bc] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:07.255138 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-da84f76c-4b04-4cb6-9aaf-9308a4c816d8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:07.255858 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-da84f76c-4b04-4cb6-9aaf-9308a4c816d8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:07.256869 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-da84f76c-4b04-4cb6-9aaf-9308a4c816d8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:07.257774 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-da84f76c-4b04-4cb6-9aaf-9308a4c816d8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:07.258411 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-da84f76c-4b04-4cb6-9aaf-9308a4c816d8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:07.258991 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-da84f76c-4b04-4cb6-9aaf-9308a4c816d8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:07.324119 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-da84f76c-4b04-4cb6-9aaf-9308a4c816d8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:07.332098 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-da84f76c-4b04-4cb6-9aaf-9308a4c816d8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc" status: 200 len: 1137 microversion: 2.1 time: 0.090854 Sep 21 16:27:07.334271 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 312/542] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:07 2022] GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc => generated 1137 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:27:07.372074 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-9eb7b829-cec3-4207-ba6e-6ff56eb4eda2 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:07.382372 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-9eb7b829-cec3-4207-ba6e-6ff56eb4eda2 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1759 microversion: 2.1 time: 0.386153 Sep 21 16:27:07.383024 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 231/543] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:06 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1759 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:07.710478 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-dd555af0-d554-40ef-afd3-aefc39f6bdc5 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:07.710764 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-dd555af0-d554-40ef-afd3-aefc39f6bdc5 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:07.717721 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dd555af0-d554-40ef-afd3-aefc39f6bdc5 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:07.718249 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dd555af0-d554-40ef-afd3-aefc39f6bdc5 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:07.718879 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dd555af0-d554-40ef-afd3-aefc39f6bdc5 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:07.719897 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dd555af0-d554-40ef-afd3-aefc39f6bdc5 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:07.720531 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dd555af0-d554-40ef-afd3-aefc39f6bdc5 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:07.720954 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dd555af0-d554-40ef-afd3-aefc39f6bdc5 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:07.879222 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-e481ad65-3d65-48bc-a258-5e8eaec8f7ad tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:07.879871 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-e481ad65-3d65-48bc-a258-5e8eaec8f7ad tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:07.902249 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e481ad65-3d65-48bc-a258-5e8eaec8f7ad tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:07.902748 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e481ad65-3d65-48bc-a258-5e8eaec8f7ad tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:07.903182 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e481ad65-3d65-48bc-a258-5e8eaec8f7ad tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:07.903890 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e481ad65-3d65-48bc-a258-5e8eaec8f7ad tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:07.904373 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e481ad65-3d65-48bc-a258-5e8eaec8f7ad tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:07.904756 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e481ad65-3d65-48bc-a258-5e8eaec8f7ad tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:07.939453 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-dd555af0-d554-40ef-afd3-aefc39f6bdc5 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:07.951417 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-dd555af0-d554-40ef-afd3-aefc39f6bdc5 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1664 microversion: 2.1 time: 0.246456 Sep 21 16:27:07.952247 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 313/544] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:07 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1664 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:08.064446 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-e481ad65-3d65-48bc-a258-5e8eaec8f7ad tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:08.074021 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-e481ad65-3d65-48bc-a258-5e8eaec8f7ad tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:08.075525 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-e481ad65-3d65-48bc-a258-5e8eaec8f7ad tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:08.076716 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-e481ad65-3d65-48bc-a258-5e8eaec8f7ad tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1809 microversion: 2.20 time: 0.202602 Sep 21 16:27:08.077277 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 232/545] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:27:07 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1809 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 16:27:08.358227 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-95235279-0400-4855-961a-24aa81534e62 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:08.359495 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-95235279-0400-4855-961a-24aa81534e62 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 19567338-1f72-414d-b6d7-7ab9d4fe94bc] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:08.367375 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-95235279-0400-4855-961a-24aa81534e62 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:08.367866 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-95235279-0400-4855-961a-24aa81534e62 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:08.368506 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-95235279-0400-4855-961a-24aa81534e62 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:08.369301 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-95235279-0400-4855-961a-24aa81534e62 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:08.370406 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-95235279-0400-4855-961a-24aa81534e62 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:08.371701 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-95235279-0400-4855-961a-24aa81534e62 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:08.484609 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-95235279-0400-4855-961a-24aa81534e62 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:08.500326 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-95235279-0400-4855-961a-24aa81534e62 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc" status: 200 len: 1201 microversion: 2.1 time: 0.146611 Sep 21 16:27:08.501841 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 314/546] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:08 2022] GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc => generated 1201 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:08.975630 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-43cfed9e-9095-4108-8ad2-d4a97d8b98ae tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:08.976145 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-43cfed9e-9095-4108-8ad2-d4a97d8b98ae tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:08.983497 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-43cfed9e-9095-4108-8ad2-d4a97d8b98ae tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:08.984102 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-43cfed9e-9095-4108-8ad2-d4a97d8b98ae tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:08.984792 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-43cfed9e-9095-4108-8ad2-d4a97d8b98ae tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:08.985558 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-43cfed9e-9095-4108-8ad2-d4a97d8b98ae tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:08.986020 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-43cfed9e-9095-4108-8ad2-d4a97d8b98ae tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:08.986467 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-43cfed9e-9095-4108-8ad2-d4a97d8b98ae tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:09.101948 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-a5b37936-779a-4302-9379-2571c1a174ab tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:09.102720 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-a5b37936-779a-4302-9379-2571c1a174ab tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:09.104883 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=1 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:27:09.111252 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a5b37936-779a-4302-9379-2571c1a174ab tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:09.112081 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a5b37936-779a-4302-9379-2571c1a174ab tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:09.112618 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a5b37936-779a-4302-9379-2571c1a174ab tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:09.113414 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a5b37936-779a-4302-9379-2571c1a174ab tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:09.113944 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a5b37936-779a-4302-9379-2571c1a174ab tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:09.114642 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a5b37936-779a-4302-9379-2571c1a174ab tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:09.279964 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a5b37936-779a-4302-9379-2571c1a174ab tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:09.290077 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a5b37936-779a-4302-9379-2571c1a174ab tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:09.294107 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a5b37936-779a-4302-9379-2571c1a174ab tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:09.295392 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-a5b37936-779a-4302-9379-2571c1a174ab tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1796 microversion: 2.20 time: 0.197344 Sep 21 16:27:09.298082 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 315/547] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:27:09 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1796 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 16:27:09.428437 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-43cfed9e-9095-4108-8ad2-d4a97d8b98ae tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:09.436836 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-43cfed9e-9095-4108-8ad2-d4a97d8b98ae tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1664 microversion: 2.1 time: 0.465589 Sep 21 16:27:09.437530 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 233/548] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:08 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1664 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:09.524809 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-89559d97-fce0-4f0b-92ec-7131928ff762 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:09.525735 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-89559d97-fce0-4f0b-92ec-7131928ff762 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 19567338-1f72-414d-b6d7-7ab9d4fe94bc] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:09.532096 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-89559d97-fce0-4f0b-92ec-7131928ff762 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:09.532511 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-89559d97-fce0-4f0b-92ec-7131928ff762 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:09.532941 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-89559d97-fce0-4f0b-92ec-7131928ff762 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:09.533649 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-89559d97-fce0-4f0b-92ec-7131928ff762 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:09.534131 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-89559d97-fce0-4f0b-92ec-7131928ff762 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:09.534560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-89559d97-fce0-4f0b-92ec-7131928ff762 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:09.597911 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-89559d97-fce0-4f0b-92ec-7131928ff762 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:09.607245 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-89559d97-fce0-4f0b-92ec-7131928ff762 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc" status: 200 len: 1199 microversion: 2.1 time: 0.086794 Sep 21 16:27:09.607844 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 316/549] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:09 2022] GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc => generated 1199 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:10.460532 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-5b9477f9-ce21-4a11-85d3-d2bfd2e86620 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:10.461299 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-5b9477f9-ce21-4a11-85d3-d2bfd2e86620 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:10.470309 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5b9477f9-ce21-4a11-85d3-d2bfd2e86620 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:10.470792 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5b9477f9-ce21-4a11-85d3-d2bfd2e86620 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:10.471440 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5b9477f9-ce21-4a11-85d3-d2bfd2e86620 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:10.472164 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5b9477f9-ce21-4a11-85d3-d2bfd2e86620 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:10.472624 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5b9477f9-ce21-4a11-85d3-d2bfd2e86620 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:10.473044 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5b9477f9-ce21-4a11-85d3-d2bfd2e86620 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:10.633445 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-38ae3f6c-af29-4470-8477-7cfc8383963f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:10.635740 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-38ae3f6c-af29-4470-8477-7cfc8383963f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 19567338-1f72-414d-b6d7-7ab9d4fe94bc] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:10.642705 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-38ae3f6c-af29-4470-8477-7cfc8383963f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:10.643191 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-38ae3f6c-af29-4470-8477-7cfc8383963f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:10.643925 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-38ae3f6c-af29-4470-8477-7cfc8383963f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:10.644519 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-38ae3f6c-af29-4470-8477-7cfc8383963f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:10.644978 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-38ae3f6c-af29-4470-8477-7cfc8383963f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:10.645560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-38ae3f6c-af29-4470-8477-7cfc8383963f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:10.754194 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-5b9477f9-ce21-4a11-85d3-d2bfd2e86620 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:10.764545 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-5b9477f9-ce21-4a11-85d3-d2bfd2e86620 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1668 microversion: 2.1 time: 0.307981 Sep 21 16:27:10.765144 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 234/550] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:10 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1668 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:10.796740 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-38ae3f6c-af29-4470-8477-7cfc8383963f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:10.805327 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-38ae3f6c-af29-4470-8477-7cfc8383963f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc" status: 200 len: 1266 microversion: 2.1 time: 0.175906 Sep 21 16:27:10.805798 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 317/551] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:10 2022] GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:11.260161 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-076c17dc-2149-427e-b729-3c75879c83b3 req-7f1f7bc1-2c7e-4139-8ec2-b3457d7abb89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19567338-1f72-414d-b6d7-7ab9d4fe94bc", "tag": "8c077bf0-61d4-4c24-843e-0a70de3959d3"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:27:11.278534 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-076c17dc-2149-427e-b729-3c75879c83b3 req-7f1f7bc1-2c7e-4139-8ec2-b3457d7abb89 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:11.279194 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-076c17dc-2149-427e-b729-3c75879c83b3 req-7f1f7bc1-2c7e-4139-8ec2-b3457d7abb89 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:11.279682 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-076c17dc-2149-427e-b729-3c75879c83b3 req-7f1f7bc1-2c7e-4139-8ec2-b3457d7abb89 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:11.292741 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-076c17dc-2149-427e-b729-3c75879c83b3 req-7f1f7bc1-2c7e-4139-8ec2-b3457d7abb89 service nova] Creating event network-changed:8c077bf0-61d4-4c24-843e-0a70de3959d3 for instance 19567338-1f72-414d-b6d7-7ab9d4fe94bc on hv-cinder-85862 Sep 21 16:27:11.298722 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-076c17dc-2149-427e-b729-3c75879c83b3 req-7f1f7bc1-2c7e-4139-8ec2-b3457d7abb89 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042526 Sep 21 16:27:11.299491 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 235/552] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:27:11.828367 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-71dfc817-172f-4046-b915-637eaee57aed tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:11.828981 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-71dfc817-172f-4046-b915-637eaee57aed tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 19567338-1f72-414d-b6d7-7ab9d4fe94bc] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:11.836218 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-71dfc817-172f-4046-b915-637eaee57aed tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:11.836715 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-71dfc817-172f-4046-b915-637eaee57aed tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:11.837147 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-71dfc817-172f-4046-b915-637eaee57aed tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:11.838424 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-71dfc817-172f-4046-b915-637eaee57aed tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:11.838883 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-71dfc817-172f-4046-b915-637eaee57aed tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:11.839305 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-71dfc817-172f-4046-b915-637eaee57aed tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:12.004559 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-71dfc817-172f-4046-b915-637eaee57aed tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:12.013504 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-71dfc817-172f-4046-b915-637eaee57aed tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc" status: 200 len: 1266 microversion: 2.1 time: 0.188993 Sep 21 16:27:12.014347 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 318/553] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:11 2022] GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:13.039124 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-5ae2a132-e49d-40bc-9d9c-4116665de8cc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:13.039810 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-5ae2a132-e49d-40bc-9d9c-4116665de8cc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 19567338-1f72-414d-b6d7-7ab9d4fe94bc] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:13.046598 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5ae2a132-e49d-40bc-9d9c-4116665de8cc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:13.047071 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5ae2a132-e49d-40bc-9d9c-4116665de8cc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:13.047498 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5ae2a132-e49d-40bc-9d9c-4116665de8cc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:13.048209 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5ae2a132-e49d-40bc-9d9c-4116665de8cc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:13.048695 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5ae2a132-e49d-40bc-9d9c-4116665de8cc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:13.049099 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5ae2a132-e49d-40bc-9d9c-4116665de8cc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:13.187412 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-5ae2a132-e49d-40bc-9d9c-4116665de8cc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:13.195604 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-5ae2a132-e49d-40bc-9d9c-4116665de8cc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc" status: 200 len: 1266 microversion: 2.1 time: 0.161190 Sep 21 16:27:13.196179 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 236/554] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:13 2022] GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:14.218202 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-5a49127a-cb88-47f3-804f-bb4d7e5d9aef tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:14.218824 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-5a49127a-cb88-47f3-804f-bb4d7e5d9aef tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 19567338-1f72-414d-b6d7-7ab9d4fe94bc] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:14.225227 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5a49127a-cb88-47f3-804f-bb4d7e5d9aef tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:14.225711 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5a49127a-cb88-47f3-804f-bb4d7e5d9aef tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:14.226170 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5a49127a-cb88-47f3-804f-bb4d7e5d9aef tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:14.227402 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5a49127a-cb88-47f3-804f-bb4d7e5d9aef tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:14.227402 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5a49127a-cb88-47f3-804f-bb4d7e5d9aef tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:14.227722 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5a49127a-cb88-47f3-804f-bb4d7e5d9aef tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:14.357880 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5a49127a-cb88-47f3-804f-bb4d7e5d9aef tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:14.365961 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-5a49127a-cb88-47f3-804f-bb4d7e5d9aef tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc" status: 200 len: 1266 microversion: 2.1 time: 0.151599 Sep 21 16:27:14.366590 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 319/555] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:14 2022] GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:15.390238 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-1e8b1da2-59d4-4004-b607-bb2077cf8159 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:15.390909 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-1e8b1da2-59d4-4004-b607-bb2077cf8159 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 19567338-1f72-414d-b6d7-7ab9d4fe94bc] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:15.393773 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:27:15.399834 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1e8b1da2-59d4-4004-b607-bb2077cf8159 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:15.400634 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1e8b1da2-59d4-4004-b607-bb2077cf8159 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:15.401118 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1e8b1da2-59d4-4004-b607-bb2077cf8159 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:15.401828 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1e8b1da2-59d4-4004-b607-bb2077cf8159 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:15.402303 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1e8b1da2-59d4-4004-b607-bb2077cf8159 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:15.402714 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1e8b1da2-59d4-4004-b607-bb2077cf8159 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:15.423492 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=100 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:27:15.551384 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-1e8b1da2-59d4-4004-b607-bb2077cf8159 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:15.559635 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-1e8b1da2-59d4-4004-b607-bb2077cf8159 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc" status: 200 len: 1266 microversion: 2.1 time: 0.173367 Sep 21 16:27:15.560196 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 237/556] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:15 2022] GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:16.582708 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-61582a6c-5237-4cfa-a280-6983038dea79 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:16.583265 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-61582a6c-5237-4cfa-a280-6983038dea79 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 19567338-1f72-414d-b6d7-7ab9d4fe94bc] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:16.585833 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell0:SELECT=2 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:27:16.592104 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-61582a6c-5237-4cfa-a280-6983038dea79 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:16.592596 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-61582a6c-5237-4cfa-a280-6983038dea79 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:16.593039 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-61582a6c-5237-4cfa-a280-6983038dea79 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:16.593747 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-61582a6c-5237-4cfa-a280-6983038dea79 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:16.594233 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-61582a6c-5237-4cfa-a280-6983038dea79 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:16.594658 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-61582a6c-5237-4cfa-a280-6983038dea79 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:16.742238 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-61582a6c-5237-4cfa-a280-6983038dea79 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:16.750803 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-61582a6c-5237-4cfa-a280-6983038dea79 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc" status: 200 len: 1266 microversion: 2.1 time: 0.171979 Sep 21 16:27:16.751392 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 320/557] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:16 2022] GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:17.774298 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-c05e0f6f-306f-4b3b-a8b4-86147195eb0f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:17.775441 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-c05e0f6f-306f-4b3b-a8b4-86147195eb0f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 19567338-1f72-414d-b6d7-7ab9d4fe94bc] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:17.777285 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell0:SELECT=2 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:27:17.777957 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell0:SELECT=6 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:27:17.784635 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c05e0f6f-306f-4b3b-a8b4-86147195eb0f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:17.785119 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c05e0f6f-306f-4b3b-a8b4-86147195eb0f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:17.785551 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c05e0f6f-306f-4b3b-a8b4-86147195eb0f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:17.786285 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c05e0f6f-306f-4b3b-a8b4-86147195eb0f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:17.786737 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c05e0f6f-306f-4b3b-a8b4-86147195eb0f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:17.787965 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c05e0f6f-306f-4b3b-a8b4-86147195eb0f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:17.922506 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-c05e0f6f-306f-4b3b-a8b4-86147195eb0f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:17.930485 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-c05e0f6f-306f-4b3b-a8b4-86147195eb0f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc" status: 200 len: 1266 microversion: 2.1 time: 0.160640 Sep 21 16:27:17.931062 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 238/558] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:17 2022] GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:18.954292 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-94561362-42c9-4d67-af62-eae27bfdf458 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:18.954902 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-94561362-42c9-4d67-af62-eae27bfdf458 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 19567338-1f72-414d-b6d7-7ab9d4fe94bc] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:18.961519 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-94561362-42c9-4d67-af62-eae27bfdf458 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:18.962007 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-94561362-42c9-4d67-af62-eae27bfdf458 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:18.962475 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-94561362-42c9-4d67-af62-eae27bfdf458 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:18.963181 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-94561362-42c9-4d67-af62-eae27bfdf458 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:18.963641 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-94561362-42c9-4d67-af62-eae27bfdf458 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:18.964073 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-94561362-42c9-4d67-af62-eae27bfdf458 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:18.980874 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:27:19.106599 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-94561362-42c9-4d67-af62-eae27bfdf458 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:19.114707 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-94561362-42c9-4d67-af62-eae27bfdf458 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc" status: 200 len: 1266 microversion: 2.1 time: 0.164273 Sep 21 16:27:19.115296 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 321/559] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:18 2022] GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:27:20.137383 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-18627f07-8d42-4871-8dc5-69958d016de9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:20.137985 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-18627f07-8d42-4871-8dc5-69958d016de9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 19567338-1f72-414d-b6d7-7ab9d4fe94bc] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:20.145060 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-18627f07-8d42-4871-8dc5-69958d016de9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:20.145541 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-18627f07-8d42-4871-8dc5-69958d016de9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:20.145969 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-18627f07-8d42-4871-8dc5-69958d016de9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:20.146712 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-18627f07-8d42-4871-8dc5-69958d016de9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:20.147155 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-18627f07-8d42-4871-8dc5-69958d016de9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:20.147571 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-18627f07-8d42-4871-8dc5-69958d016de9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:20.293024 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-18627f07-8d42-4871-8dc5-69958d016de9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:20.300836 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-18627f07-8d42-4871-8dc5-69958d016de9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc" status: 200 len: 1266 microversion: 2.1 time: 0.167369 Sep 21 16:27:20.301405 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 239/560] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:20 2022] GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:21.324620 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-9d024ba3-781c-4464-a019-9ba2c81b49ca tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:21.325258 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-9d024ba3-781c-4464-a019-9ba2c81b49ca tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 19567338-1f72-414d-b6d7-7ab9d4fe94bc] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:21.331764 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9d024ba3-781c-4464-a019-9ba2c81b49ca tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:21.332286 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9d024ba3-781c-4464-a019-9ba2c81b49ca tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:21.332749 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9d024ba3-781c-4464-a019-9ba2c81b49ca tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:21.333441 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9d024ba3-781c-4464-a019-9ba2c81b49ca tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:21.333940 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9d024ba3-781c-4464-a019-9ba2c81b49ca tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:21.334386 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9d024ba3-781c-4464-a019-9ba2c81b49ca tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:21.482289 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-9d024ba3-781c-4464-a019-9ba2c81b49ca tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:21.492705 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-9d024ba3-781c-4464-a019-9ba2c81b49ca tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc" status: 200 len: 1266 microversion: 2.1 time: 0.171837 Sep 21 16:27:21.494158 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 322/561] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:21 2022] GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:22.517868 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-14fa7cfd-8aa9-43bd-a0c9-3bdfdeb24e14 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:22.518567 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-14fa7cfd-8aa9-43bd-a0c9-3bdfdeb24e14 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 19567338-1f72-414d-b6d7-7ab9d4fe94bc] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:22.526445 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-14fa7cfd-8aa9-43bd-a0c9-3bdfdeb24e14 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:22.526939 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-14fa7cfd-8aa9-43bd-a0c9-3bdfdeb24e14 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:22.527368 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-14fa7cfd-8aa9-43bd-a0c9-3bdfdeb24e14 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:22.528073 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-14fa7cfd-8aa9-43bd-a0c9-3bdfdeb24e14 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:22.528521 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-14fa7cfd-8aa9-43bd-a0c9-3bdfdeb24e14 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:22.528938 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-14fa7cfd-8aa9-43bd-a0c9-3bdfdeb24e14 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:22.674364 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-14fa7cfd-8aa9-43bd-a0c9-3bdfdeb24e14 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:22.682252 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-14fa7cfd-8aa9-43bd-a0c9-3bdfdeb24e14 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc" status: 200 len: 1266 microversion: 2.1 time: 0.169193 Sep 21 16:27:22.682821 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 240/562] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:22 2022] GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:23.704529 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-2c2cbc9f-e933-4b70-a473-5bf72c3e65bc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:23.705142 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-2c2cbc9f-e933-4b70-a473-5bf72c3e65bc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 19567338-1f72-414d-b6d7-7ab9d4fe94bc] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:23.713267 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2c2cbc9f-e933-4b70-a473-5bf72c3e65bc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:23.713764 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2c2cbc9f-e933-4b70-a473-5bf72c3e65bc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:23.714232 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2c2cbc9f-e933-4b70-a473-5bf72c3e65bc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:23.714947 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2c2cbc9f-e933-4b70-a473-5bf72c3e65bc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:23.715400 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2c2cbc9f-e933-4b70-a473-5bf72c3e65bc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:23.715823 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2c2cbc9f-e933-4b70-a473-5bf72c3e65bc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:23.859062 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-2c2cbc9f-e933-4b70-a473-5bf72c3e65bc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:23.876341 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-2c2cbc9f-e933-4b70-a473-5bf72c3e65bc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc" status: 200 len: 1266 microversion: 2.1 time: 0.166488 Sep 21 16:27:23.876341 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 323/563] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:23 2022] GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:23.990837 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-6722b260-c719-4cb8-8fab-365f0cbb0815 req-c2d29a13-dcbf-4333-aa2f-3eaa752dbf25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19567338-1f72-414d-b6d7-7ab9d4fe94bc", "name": "network-vif-plugged", "status": "completed", "tag": "8c077bf0-61d4-4c24-843e-0a70de3959d3"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:27:24.002105 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-6722b260-c719-4cb8-8fab-365f0cbb0815 req-c2d29a13-dcbf-4333-aa2f-3eaa752dbf25 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:24.002809 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-6722b260-c719-4cb8-8fab-365f0cbb0815 req-c2d29a13-dcbf-4333-aa2f-3eaa752dbf25 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:24.004190 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-6722b260-c719-4cb8-8fab-365f0cbb0815 req-c2d29a13-dcbf-4333-aa2f-3eaa752dbf25 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:24.017053 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-6722b260-c719-4cb8-8fab-365f0cbb0815 req-c2d29a13-dcbf-4333-aa2f-3eaa752dbf25 service nova] Creating event network-vif-plugged:8c077bf0-61d4-4c24-843e-0a70de3959d3 for instance 19567338-1f72-414d-b6d7-7ab9d4fe94bc on hv-cinder-85862 Sep 21 16:27:24.022358 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-6722b260-c719-4cb8-8fab-365f0cbb0815 req-c2d29a13-dcbf-4333-aa2f-3eaa752dbf25 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035213 Sep 21 16:27:24.022959 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 241/564] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:27:24.891243 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-9d33bbf9-1329-4636-a984-9df88fc16c69 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:24.892071 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-9d33bbf9-1329-4636-a984-9df88fc16c69 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 19567338-1f72-414d-b6d7-7ab9d4fe94bc] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:24.898036 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9d33bbf9-1329-4636-a984-9df88fc16c69 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:24.898548 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9d33bbf9-1329-4636-a984-9df88fc16c69 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:24.899038 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9d33bbf9-1329-4636-a984-9df88fc16c69 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:24.900071 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9d33bbf9-1329-4636-a984-9df88fc16c69 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:24.900531 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9d33bbf9-1329-4636-a984-9df88fc16c69 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:24.901004 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9d33bbf9-1329-4636-a984-9df88fc16c69 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:25.039319 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-9d33bbf9-1329-4636-a984-9df88fc16c69 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:25.047897 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-9d33bbf9-1329-4636-a984-9df88fc16c69 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc" status: 200 len: 1266 microversion: 2.1 time: 0.160504 Sep 21 16:27:25.048497 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 324/565] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:24 2022] GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:26.070473 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-e4e0bb69-a9df-4440-a9d9-134590ac5ba8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:26.071161 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-e4e0bb69-a9df-4440-a9d9-134590ac5ba8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 19567338-1f72-414d-b6d7-7ab9d4fe94bc] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:26.078377 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e4e0bb69-a9df-4440-a9d9-134590ac5ba8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:26.078890 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e4e0bb69-a9df-4440-a9d9-134590ac5ba8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:26.079323 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e4e0bb69-a9df-4440-a9d9-134590ac5ba8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:26.080084 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e4e0bb69-a9df-4440-a9d9-134590ac5ba8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:26.080653 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e4e0bb69-a9df-4440-a9d9-134590ac5ba8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:26.081115 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e4e0bb69-a9df-4440-a9d9-134590ac5ba8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:26.223952 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-e4e0bb69-a9df-4440-a9d9-134590ac5ba8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:26.237615 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-e4e0bb69-a9df-4440-a9d9-134590ac5ba8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc" status: 200 len: 1453 microversion: 2.1 time: 0.170867 Sep 21 16:27:26.238939 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 242/566] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:26 2022] GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc => generated 1453 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:26.261619 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-0882ed4b-5d98-4e7b-82d3-1a3f1f6fdd54 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:26.262271 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-0882ed4b-5d98-4e7b-82d3-1a3f1f6fdd54 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 19567338-1f72-414d-b6d7-7ab9d4fe94bc] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:26.268707 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0882ed4b-5d98-4e7b-82d3-1a3f1f6fdd54 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:26.269222 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0882ed4b-5d98-4e7b-82d3-1a3f1f6fdd54 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:26.269659 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0882ed4b-5d98-4e7b-82d3-1a3f1f6fdd54 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:26.270392 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0882ed4b-5d98-4e7b-82d3-1a3f1f6fdd54 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:26.270850 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0882ed4b-5d98-4e7b-82d3-1a3f1f6fdd54 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:26.271276 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0882ed4b-5d98-4e7b-82d3-1a3f1f6fdd54 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:26.409823 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-0882ed4b-5d98-4e7b-82d3-1a3f1f6fdd54 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:26.417698 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-0882ed4b-5d98-4e7b-82d3-1a3f1f6fdd54 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc" status: 200 len: 1453 microversion: 2.1 time: 0.160458 Sep 21 16:27:26.418377 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 325/567] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:26 2022] GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:26.835804 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-f12a5527-b9a2-4919-a6b3-99fedf2c35ce tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5daa0358-1a92-4801-95be-3236e23d3e76"}} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:27:26.838572 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-f12a5527-b9a2-4919-a6b3-99fedf2c35ce tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:26.845043 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f12a5527-b9a2-4919-a6b3-99fedf2c35ce tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:26.845511 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f12a5527-b9a2-4919-a6b3-99fedf2c35ce tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:26.845955 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f12a5527-b9a2-4919-a6b3-99fedf2c35ce tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:26.846765 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f12a5527-b9a2-4919-a6b3-99fedf2c35ce tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:26.847223 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f12a5527-b9a2-4919-a6b3-99fedf2c35ce tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:26.847656 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f12a5527-b9a2-4919-a6b3-99fedf2c35ce tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:27.143223 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-f12a5527-b9a2-4919-a6b3-99fedf2c35ce tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "POST /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311353 Sep 21 16:27:27.150366 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 243/568] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Sep 21 16:27:26 2022] POST /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664/os-volume_attachments => generated 194 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:27:28.564185 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-531720ec-703c-47ed-a027-2b633920aad8 req-88d06b6c-04b8-43a6-966d-a7eea19b15a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19567338-1f72-414d-b6d7-7ab9d4fe94bc", "tag": "8c077bf0-61d4-4c24-843e-0a70de3959d3"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:27:28.574421 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-531720ec-703c-47ed-a027-2b633920aad8 req-88d06b6c-04b8-43a6-966d-a7eea19b15a1 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:28.574899 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-531720ec-703c-47ed-a027-2b633920aad8 req-88d06b6c-04b8-43a6-966d-a7eea19b15a1 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:28.575335 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-531720ec-703c-47ed-a027-2b633920aad8 req-88d06b6c-04b8-43a6-966d-a7eea19b15a1 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:28.586985 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-531720ec-703c-47ed-a027-2b633920aad8 req-88d06b6c-04b8-43a6-966d-a7eea19b15a1 service nova] Creating event network-changed:8c077bf0-61d4-4c24-843e-0a70de3959d3 for instance 19567338-1f72-414d-b6d7-7ab9d4fe94bc on hv-cinder-85862 Sep 21 16:27:28.592476 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-531720ec-703c-47ed-a027-2b633920aad8 req-88d06b6c-04b8-43a6-966d-a7eea19b15a1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032014 Sep 21 16:27:28.593298 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 326/569] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:27:32.405741 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-fab1e8f8-8696-4670-a12a-476ee8b25474 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:32.406327 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-fab1e8f8-8696-4670-a12a-476ee8b25474 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 7ffeddb1-1776-4585-9f48-3920444b4b18] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:32.413115 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fab1e8f8-8696-4670-a12a-476ee8b25474 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:32.413574 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fab1e8f8-8696-4670-a12a-476ee8b25474 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:32.414007 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fab1e8f8-8696-4670-a12a-476ee8b25474 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:32.415271 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fab1e8f8-8696-4670-a12a-476ee8b25474 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:32.415715 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fab1e8f8-8696-4670-a12a-476ee8b25474 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:32.416127 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fab1e8f8-8696-4670-a12a-476ee8b25474 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:32.439040 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-fab1e8f8-8696-4670-a12a-476ee8b25474 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18/ips" status: 200 len: 149 microversion: 2.1 time: 0.041821 Sep 21 16:27:32.439604 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 244/570] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Sep 21 16:27:32 2022] GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:27:32.452336 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-976c2ef9-15dc-464a-99a8-c7d455cd69be tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a08d0ea-25a1-4a2f-9a7a-2e93634c5012"}} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:27:32.454754 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-976c2ef9-15dc-464a-99a8-c7d455cd69be tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 7ffeddb1-1776-4585-9f48-3920444b4b18] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:32.461277 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-976c2ef9-15dc-464a-99a8-c7d455cd69be tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:32.461758 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-976c2ef9-15dc-464a-99a8-c7d455cd69be tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:32.462217 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-976c2ef9-15dc-464a-99a8-c7d455cd69be tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:32.462902 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-976c2ef9-15dc-464a-99a8-c7d455cd69be tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:32.463348 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-976c2ef9-15dc-464a-99a8-c7d455cd69be tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:32.463960 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-976c2ef9-15dc-464a-99a8-c7d455cd69be tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:32.552798 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.wsgi [None req-976c2ef9-15dc-464a-99a8-c7d455cd69be tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] HTTP exception thrown: Invalid volume: volume 0a08d0ea-25a1-4a2f-9a7a-2e93634c5012 is already attached to instances: 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 Sep 21 16:27:32.554538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-976c2ef9-15dc-464a-99a8-c7d455cd69be tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Request method failure captured: Sep 21 16:27:32.554538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: request: POST /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18/os-volume_attachments HTTP/1.1 Sep 21 16:27:32.554538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept: application/json Sep 21 16:27:32.554538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept-Encoding: identity Sep 21 16:27:32.554538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Connection: close Sep 21 16:27:32.554538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Length: 74 Sep 21 16:27:32.554538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Type: application/json Sep 21 16:27:32.554538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Host: 10.222.0.64 Sep 21 16:27:32.554538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Openstack-System-Scope: None Sep 21 16:27:32.554538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: User-Agent: python-urllib3/1.26.12 Sep 21 16:27:32.554538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Auth-Token: gAAAAABjKzptDl5Jwme7JQaRL3V8XsiXvjsgkfXKC5CR9zEf_XxPd1NsWodDna8_dBwDJyu9_lHil_M0vLPPzmX177kcKqWx5X8mqOmQSrRLHHx1LRIv3gdLEkJSUiwMVF6fR-kEaNic5IQ5zuSAZa0555zHli7HQ0zguOZ1COKKRN-ARxj0HyM Sep 21 16:27:32.554538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Id: None Sep 21 16:27:32.554538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Name: None Sep 21 16:27:32.554538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Identity-Status: Confirmed Sep 21 16:27:32.554538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Is-Admin-Project: True Sep 21 16:27:32.554538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Id: default Sep 21 16:27:32.554538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Name: Default Sep 21 16:27:32.554538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Id: ce7a3e77ddf14b48986752434dda6d33 Sep 21 16:27:32.554538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Name: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:27:32.554538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Role: member,reader Sep 21 16:27:32.554538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Roles: member,reader Sep 21 16:27:32.556151 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce7a3e77ddf14b48986752434dda6d33"}]}] Sep 21 16:27:32.556151 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:27:32.556151 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Id: ce7a3e77ddf14b48986752434dda6d33 Sep 21 16:27:32.556151 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:27:32.556151 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User: tempest-AttachVolumeNegativeTest-67026365-project Sep 21 16:27:32.556151 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Id: default Sep 21 16:27:32.556151 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Name: Default Sep 21 16:27:32.556151 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Id: b917d84a650f4355a676e315ea039f0e Sep 21 16:27:32.556151 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Name: tempest-AttachVolumeNegativeTest-67026365-project Sep 21 16:27:32.556151 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Sep 21 16:27:32.556151 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: {"volumeAttachment": {"volumeId": "0a08d0ea-25a1-4a2f-9a7a-2e93634c5012"}} Sep 21 16:27:32.556151 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: method: > Sep 21 16:27:32.557090 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: exception: Invalid volume: volume 0a08d0ea-25a1-4a2f-9a7a-2e93634c5012 is already attached to instances: 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 Sep 21 16:27:32.557090 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: action_args: {'server_id': '7ffeddb1-1776-4585-9f48-3920444b4b18', 'body': {'volumeAttachment': {'volumeId': '0a08d0ea-25a1-4a2f-9a7a-2e93634c5012'}}} Sep 21 16:27:32.557090 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:27:32.557090 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:27:32.557090 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 21 16:27:32.557090 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 21 16:27:32.557090 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 21 16:27:32.557090 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 21 16:27:32.557090 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 21 16:27:32.557090 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 21 16:27:32.557090 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 21 16:27:32.557090 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 21 16:27:32.557090 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 21 16:27:32.557090 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 21 16:27:32.557090 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0a08d0ea-25a1-4a2f-9a7a-2e93634c5012 is already attached to instances: 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 Sep 21 16:27:32.557090 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:27:32.557090 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:27:32.557090 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:27:32.557090 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:27:32.558367 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:27:32.558367 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:27:32.558367 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:27:32.558367 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:27:32.558367 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:27:32.558367 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:27:32.558367 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 21 16:27:32.558367 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 21 16:27:32.558367 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 21 16:27:32.558367 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 21 16:27:32.558367 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 21 16:27:32.558367 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 21 16:27:32.558367 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 21 16:27:32.558367 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 21 16:27:32.558367 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0a08d0ea-25a1-4a2f-9a7a-2e93634c5012 is already attached to instances: 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 Sep 21 16:27:32.558367 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:27:32.558367 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:27:32.558367 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:27:32.558367 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:27:32.558367 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:27:32.559544 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:27:32.559544 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:27:32.559544 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:27:32.559544 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0a08d0ea-25a1-4a2f-9a7a-2e93634c5012 is already attached to instances: 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 Sep 21 16:27:32.559544 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:27:32.559544 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-976c2ef9-15dc-464a-99a8-c7d455cd69be tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Returning 400 to user: Invalid volume: volume 0a08d0ea-25a1-4a2f-9a7a-2e93634c5012 is already attached to instances: 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 {{(pid=120532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:27:32.559544 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-976c2ef9-15dc-464a-99a8-c7d455cd69be tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "POST /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108890 Sep 21 16:27:32.559544 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 327/571] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Sep 21 16:27:32 2022] POST /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 21 16:27:32.565061 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-87eead62-9af4-49d2-896a-01160e1b186c tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:32.565553 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-87eead62-9af4-49d2-896a-01160e1b186c tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 7ffeddb1-1776-4585-9f48-3920444b4b18] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:32.571450 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-87eead62-9af4-49d2-896a-01160e1b186c tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:32.571923 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-87eead62-9af4-49d2-896a-01160e1b186c tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:32.572352 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-87eead62-9af4-49d2-896a-01160e1b186c tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:32.573037 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-87eead62-9af4-49d2-896a-01160e1b186c tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:32.573484 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-87eead62-9af4-49d2-896a-01160e1b186c tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:32.573902 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-87eead62-9af4-49d2-896a-01160e1b186c tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:32.598910 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-87eead62-9af4-49d2-896a-01160e1b186c tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 7ffeddb1-1776-4585-9f48-3920444b4b18] Going to try to terminate instance {{(pid=120531) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 16:27:32.672198 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-87eead62-9af4-49d2-896a-01160e1b186c tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "DELETE /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18" status: 204 len: 0 microversion: 2.1 time: 0.110472 Sep 21 16:27:32.672708 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 245/572] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Sep 21 16:27:32 2022] DELETE /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 21 16:27:32.683687 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-447938c7-3b26-4423-9c9e-5d602e532074 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:32.684570 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-447938c7-3b26-4423-9c9e-5d602e532074 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 7ffeddb1-1776-4585-9f48-3920444b4b18] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:32.692345 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-447938c7-3b26-4423-9c9e-5d602e532074 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:32.692829 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-447938c7-3b26-4423-9c9e-5d602e532074 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:32.693294 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-447938c7-3b26-4423-9c9e-5d602e532074 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:32.693988 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-447938c7-3b26-4423-9c9e-5d602e532074 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:32.694467 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-447938c7-3b26-4423-9c9e-5d602e532074 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:32.694889 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-447938c7-3b26-4423-9c9e-5d602e532074 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:32.828708 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-447938c7-3b26-4423-9c9e-5d602e532074 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:32.837186 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-447938c7-3b26-4423-9c9e-5d602e532074 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18" status: 200 len: 1679 microversion: 2.1 time: 0.159173 Sep 21 16:27:32.837753 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 328/573] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:32 2022] GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:33.861653 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-6b13c01e-0f99-4a93-b5f5-877fc78d2266 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:33.862296 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-6b13c01e-0f99-4a93-b5f5-877fc78d2266 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 7ffeddb1-1776-4585-9f48-3920444b4b18] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:33.869285 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6b13c01e-0f99-4a93-b5f5-877fc78d2266 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:33.869765 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6b13c01e-0f99-4a93-b5f5-877fc78d2266 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:33.870231 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6b13c01e-0f99-4a93-b5f5-877fc78d2266 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:33.870919 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6b13c01e-0f99-4a93-b5f5-877fc78d2266 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:33.871367 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6b13c01e-0f99-4a93-b5f5-877fc78d2266 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:33.871783 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6b13c01e-0f99-4a93-b5f5-877fc78d2266 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:34.006837 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-6b13c01e-0f99-4a93-b5f5-877fc78d2266 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:34.014833 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-6b13c01e-0f99-4a93-b5f5-877fc78d2266 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18" status: 200 len: 1679 microversion: 2.1 time: 0.157520 Sep 21 16:27:34.015419 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 246/574] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:33 2022] GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:35.038386 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ae0ee01d-c62c-4ecc-84ac-76c3ed5ca14f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:35.038914 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ae0ee01d-c62c-4ecc-84ac-76c3ed5ca14f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 7ffeddb1-1776-4585-9f48-3920444b4b18] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:35.046320 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ae0ee01d-c62c-4ecc-84ac-76c3ed5ca14f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:35.046817 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ae0ee01d-c62c-4ecc-84ac-76c3ed5ca14f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:35.047287 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ae0ee01d-c62c-4ecc-84ac-76c3ed5ca14f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:35.047996 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ae0ee01d-c62c-4ecc-84ac-76c3ed5ca14f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:35.048455 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ae0ee01d-c62c-4ecc-84ac-76c3ed5ca14f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:35.048879 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ae0ee01d-c62c-4ecc-84ac-76c3ed5ca14f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:35.185943 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ae0ee01d-c62c-4ecc-84ac-76c3ed5ca14f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:35.194291 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ae0ee01d-c62c-4ecc-84ac-76c3ed5ca14f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18" status: 200 len: 1679 microversion: 2.1 time: 0.160049 Sep 21 16:27:35.194941 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 329/575] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:35 2022] GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:36.219512 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-c6bfeb8c-0a60-4149-8206-703187bf9549 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:36.220117 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-c6bfeb8c-0a60-4149-8206-703187bf9549 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 7ffeddb1-1776-4585-9f48-3920444b4b18] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:36.226986 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c6bfeb8c-0a60-4149-8206-703187bf9549 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:36.227469 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c6bfeb8c-0a60-4149-8206-703187bf9549 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:36.227897 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c6bfeb8c-0a60-4149-8206-703187bf9549 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:36.229166 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c6bfeb8c-0a60-4149-8206-703187bf9549 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:36.229639 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c6bfeb8c-0a60-4149-8206-703187bf9549 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:36.230074 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c6bfeb8c-0a60-4149-8206-703187bf9549 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:36.320539 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-c6bfeb8c-0a60-4149-8206-703187bf9549 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:36.329563 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-c6bfeb8c-0a60-4149-8206-703187bf9549 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18" status: 200 len: 1611 microversion: 2.1 time: 0.113780 Sep 21 16:27:36.330282 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 247/576] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:36 2022] GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18 => generated 1611 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:36.823668 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-739b8ad1-7e71-4141-bd8b-7be5c42e8c4d req-2a2b1f8d-cacc-4a1d-a0cb-7ad52ec102f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ffeddb1-1776-4585-9f48-3920444b4b18", "name": "network-vif-deleted", "tag": "a15d4d58-da23-48ff-988c-d87d69afffc5"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:27:36.835039 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-739b8ad1-7e71-4141-bd8b-7be5c42e8c4d req-2a2b1f8d-cacc-4a1d-a0cb-7ad52ec102f9 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:36.835937 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-739b8ad1-7e71-4141-bd8b-7be5c42e8c4d req-2a2b1f8d-cacc-4a1d-a0cb-7ad52ec102f9 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:36.836845 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-739b8ad1-7e71-4141-bd8b-7be5c42e8c4d req-2a2b1f8d-cacc-4a1d-a0cb-7ad52ec102f9 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:36.851143 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-739b8ad1-7e71-4141-bd8b-7be5c42e8c4d req-2a2b1f8d-cacc-4a1d-a0cb-7ad52ec102f9 service nova] Creating event network-vif-deleted:a15d4d58-da23-48ff-988c-d87d69afffc5 for instance 7ffeddb1-1776-4585-9f48-3920444b4b18 on hv-cinder-85862 Sep 21 16:27:36.858209 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-739b8ad1-7e71-4141-bd8b-7be5c42e8c4d req-2a2b1f8d-cacc-4a1d-a0cb-7ad52ec102f9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037863 Sep 21 16:27:36.859167 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 330/577] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:27:36.879346 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-ddcfc2c5-cbb0-4bf9-915d-3d1514d8c9ec tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:27:36.881942 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-ddcfc2c5-cbb0-4bf9-915d-3d1514d8c9ec tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:36.889004 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ddcfc2c5-cbb0-4bf9-915d-3d1514d8c9ec tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:36.889629 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ddcfc2c5-cbb0-4bf9-915d-3d1514d8c9ec tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:36.890355 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ddcfc2c5-cbb0-4bf9-915d-3d1514d8c9ec tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:36.891179 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ddcfc2c5-cbb0-4bf9-915d-3d1514d8c9ec tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:36.891874 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ddcfc2c5-cbb0-4bf9-915d-3d1514d8c9ec tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:36.892383 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ddcfc2c5-cbb0-4bf9-915d-3d1514d8c9ec tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:36.919413 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.objects.instance [None req-ddcfc2c5-cbb0-4bf9-915d-3d1514d8c9ec tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lazy-loading 'flavor' on Instance uuid c95f478c-11b2-4097-b4b1-551d61fa9664 {{(pid=120531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 16:27:37.085279 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-ddcfc2c5-cbb0-4bf9-915d-3d1514d8c9ec tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "POST /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664/action" status: 200 len: 32 microversion: 2.1 time: 0.212943 Sep 21 16:27:37.092201 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 248/578] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Sep 21 16:27:36 2022] POST /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664/action => generated 32 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 21 16:27:37.101421 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-601424b7-4215-486f-b1d6-53f8cdad9a88 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:37.102425 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-601424b7-4215-486f-b1d6-53f8cdad9a88 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:37.112397 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-601424b7-4215-486f-b1d6-53f8cdad9a88 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:37.113675 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-601424b7-4215-486f-b1d6-53f8cdad9a88 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:37.114364 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-601424b7-4215-486f-b1d6-53f8cdad9a88 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:37.115312 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-601424b7-4215-486f-b1d6-53f8cdad9a88 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:37.116600 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-601424b7-4215-486f-b1d6-53f8cdad9a88 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:37.117211 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-601424b7-4215-486f-b1d6-53f8cdad9a88 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:37.334723 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-601424b7-4215-486f-b1d6-53f8cdad9a88 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:37.346842 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-601424b7-4215-486f-b1d6-53f8cdad9a88 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1735 microversion: 2.1 time: 0.252437 Sep 21 16:27:37.348801 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 331/579] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:37 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1735 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:37.355549 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-72d53072-2d6b-4e9a-beea-51c4b0c0b71e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:37.356901 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-72d53072-2d6b-4e9a-beea-51c4b0c0b71e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 7ffeddb1-1776-4585-9f48-3920444b4b18] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:37.364771 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-72d53072-2d6b-4e9a-beea-51c4b0c0b71e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:37.365513 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-72d53072-2d6b-4e9a-beea-51c4b0c0b71e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:37.366026 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-72d53072-2d6b-4e9a-beea-51c4b0c0b71e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:37.366832 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-72d53072-2d6b-4e9a-beea-51c4b0c0b71e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:37.367359 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-72d53072-2d6b-4e9a-beea-51c4b0c0b71e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:37.367875 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-72d53072-2d6b-4e9a-beea-51c4b0c0b71e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:37.403885 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-72d53072-2d6b-4e9a-beea-51c4b0c0b71e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:37.404480 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-72d53072-2d6b-4e9a-beea-51c4b0c0b71e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:37.404987 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-72d53072-2d6b-4e9a-beea-51c4b0c0b71e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:37.405766 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.objects.instance [None req-72d53072-2d6b-4e9a-beea-51c4b0c0b71e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lazy-loading 'fault' on Instance uuid 7ffeddb1-1776-4585-9f48-3920444b4b18 {{(pid=120531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 16:27:37.478464 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-72d53072-2d6b-4e9a-beea-51c4b0c0b71e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:37.482743 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:27:37.494279 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-72d53072-2d6b-4e9a-beea-51c4b0c0b71e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18" status: 200 len: 1329 microversion: 2.1 time: 0.143981 Sep 21 16:27:37.494883 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 249/580] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:37 2022] GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18 => generated 1329 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:27:37.598572 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-612d6092-c71e-499d-9d3a-dbd9beb10aeb tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:27:37.600866 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-612d6092-c71e-499d-9d3a-dbd9beb10aeb tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:37.607292 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-612d6092-c71e-499d-9d3a-dbd9beb10aeb tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:37.607779 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-612d6092-c71e-499d-9d3a-dbd9beb10aeb tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:37.608242 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-612d6092-c71e-499d-9d3a-dbd9beb10aeb tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:37.608949 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-612d6092-c71e-499d-9d3a-dbd9beb10aeb tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:37.609403 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-612d6092-c71e-499d-9d3a-dbd9beb10aeb tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:37.610008 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-612d6092-c71e-499d-9d3a-dbd9beb10aeb tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:37.689263 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-612d6092-c71e-499d-9d3a-dbd9beb10aeb tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "POST /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd/action" status: 202 len: 0 microversion: 2.1 time: 0.094406 Sep 21 16:27:37.689921 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 332/581] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Sep 21 16:27:37 2022] POST /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 16:27:37.702672 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-154da5ab-c153-4980-9946-38acffb944d4 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:37.706201 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-154da5ab-c153-4980-9946-38acffb944d4 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:37.717843 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-154da5ab-c153-4980-9946-38acffb944d4 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:37.718493 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-154da5ab-c153-4980-9946-38acffb944d4 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:37.718932 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-154da5ab-c153-4980-9946-38acffb944d4 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:37.719672 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-154da5ab-c153-4980-9946-38acffb944d4 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:37.720127 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-154da5ab-c153-4980-9946-38acffb944d4 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:37.720547 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-154da5ab-c153-4980-9946-38acffb944d4 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:38.141339 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-154da5ab-c153-4980-9946-38acffb944d4 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:38.153464 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-154da5ab-c153-4980-9946-38acffb944d4 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1751 microversion: 2.1 time: 0.458906 Sep 21 16:27:38.168202 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 250/582] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:37 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1751 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:38.374179 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-7bf5d9f3-00d0-4c25-9424-a6a986057f6a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:38.374880 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-7bf5d9f3-00d0-4c25-9424-a6a986057f6a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:38.381572 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7bf5d9f3-00d0-4c25-9424-a6a986057f6a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:38.382373 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7bf5d9f3-00d0-4c25-9424-a6a986057f6a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:38.382977 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7bf5d9f3-00d0-4c25-9424-a6a986057f6a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:38.383849 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7bf5d9f3-00d0-4c25-9424-a6a986057f6a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:38.384492 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7bf5d9f3-00d0-4c25-9424-a6a986057f6a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:38.385099 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7bf5d9f3-00d0-4c25-9424-a6a986057f6a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:38.518194 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-7e8d5038-74b6-4d9a-8793-ea373d6510cd tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:38.519114 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-7e8d5038-74b6-4d9a-8793-ea373d6510cd tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 7ffeddb1-1776-4585-9f48-3920444b4b18] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:38.529761 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7e8d5038-74b6-4d9a-8793-ea373d6510cd tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:38.530461 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7e8d5038-74b6-4d9a-8793-ea373d6510cd tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:38.530898 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7e8d5038-74b6-4d9a-8793-ea373d6510cd tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:38.531732 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7e8d5038-74b6-4d9a-8793-ea373d6510cd tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:38.532403 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7e8d5038-74b6-4d9a-8793-ea373d6510cd tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:38.532971 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7e8d5038-74b6-4d9a-8793-ea373d6510cd tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:38.550500 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.wsgi [None req-7e8d5038-74b6-4d9a-8793-ea373d6510cd tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] HTTP exception thrown: Instance 7ffeddb1-1776-4585-9f48-3920444b4b18 could not be found. Sep 21 16:27:38.552372 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-7e8d5038-74b6-4d9a-8793-ea373d6510cd tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Request method failure captured: Sep 21 16:27:38.552372 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: request: GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18 HTTP/1.1 Sep 21 16:27:38.552372 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept: application/json Sep 21 16:27:38.552372 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept-Encoding: identity Sep 21 16:27:38.552372 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Connection: close Sep 21 16:27:38.552372 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Length: 0 Sep 21 16:27:38.552372 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Type: application/json Sep 21 16:27:38.552372 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Host: 10.222.0.64 Sep 21 16:27:38.552372 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Openstack-System-Scope: None Sep 21 16:27:38.552372 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: User-Agent: python-urllib3/1.26.12 Sep 21 16:27:38.552372 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Auth-Token: gAAAAABjKzptDl5Jwme7JQaRL3V8XsiXvjsgkfXKC5CR9zEf_XxPd1NsWodDna8_dBwDJyu9_lHil_M0vLPPzmX177kcKqWx5X8mqOmQSrRLHHx1LRIv3gdLEkJSUiwMVF6fR-kEaNic5IQ5zuSAZa0555zHli7HQ0zguOZ1COKKRN-ARxj0HyM Sep 21 16:27:38.552372 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Id: None Sep 21 16:27:38.552372 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Name: None Sep 21 16:27:38.552372 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Identity-Status: Confirmed Sep 21 16:27:38.552372 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Is-Admin-Project: True Sep 21 16:27:38.552372 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Id: default Sep 21 16:27:38.552372 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Name: Default Sep 21 16:27:38.552372 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Id: ce7a3e77ddf14b48986752434dda6d33 Sep 21 16:27:38.552372 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Name: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:27:38.552372 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Role: member,reader Sep 21 16:27:38.552372 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Roles: member,reader Sep 21 16:27:38.553699 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce7a3e77ddf14b48986752434dda6d33"}]}] Sep 21 16:27:38.553699 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:27:38.553699 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Id: ce7a3e77ddf14b48986752434dda6d33 Sep 21 16:27:38.553699 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:27:38.553699 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User: tempest-AttachVolumeNegativeTest-67026365-project Sep 21 16:27:38.553699 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Id: default Sep 21 16:27:38.553699 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Name: Default Sep 21 16:27:38.553699 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Id: b917d84a650f4355a676e315ea039f0e Sep 21 16:27:38.553699 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Name: tempest-AttachVolumeNegativeTest-67026365-project Sep 21 16:27:38.553699 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: method: > Sep 21 16:27:38.553699 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: exception: Instance 7ffeddb1-1776-4585-9f48-3920444b4b18 could not be found. Sep 21 16:27:38.553699 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: action_args: {'id': '7ffeddb1-1776-4585-9f48-3920444b4b18'} Sep 21 16:27:38.554604 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:27:38.554604 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:27:38.554604 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 16:27:38.554604 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 16:27:38.554604 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 16:27:38.554604 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 16:27:38.554604 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 16:27:38.554604 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 16:27:38.554604 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 16:27:38.554604 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 16:27:38.554604 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ffeddb1-1776-4585-9f48-3920444b4b18 could not be found. Sep 21 16:27:38.554604 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:27:38.554604 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:27:38.554604 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:27:38.554604 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:27:38.554604 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:27:38.554604 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:27:38.554604 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:27:38.554604 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:27:38.554604 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:27:38.556437 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:27:38.556437 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 16:27:38.556437 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 16:27:38.556437 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 16:27:38.556437 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 16:27:38.556437 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 16:27:38.556437 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:27:38.556437 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ffeddb1-1776-4585-9f48-3920444b4b18 could not be found. Sep 21 16:27:38.556437 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:27:38.556437 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:27:38.556437 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:27:38.556437 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:27:38.556437 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:27:38.556437 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:27:38.556437 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:27:38.556437 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:27:38.556437 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ffeddb1-1776-4585-9f48-3920444b4b18 could not be found. Sep 21 16:27:38.556437 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:27:38.557917 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-7e8d5038-74b6-4d9a-8793-ea373d6510cd tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Returning 404 to user: Instance 7ffeddb1-1776-4585-9f48-3920444b4b18 could not be found. {{(pid=120531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:27:38.557917 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-7e8d5038-74b6-4d9a-8793-ea373d6510cd tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18" status: 404 len: 111 microversion: 2.1 time: 0.039572 Sep 21 16:27:38.557917 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 251/583] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:38 2022] GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 16:27:38.563392 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-685b49c2-b576-4f56-8913-8b61b68efad5 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '.version_select at 0x7fdb88d930d0>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:38.564832 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-7bf5d9f3-00d0-4c25-9424-a6a986057f6a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:38.573760 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-7bf5d9f3-00d0-4c25-9424-a6a986057f6a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1735 microversion: 2.1 time: 0.204960 Sep 21 16:27:38.574580 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 333/584] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:38 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1735 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:38.599559 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-685b49c2-b576-4f56-8913-8b61b68efad5 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-30027367" status: 202 len: 0 microversion: 2.1 time: 0.039909 Sep 21 16:27:38.600302 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 252/585] 10.222.0.64 () {58 vars in 1215 bytes} [Wed Sep 21 16:27:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-30027367 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 16:27:39.182618 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-877dd476-a0ae-4e54-bf35-5484c80bbf3b tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:39.183246 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-877dd476-a0ae-4e54-bf35-5484c80bbf3b tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:39.185507 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_api:SELECT=38 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:27:39.191419 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-877dd476-a0ae-4e54-bf35-5484c80bbf3b tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:39.191914 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-877dd476-a0ae-4e54-bf35-5484c80bbf3b tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:39.192732 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-877dd476-a0ae-4e54-bf35-5484c80bbf3b tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:39.193482 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-877dd476-a0ae-4e54-bf35-5484c80bbf3b tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:39.193950 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-877dd476-a0ae-4e54-bf35-5484c80bbf3b tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:39.194558 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-877dd476-a0ae-4e54-bf35-5484c80bbf3b tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:39.406084 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-877dd476-a0ae-4e54-bf35-5484c80bbf3b tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:39.415558 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-877dd476-a0ae-4e54-bf35-5484c80bbf3b tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1756 microversion: 2.1 time: 0.238444 Sep 21 16:27:39.416443 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 334/586] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:39 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1756 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:39.550500 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-891fae48-23f1-48ca-bb10-b55b0e74e925 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:39.551015 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-891fae48-23f1-48ca-bb10-b55b0e74e925 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:39.558228 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-891fae48-23f1-48ca-bb10-b55b0e74e925 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:39.558705 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-891fae48-23f1-48ca-bb10-b55b0e74e925 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:39.559132 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-891fae48-23f1-48ca-bb10-b55b0e74e925 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:39.559815 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-891fae48-23f1-48ca-bb10-b55b0e74e925 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:39.560257 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-891fae48-23f1-48ca-bb10-b55b0e74e925 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:39.560670 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-891fae48-23f1-48ca-bb10-b55b0e74e925 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:39.597499 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-5a6eb3c0-71d4-4f0e-a178-4b624f6e80fd tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:39.598178 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-5a6eb3c0-71d4-4f0e-a178-4b624f6e80fd tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:39.604889 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5a6eb3c0-71d4-4f0e-a178-4b624f6e80fd tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:39.605378 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5a6eb3c0-71d4-4f0e-a178-4b624f6e80fd tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:39.605812 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5a6eb3c0-71d4-4f0e-a178-4b624f6e80fd tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:39.606530 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5a6eb3c0-71d4-4f0e-a178-4b624f6e80fd tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:39.606988 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5a6eb3c0-71d4-4f0e-a178-4b624f6e80fd tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:39.607413 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5a6eb3c0-71d4-4f0e-a178-4b624f6e80fd tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:39.644531 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.objects.instance [None req-891fae48-23f1-48ca-bb10-b55b0e74e925 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lazy-loading 'services' on Instance uuid 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 {{(pid=120531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 16:27:39.720453 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-891fae48-23f1-48ca-bb10-b55b0e74e925 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "DELETE /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77/os-volume_attachments/0a08d0ea-25a1-4a2f-9a7a-2e93634c5012" status: 202 len: 0 microversion: 2.1 time: 0.176893 Sep 21 16:27:39.721087 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 253/587] 10.222.0.64 () {58 vars in 1416 bytes} [Wed Sep 21 16:27:39 2022] DELETE /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77/os-volume_attachments/0a08d0ea-25a1-4a2f-9a7a-2e93634c5012 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 16:27:39.731203 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-56598c44-358f-454e-b740-c25759e9e710 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:39.733975 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-56598c44-358f-454e-b740-c25759e9e710 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:39.740590 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-56598c44-358f-454e-b740-c25759e9e710 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:39.741169 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-56598c44-358f-454e-b740-c25759e9e710 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:39.741787 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-56598c44-358f-454e-b740-c25759e9e710 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:39.743078 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-56598c44-358f-454e-b740-c25759e9e710 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:39.744156 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-56598c44-358f-454e-b740-c25759e9e710 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:39.744599 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-56598c44-358f-454e-b740-c25759e9e710 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:39.759567 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5a6eb3c0-71d4-4f0e-a178-4b624f6e80fd tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:39.768178 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-5a6eb3c0-71d4-4f0e-a178-4b624f6e80fd tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1735 microversion: 2.1 time: 0.174337 Sep 21 16:27:39.768766 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 335/588] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:39 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:39.781773 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-56598c44-358f-454e-b740-c25759e9e710 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055840 Sep 21 16:27:39.782493 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 254/589] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Sep 21 16:27:39 2022] GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:27:40.440477 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-80dc17ce-a4ed-4057-a92b-10e1d17c330d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:40.441199 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-80dc17ce-a4ed-4057-a92b-10e1d17c330d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:40.448881 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-80dc17ce-a4ed-4057-a92b-10e1d17c330d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:40.449384 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-80dc17ce-a4ed-4057-a92b-10e1d17c330d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:40.449825 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-80dc17ce-a4ed-4057-a92b-10e1d17c330d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:40.450587 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-80dc17ce-a4ed-4057-a92b-10e1d17c330d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:40.451760 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-80dc17ce-a4ed-4057-a92b-10e1d17c330d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:40.451760 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-80dc17ce-a4ed-4057-a92b-10e1d17c330d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:40.613325 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-80dc17ce-a4ed-4057-a92b-10e1d17c330d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:40.621685 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-80dc17ce-a4ed-4057-a92b-10e1d17c330d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1756 microversion: 2.1 time: 0.185893 Sep 21 16:27:40.622332 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 336/590] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:40 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:27:40.793132 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-ba26aca0-736f-4fcc-b437-bf84aea2f68f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:40.793747 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-ba26aca0-736f-4fcc-b437-bf84aea2f68f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:40.794726 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-bca998cf-6c08-4821-9415-cc01c86f822b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:40.797343 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-bca998cf-6c08-4821-9415-cc01c86f822b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:40.801391 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ba26aca0-736f-4fcc-b437-bf84aea2f68f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:40.801875 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ba26aca0-736f-4fcc-b437-bf84aea2f68f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:40.802349 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ba26aca0-736f-4fcc-b437-bf84aea2f68f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:40.803044 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ba26aca0-736f-4fcc-b437-bf84aea2f68f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:40.803479 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bca998cf-6c08-4821-9415-cc01c86f822b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:40.803598 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ba26aca0-736f-4fcc-b437-bf84aea2f68f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:40.803903 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ba26aca0-736f-4fcc-b437-bf84aea2f68f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:40.804050 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bca998cf-6c08-4821-9415-cc01c86f822b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:40.804384 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bca998cf-6c08-4821-9415-cc01c86f822b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:40.805140 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bca998cf-6c08-4821-9415-cc01c86f822b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:40.805614 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bca998cf-6c08-4821-9415-cc01c86f822b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:40.806584 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bca998cf-6c08-4821-9415-cc01c86f822b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:40.836190 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-bca998cf-6c08-4821-9415-cc01c86f822b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045496 Sep 21 16:27:40.836960 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 337/591] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Sep 21 16:27:40 2022] GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 21 16:27:40.901708 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-da70ebac-6e17-435d-9d06-e48b9f9c78ae tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:40.902177 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-da70ebac-6e17-435d-9d06-e48b9f9c78ae tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:40.908148 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-da70ebac-6e17-435d-9d06-e48b9f9c78ae tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:40.908664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-da70ebac-6e17-435d-9d06-e48b9f9c78ae tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:40.909100 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-da70ebac-6e17-435d-9d06-e48b9f9c78ae tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:40.909802 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-da70ebac-6e17-435d-9d06-e48b9f9c78ae tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:40.910281 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-da70ebac-6e17-435d-9d06-e48b9f9c78ae tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:40.910715 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-da70ebac-6e17-435d-9d06-e48b9f9c78ae tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:40.925365 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:27:40.937808 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-ba26aca0-736f-4fcc-b437-bf84aea2f68f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:40.937976 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-da70ebac-6e17-435d-9d06-e48b9f9c78ae tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77] Going to try to terminate instance {{(pid=120532) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 16:27:40.946616 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-ba26aca0-736f-4fcc-b437-bf84aea2f68f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1735 microversion: 2.1 time: 0.157214 Sep 21 16:27:40.947813 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 255/592] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:40 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:41.018883 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-da70ebac-6e17-435d-9d06-e48b9f9c78ae tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "DELETE /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77" status: 204 len: 0 microversion: 2.1 time: 0.121531 Sep 21 16:27:41.019495 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 338/593] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Sep 21 16:27:40 2022] DELETE /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 21 16:27:41.029527 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-9225f289-c650-472c-9735-5dfc9c0f96bc tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:41.030181 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-9225f289-c650-472c-9735-5dfc9c0f96bc tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:41.036397 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9225f289-c650-472c-9735-5dfc9c0f96bc tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:41.036888 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9225f289-c650-472c-9735-5dfc9c0f96bc tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:41.037326 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9225f289-c650-472c-9735-5dfc9c0f96bc tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:41.038034 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9225f289-c650-472c-9735-5dfc9c0f96bc tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:41.038533 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9225f289-c650-472c-9735-5dfc9c0f96bc tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:41.038958 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9225f289-c650-472c-9735-5dfc9c0f96bc tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:41.181602 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-9225f289-c650-472c-9735-5dfc9c0f96bc tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:41.189631 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-9225f289-c650-472c-9735-5dfc9c0f96bc tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77" status: 200 len: 1680 microversion: 2.1 time: 0.164922 Sep 21 16:27:41.190256 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 256/594] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:41 2022] GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:41.645376 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-24dd3420-06c8-47f4-be40-563f5914f6de tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:41.646082 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-24dd3420-06c8-47f4-be40-563f5914f6de tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:41.653380 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-24dd3420-06c8-47f4-be40-563f5914f6de tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:41.653867 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-24dd3420-06c8-47f4-be40-563f5914f6de tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:41.654321 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-24dd3420-06c8-47f4-be40-563f5914f6de tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:41.655086 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-24dd3420-06c8-47f4-be40-563f5914f6de tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:41.655563 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-24dd3420-06c8-47f4-be40-563f5914f6de tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:41.656009 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-24dd3420-06c8-47f4-be40-563f5914f6de tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:41.805608 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-24dd3420-06c8-47f4-be40-563f5914f6de tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:41.814365 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-24dd3420-06c8-47f4-be40-563f5914f6de tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1756 microversion: 2.1 time: 0.173161 Sep 21 16:27:41.814934 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 339/595] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:41 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:27:41.970534 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-2c346828-f34a-4bf6-b473-4d35ded815a5 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:41.971121 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-2c346828-f34a-4bf6-b473-4d35ded815a5 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:41.978228 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2c346828-f34a-4bf6-b473-4d35ded815a5 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:41.978707 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2c346828-f34a-4bf6-b473-4d35ded815a5 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:41.979134 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2c346828-f34a-4bf6-b473-4d35ded815a5 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:41.979815 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2c346828-f34a-4bf6-b473-4d35ded815a5 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:41.980260 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2c346828-f34a-4bf6-b473-4d35ded815a5 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:41.980738 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2c346828-f34a-4bf6-b473-4d35ded815a5 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:42.108989 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-2c346828-f34a-4bf6-b473-4d35ded815a5 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:42.117472 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-2c346828-f34a-4bf6-b473-4d35ded815a5 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1735 microversion: 2.1 time: 0.150741 Sep 21 16:27:42.118028 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 257/596] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:41 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:42.213518 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-9e5c34d9-c2cb-4cbb-b5d9-03de1e821771 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:42.214153 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-9e5c34d9-c2cb-4cbb-b5d9-03de1e821771 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:42.220104 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9e5c34d9-c2cb-4cbb-b5d9-03de1e821771 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:42.220585 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9e5c34d9-c2cb-4cbb-b5d9-03de1e821771 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:42.221020 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9e5c34d9-c2cb-4cbb-b5d9-03de1e821771 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:42.221708 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9e5c34d9-c2cb-4cbb-b5d9-03de1e821771 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:42.222200 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9e5c34d9-c2cb-4cbb-b5d9-03de1e821771 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:42.222628 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9e5c34d9-c2cb-4cbb-b5d9-03de1e821771 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:42.355406 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-9e5c34d9-c2cb-4cbb-b5d9-03de1e821771 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:42.363276 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-9e5c34d9-c2cb-4cbb-b5d9-03de1e821771 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77" status: 200 len: 1680 microversion: 2.1 time: 0.154113 Sep 21 16:27:42.363869 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 340/597] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:42 2022] GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:42.838474 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-1f1312b4-b2f0-4cfc-be93-bc282ac976da tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:42.839077 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-1f1312b4-b2f0-4cfc-be93-bc282ac976da tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:42.845228 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1f1312b4-b2f0-4cfc-be93-bc282ac976da tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:42.845707 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1f1312b4-b2f0-4cfc-be93-bc282ac976da tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:42.846168 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1f1312b4-b2f0-4cfc-be93-bc282ac976da tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:42.846842 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1f1312b4-b2f0-4cfc-be93-bc282ac976da tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:42.847580 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1f1312b4-b2f0-4cfc-be93-bc282ac976da tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:42.847994 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1f1312b4-b2f0-4cfc-be93-bc282ac976da tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:42.990776 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-1f1312b4-b2f0-4cfc-be93-bc282ac976da tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:42.999629 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-1f1312b4-b2f0-4cfc-be93-bc282ac976da tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1756 microversion: 2.1 time: 0.165481 Sep 21 16:27:43.000197 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 258/598] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:42 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:43.142138 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-564b01e0-9062-4a7c-b6cd-d0c9a8850be7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:43.142751 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-564b01e0-9062-4a7c-b6cd-d0c9a8850be7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:43.149521 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-564b01e0-9062-4a7c-b6cd-d0c9a8850be7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:43.150008 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-564b01e0-9062-4a7c-b6cd-d0c9a8850be7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:43.150469 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-564b01e0-9062-4a7c-b6cd-d0c9a8850be7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:43.151167 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-564b01e0-9062-4a7c-b6cd-d0c9a8850be7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:43.151669 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-564b01e0-9062-4a7c-b6cd-d0c9a8850be7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:43.152093 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-564b01e0-9062-4a7c-b6cd-d0c9a8850be7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:43.284057 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-564b01e0-9062-4a7c-b6cd-d0c9a8850be7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:43.292329 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-564b01e0-9062-4a7c-b6cd-d0c9a8850be7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1735 microversion: 2.1 time: 0.154125 Sep 21 16:27:43.293145 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 341/599] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:43 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:43.387047 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-948e374d-1f4d-4a40-917a-ed5d472ac058 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:43.387689 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-948e374d-1f4d-4a40-917a-ed5d472ac058 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:43.394974 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-948e374d-1f4d-4a40-917a-ed5d472ac058 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:43.394974 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-948e374d-1f4d-4a40-917a-ed5d472ac058 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:43.394974 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-948e374d-1f4d-4a40-917a-ed5d472ac058 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:43.395670 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-948e374d-1f4d-4a40-917a-ed5d472ac058 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:43.396194 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-948e374d-1f4d-4a40-917a-ed5d472ac058 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:43.396677 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-948e374d-1f4d-4a40-917a-ed5d472ac058 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:43.605523 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-948e374d-1f4d-4a40-917a-ed5d472ac058 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:43.613877 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-948e374d-1f4d-4a40-917a-ed5d472ac058 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77" status: 200 len: 1680 microversion: 2.1 time: 0.230676 Sep 21 16:27:43.614501 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 259/600] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:43 2022] GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 => generated 1680 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:44.014875 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-df659e49-26e9-460f-a32d-b639a810c7ae req-03b4776d-3bd4-4131-9f05-3d93ebcef3f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72c89a30-cc9f-472e-9fa3-8ad2f7c36b77", "name": "network-vif-deleted", "tag": "be058d27-ec10-484e-9f81-e51deac36522"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:27:44.023234 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-a5ce44fb-5697-4399-b93b-afe2ca16c87d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:44.024765 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-a5ce44fb-5697-4399-b93b-afe2ca16c87d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:44.027569 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-df659e49-26e9-460f-a32d-b639a810c7ae req-03b4776d-3bd4-4131-9f05-3d93ebcef3f7 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:44.028311 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-df659e49-26e9-460f-a32d-b639a810c7ae req-03b4776d-3bd4-4131-9f05-3d93ebcef3f7 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:44.028822 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-df659e49-26e9-460f-a32d-b639a810c7ae req-03b4776d-3bd4-4131-9f05-3d93ebcef3f7 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:44.032658 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a5ce44fb-5697-4399-b93b-afe2ca16c87d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:44.033601 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a5ce44fb-5697-4399-b93b-afe2ca16c87d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:44.034534 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a5ce44fb-5697-4399-b93b-afe2ca16c87d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:44.036077 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a5ce44fb-5697-4399-b93b-afe2ca16c87d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:44.036828 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a5ce44fb-5697-4399-b93b-afe2ca16c87d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:44.037409 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a5ce44fb-5697-4399-b93b-afe2ca16c87d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:44.046940 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-df659e49-26e9-460f-a32d-b639a810c7ae req-03b4776d-3bd4-4131-9f05-3d93ebcef3f7 service nova] Creating event network-vif-deleted:be058d27-ec10-484e-9f81-e51deac36522 for instance 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 on hv-cinder-85862 Sep 21 16:27:44.052546 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-df659e49-26e9-460f-a32d-b639a810c7ae req-03b4776d-3bd4-4131-9f05-3d93ebcef3f7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042115 Sep 21 16:27:44.053510 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 342/601] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:27:44.220165 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-a5ce44fb-5697-4399-b93b-afe2ca16c87d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:44.229966 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-a5ce44fb-5697-4399-b93b-afe2ca16c87d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1756 microversion: 2.1 time: 0.210662 Sep 21 16:27:44.231466 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 260/602] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:44 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1756 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:27:44.316590 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-58dcbd26-0855-49b5-8570-28b1ffeb47c4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:44.317256 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-58dcbd26-0855-49b5-8570-28b1ffeb47c4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:44.328425 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-58dcbd26-0855-49b5-8570-28b1ffeb47c4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:44.329150 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-58dcbd26-0855-49b5-8570-28b1ffeb47c4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:44.329935 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-58dcbd26-0855-49b5-8570-28b1ffeb47c4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:44.330762 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-58dcbd26-0855-49b5-8570-28b1ffeb47c4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:44.331300 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-58dcbd26-0855-49b5-8570-28b1ffeb47c4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:44.331975 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-58dcbd26-0855-49b5-8570-28b1ffeb47c4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:44.478565 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-58dcbd26-0855-49b5-8570-28b1ffeb47c4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:44.487192 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-58dcbd26-0855-49b5-8570-28b1ffeb47c4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1735 microversion: 2.1 time: 0.174942 Sep 21 16:27:44.487783 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 343/603] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:44 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:44.643950 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-574a94b6-aeb5-4da8-852d-44b4da04e6d2 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:44.644700 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-574a94b6-aeb5-4da8-852d-44b4da04e6d2 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:44.650854 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-574a94b6-aeb5-4da8-852d-44b4da04e6d2 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:44.651336 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-574a94b6-aeb5-4da8-852d-44b4da04e6d2 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:44.651771 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-574a94b6-aeb5-4da8-852d-44b4da04e6d2 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:44.652502 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-574a94b6-aeb5-4da8-852d-44b4da04e6d2 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:44.652958 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-574a94b6-aeb5-4da8-852d-44b4da04e6d2 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:44.653373 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-574a94b6-aeb5-4da8-852d-44b4da04e6d2 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:44.686539 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-574a94b6-aeb5-4da8-852d-44b4da04e6d2 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:44.687018 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-574a94b6-aeb5-4da8-852d-44b4da04e6d2 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:44.687446 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-574a94b6-aeb5-4da8-852d-44b4da04e6d2 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:44.687882 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.objects.instance [None req-574a94b6-aeb5-4da8-852d-44b4da04e6d2 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lazy-loading 'fault' on Instance uuid 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 {{(pid=120531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 16:27:44.730820 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-574a94b6-aeb5-4da8-852d-44b4da04e6d2 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:44.738560 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-574a94b6-aeb5-4da8-852d-44b4da04e6d2 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77" status: 200 len: 1331 microversion: 2.1 time: 0.098410 Sep 21 16:27:44.739146 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 261/604] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:44 2022] GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:45.256076 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-af28ba17-fa83-4080-899f-661dcb05e75c tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:45.256594 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-af28ba17-fa83-4080-899f-661dcb05e75c tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:45.263253 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-af28ba17-fa83-4080-899f-661dcb05e75c tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:45.263731 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-af28ba17-fa83-4080-899f-661dcb05e75c tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:45.264162 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-af28ba17-fa83-4080-899f-661dcb05e75c tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:45.264838 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-af28ba17-fa83-4080-899f-661dcb05e75c tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:45.265290 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-af28ba17-fa83-4080-899f-661dcb05e75c tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:45.265702 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-af28ba17-fa83-4080-899f-661dcb05e75c tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:45.405904 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-af28ba17-fa83-4080-899f-661dcb05e75c tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:45.414370 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-af28ba17-fa83-4080-899f-661dcb05e75c tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1756 microversion: 2.1 time: 0.162210 Sep 21 16:27:45.414950 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 344/605] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:45 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:45.511105 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-e1c7754b-5c17-4bb2-b87b-2ca28fc16c1d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:45.511638 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-e1c7754b-5c17-4bb2-b87b-2ca28fc16c1d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:45.514008 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:27:45.519237 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e1c7754b-5c17-4bb2-b87b-2ca28fc16c1d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:45.519714 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e1c7754b-5c17-4bb2-b87b-2ca28fc16c1d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:45.520139 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e1c7754b-5c17-4bb2-b87b-2ca28fc16c1d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:45.520826 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e1c7754b-5c17-4bb2-b87b-2ca28fc16c1d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:45.521272 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e1c7754b-5c17-4bb2-b87b-2ca28fc16c1d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:45.521685 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e1c7754b-5c17-4bb2-b87b-2ca28fc16c1d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:45.650940 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-e1c7754b-5c17-4bb2-b87b-2ca28fc16c1d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:45.659467 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-e1c7754b-5c17-4bb2-b87b-2ca28fc16c1d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1735 microversion: 2.1 time: 0.152817 Sep 21 16:27:45.660038 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 262/606] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:45 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:45.761454 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-e20bbd5f-6266-40ed-b662-33776b150133 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:45.761988 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-e20bbd5f-6266-40ed-b662-33776b150133 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:45.767965 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e20bbd5f-6266-40ed-b662-33776b150133 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:45.768447 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e20bbd5f-6266-40ed-b662-33776b150133 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:45.768884 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e20bbd5f-6266-40ed-b662-33776b150133 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:45.769607 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e20bbd5f-6266-40ed-b662-33776b150133 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:45.770088 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e20bbd5f-6266-40ed-b662-33776b150133 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:45.770517 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e20bbd5f-6266-40ed-b662-33776b150133 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:45.784013 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.wsgi [None req-e20bbd5f-6266-40ed-b662-33776b150133 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] HTTP exception thrown: Instance 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 could not be found. Sep 21 16:27:45.785652 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-e20bbd5f-6266-40ed-b662-33776b150133 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Request method failure captured: Sep 21 16:27:45.785652 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: request: GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 HTTP/1.1 Sep 21 16:27:45.785652 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept: application/json Sep 21 16:27:45.785652 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept-Encoding: identity Sep 21 16:27:45.785652 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Connection: close Sep 21 16:27:45.785652 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Length: 0 Sep 21 16:27:45.785652 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Type: application/json Sep 21 16:27:45.785652 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Host: 10.222.0.64 Sep 21 16:27:45.785652 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Openstack-System-Scope: None Sep 21 16:27:45.785652 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: User-Agent: python-urllib3/1.26.12 Sep 21 16:27:45.785652 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Auth-Token: gAAAAABjKzptDl5Jwme7JQaRL3V8XsiXvjsgkfXKC5CR9zEf_XxPd1NsWodDna8_dBwDJyu9_lHil_M0vLPPzmX177kcKqWx5X8mqOmQSrRLHHx1LRIv3gdLEkJSUiwMVF6fR-kEaNic5IQ5zuSAZa0555zHli7HQ0zguOZ1COKKRN-ARxj0HyM Sep 21 16:27:45.785652 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Id: None Sep 21 16:27:45.785652 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Name: None Sep 21 16:27:45.785652 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Identity-Status: Confirmed Sep 21 16:27:45.785652 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Is-Admin-Project: True Sep 21 16:27:45.785652 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Id: default Sep 21 16:27:45.785652 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Name: Default Sep 21 16:27:45.785652 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Id: ce7a3e77ddf14b48986752434dda6d33 Sep 21 16:27:45.785652 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Name: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:27:45.785652 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Role: member,reader Sep 21 16:27:45.785652 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Roles: member,reader Sep 21 16:27:45.787202 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce7a3e77ddf14b48986752434dda6d33"}]}] Sep 21 16:27:45.787202 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:27:45.787202 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Id: ce7a3e77ddf14b48986752434dda6d33 Sep 21 16:27:45.787202 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:27:45.787202 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User: tempest-AttachVolumeNegativeTest-67026365-project Sep 21 16:27:45.787202 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Id: default Sep 21 16:27:45.787202 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Name: Default Sep 21 16:27:45.787202 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Id: b917d84a650f4355a676e315ea039f0e Sep 21 16:27:45.787202 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Name: tempest-AttachVolumeNegativeTest-67026365-project Sep 21 16:27:45.787202 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: method: > Sep 21 16:27:45.787202 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: exception: Instance 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 could not be found. Sep 21 16:27:45.787202 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: action_args: {'id': '72c89a30-cc9f-472e-9fa3-8ad2f7c36b77'} Sep 21 16:27:45.788031 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:27:45.788031 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:27:45.788031 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 16:27:45.788031 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 16:27:45.788031 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 16:27:45.788031 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 16:27:45.788031 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 16:27:45.788031 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 16:27:45.788031 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 16:27:45.788031 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 16:27:45.788031 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 could not be found. Sep 21 16:27:45.788031 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:27:45.788031 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:27:45.788031 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:27:45.788031 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:27:45.788031 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:27:45.788031 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:27:45.788031 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:27:45.788031 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:27:45.788031 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:27:45.789155 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:27:45.789155 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 16:27:45.789155 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 16:27:45.789155 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 16:27:45.789155 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 16:27:45.789155 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 16:27:45.789155 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:27:45.789155 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 could not be found. Sep 21 16:27:45.789155 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:27:45.789155 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:27:45.789155 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:27:45.789155 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:27:45.789155 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:27:45.789155 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:27:45.789155 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:27:45.789155 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:27:45.789155 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 could not be found. Sep 21 16:27:45.789155 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:27:45.791060 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-e20bbd5f-6266-40ed-b662-33776b150133 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Returning 404 to user: Instance 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 could not be found. {{(pid=120532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:27:45.791060 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-e20bbd5f-6266-40ed-b662-33776b150133 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77" status: 404 len: 111 microversion: 2.1 time: 0.029638 Sep 21 16:27:45.791060 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 345/607] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:45 2022] GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 16:27:45.796316 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-613f14ba-e71e-433b-b4af-8c2d389a6027 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '.version_select at 0x7fdb88b0aaf0>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:45.815590 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-613f14ba-e71e-433b-b4af-8c2d389a6027 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1792611049" status: 202 len: 0 microversion: 2.1 time: 0.022972 Sep 21 16:27:45.816163 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 263/608] 10.222.0.64 () {58 vars in 1221 bytes} [Wed Sep 21 16:27:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1792611049 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 16:27:46.438039 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-3423519e-2b8f-4843-84d5-4ef59525a88e tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:46.438686 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-3423519e-2b8f-4843-84d5-4ef59525a88e tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:46.445629 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3423519e-2b8f-4843-84d5-4ef59525a88e tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:46.447637 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3423519e-2b8f-4843-84d5-4ef59525a88e tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:46.447637 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3423519e-2b8f-4843-84d5-4ef59525a88e tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:46.447637 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3423519e-2b8f-4843-84d5-4ef59525a88e tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:46.448002 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3423519e-2b8f-4843-84d5-4ef59525a88e tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:46.448415 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3423519e-2b8f-4843-84d5-4ef59525a88e tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:46.454446 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-4ca8124e-18bd-4d8f-9bf1-d556f99e2532 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Action: 'create', calling method: .version_select at 0x7fdb88abe700>, body: {"keypair": {"name": "tempest-keypair-90004007", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEspl8CaM9jy/cgkYbnDdFzjZec5/b/Cl1hbdQ+BXO6gFf+eJ/OFlGrIbRdLnVD5xItP3hIdXmNjcM6vufbPEbK2iY/kci/8+RQ73lEtX9PrAESFHJvy8cd5ke5K+Vd3A=="}} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:27:46.474494 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.quota [None req-4ca8124e-18bd-4d8f-9bf1-d556f99e2532 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Getting quotas for project ce7a3e77ddf14b48986752434dda6d33. Resources: {'key_pairs'} {{(pid=120531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 16:27:46.478403 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.quota [None req-4ca8124e-18bd-4d8f-9bf1-d556f99e2532 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Getting quotas for user b917d84a650f4355a676e315ea039f0e and project ce7a3e77ddf14b48986752434dda6d33. Resources: {'key_pairs'} {{(pid=120531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 16:27:46.502483 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-4ca8124e-18bd-4d8f-9bf1-d556f99e2532 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.051672 Sep 21 16:27:46.503090 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 264/609] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Sep 21 16:27:46 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:27:46.598252 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-3423519e-2b8f-4843-84d5-4ef59525a88e tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:46.606777 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-3423519e-2b8f-4843-84d5-4ef59525a88e tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1756 microversion: 2.1 time: 0.172557 Sep 21 16:27:46.607355 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 346/610] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:46 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:46.684495 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-1d335cc3-cccc-46d2-b32e-0632aad48051 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:46.685103 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-1d335cc3-cccc-46d2-b32e-0632aad48051 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:46.691167 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1d335cc3-cccc-46d2-b32e-0632aad48051 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:46.691657 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1d335cc3-cccc-46d2-b32e-0632aad48051 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:46.692081 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1d335cc3-cccc-46d2-b32e-0632aad48051 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:46.692771 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1d335cc3-cccc-46d2-b32e-0632aad48051 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:46.693217 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1d335cc3-cccc-46d2-b32e-0632aad48051 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:46.693637 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1d335cc3-cccc-46d2-b32e-0632aad48051 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:46.832649 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-1d335cc3-cccc-46d2-b32e-0632aad48051 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:46.840938 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-1d335cc3-cccc-46d2-b32e-0632aad48051 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1735 microversion: 2.1 time: 0.161298 Sep 21 16:27:46.841509 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 265/611] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:46 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:47.629349 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c6b39cfa-3679-49f1-9492-fb483a8778f9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:47.629989 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-c6b39cfa-3679-49f1-9492-fb483a8778f9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:47.637093 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c6b39cfa-3679-49f1-9492-fb483a8778f9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:47.637575 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c6b39cfa-3679-49f1-9492-fb483a8778f9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:47.638007 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c6b39cfa-3679-49f1-9492-fb483a8778f9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:47.638729 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c6b39cfa-3679-49f1-9492-fb483a8778f9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:47.639181 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c6b39cfa-3679-49f1-9492-fb483a8778f9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:47.639600 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c6b39cfa-3679-49f1-9492-fb483a8778f9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:47.686832 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-9a82e7c5-d489-409c-96f5-d243f11899fe tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2081187892", "imageRef": "600db436-ed6c-41b7-89f7-7dd31852a1a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8e8cfcce-7266-4377-accc-1ed5295280a6"}], "security_groups": [{"name": "tempest-securitygroup--1042476943"}], "key_name": "tempest-keypair-90004007", "user_data": "}} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:27:47.782830 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-c6b39cfa-3679-49f1-9492-fb483a8778f9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:47.789465 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.network.neutron [None req-9a82e7c5-d489-409c-96f5-d243f11899fe tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] validate_networks() for [('8e8cfcce-7266-4377-accc-1ed5295280a6', None, None, None, None, None)] {{(pid=120531) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 16:27:47.791463 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-c6b39cfa-3679-49f1-9492-fb483a8778f9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1756 microversion: 2.1 time: 0.165997 Sep 21 16:27:47.792079 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 347/612] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:47 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:47.864867 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c674078e-2f48-4ef5-9270-8eab1d271f75 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:47.865478 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-c674078e-2f48-4ef5-9270-8eab1d271f75 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:47.873234 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c674078e-2f48-4ef5-9270-8eab1d271f75 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:47.873720 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c674078e-2f48-4ef5-9270-8eab1d271f75 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:47.874187 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c674078e-2f48-4ef5-9270-8eab1d271f75 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:47.874892 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c674078e-2f48-4ef5-9270-8eab1d271f75 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:47.875561 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c674078e-2f48-4ef5-9270-8eab1d271f75 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:47.876407 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c674078e-2f48-4ef5-9270-8eab1d271f75 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:48.022893 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-c674078e-2f48-4ef5-9270-8eab1d271f75 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:48.032825 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-c674078e-2f48-4ef5-9270-8eab1d271f75 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1735 microversion: 2.1 time: 0.171795 Sep 21 16:27:48.033344 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 348/613] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:47 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:27:48.410353 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-9a82e7c5-d489-409c-96f5-d243f11899fe tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Flavor limits 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 16:27:48.410777 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-9a82e7c5-d489-409c-96f5-d243f11899fe tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Image limits 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 16:27:48.411255 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-9a82e7c5-d489-409c-96f5-d243f11899fe tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Flavor pref 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 16:27:48.411668 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-9a82e7c5-d489-409c-96f5-d243f11899fe tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Image pref 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 16:27:48.412106 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-9a82e7c5-d489-409c-96f5-d243f11899fe tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 16:27:48.421772 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9a82e7c5-d489-409c-96f5-d243f11899fe tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:48.422297 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9a82e7c5-d489-409c-96f5-d243f11899fe tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:48.422738 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9a82e7c5-d489-409c-96f5-d243f11899fe tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:48.423478 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9a82e7c5-d489-409c-96f5-d243f11899fe tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:48.423939 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9a82e7c5-d489-409c-96f5-d243f11899fe tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:48.424437 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9a82e7c5-d489-409c-96f5-d243f11899fe tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:48.441675 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.quota [None req-9a82e7c5-d489-409c-96f5-d243f11899fe tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Getting quotas for project ce7a3e77ddf14b48986752434dda6d33. Resources: {'cores', 'ram', 'instances'} {{(pid=120531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 16:27:48.445651 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.quota [None req-9a82e7c5-d489-409c-96f5-d243f11899fe tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Getting quotas for user b917d84a650f4355a676e315ea039f0e and project ce7a3e77ddf14b48986752434dda6d33. Resources: {'cores', 'ram', 'instances'} {{(pid=120531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 16:27:48.456688 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-9a82e7c5-d489-409c-96f5-d243f11899fe tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Going to run 1 instances... {{(pid=120531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 16:27:48.459022 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-9a82e7c5-d489-409c-96f5-d243f11899fe tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 608e4231-8635-45db-b2d6-6b0710c3120f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='600db436-ed6c-41b7-89f7-7dd31852a1a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 16:27:48.505676 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-9a82e7c5-d489-409c-96f5-d243f11899fe tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.823126 Sep 21 16:27:48.506586 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 266/614] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Sep 21 16:27:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 21 16:27:48.517747 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-0979fbe7-307d-4b3f-a711-0c242ddc4b78 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:48.518477 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-0979fbe7-307d-4b3f-a711-0c242ddc4b78 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 608e4231-8635-45db-b2d6-6b0710c3120f] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:48.572887 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-0979fbe7-307d-4b3f-a711-0c242ddc4b78 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:48.580037 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-0979fbe7-307d-4b3f-a711-0c242ddc4b78 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f" status: 200 len: 1240 microversion: 2.1 time: 0.066210 Sep 21 16:27:48.580608 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 349/615] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:48 2022] GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f => generated 1240 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:27:48.815940 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-00b80a4a-3dff-41e2-83f9-01ab0b80f89d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:48.816555 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-00b80a4a-3dff-41e2-83f9-01ab0b80f89d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:48.823903 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-00b80a4a-3dff-41e2-83f9-01ab0b80f89d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:48.824315 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-00b80a4a-3dff-41e2-83f9-01ab0b80f89d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:48.824740 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-00b80a4a-3dff-41e2-83f9-01ab0b80f89d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:48.825435 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-00b80a4a-3dff-41e2-83f9-01ab0b80f89d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:48.825880 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-00b80a4a-3dff-41e2-83f9-01ab0b80f89d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:48.826509 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-00b80a4a-3dff-41e2-83f9-01ab0b80f89d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:48.976047 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-00b80a4a-3dff-41e2-83f9-01ab0b80f89d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:48.986071 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-00b80a4a-3dff-41e2-83f9-01ab0b80f89d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1756 microversion: 2.1 time: 0.174480 Sep 21 16:27:48.986660 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 267/616] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:48 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:49.062517 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-11860ab9-b7ee-4590-8453-9b7eed31913f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:49.063118 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-11860ab9-b7ee-4590-8453-9b7eed31913f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:49.069708 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-11860ab9-b7ee-4590-8453-9b7eed31913f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:49.070239 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-11860ab9-b7ee-4590-8453-9b7eed31913f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:49.070682 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-11860ab9-b7ee-4590-8453-9b7eed31913f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:49.071977 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-11860ab9-b7ee-4590-8453-9b7eed31913f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:49.072437 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-11860ab9-b7ee-4590-8453-9b7eed31913f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:49.072870 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-11860ab9-b7ee-4590-8453-9b7eed31913f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:49.212795 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-11860ab9-b7ee-4590-8453-9b7eed31913f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:49.221157 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-11860ab9-b7ee-4590-8453-9b7eed31913f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1735 microversion: 2.1 time: 0.162528 Sep 21 16:27:49.221732 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 350/617] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:49 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:49.603239 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-3f6bc3ec-e46e-4100-8563-9454bcb37035 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:49.603842 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-3f6bc3ec-e46e-4100-8563-9454bcb37035 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 608e4231-8635-45db-b2d6-6b0710c3120f] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:49.609678 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3f6bc3ec-e46e-4100-8563-9454bcb37035 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:49.610191 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3f6bc3ec-e46e-4100-8563-9454bcb37035 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:49.610617 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3f6bc3ec-e46e-4100-8563-9454bcb37035 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:49.611294 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3f6bc3ec-e46e-4100-8563-9454bcb37035 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:49.611738 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3f6bc3ec-e46e-4100-8563-9454bcb37035 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:49.612151 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3f6bc3ec-e46e-4100-8563-9454bcb37035 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:49.672547 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-3f6bc3ec-e46e-4100-8563-9454bcb37035 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:49.679996 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-3f6bc3ec-e46e-4100-8563-9454bcb37035 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f" status: 200 len: 1292 microversion: 2.1 time: 0.080661 Sep 21 16:27:49.681076 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 268/618] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:49 2022] GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f => generated 1292 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:50.010898 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-277e32c1-3192-4fc4-9dad-2655d52d14e9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:50.011537 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-277e32c1-3192-4fc4-9dad-2655d52d14e9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:50.017726 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-277e32c1-3192-4fc4-9dad-2655d52d14e9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:50.018372 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-277e32c1-3192-4fc4-9dad-2655d52d14e9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:50.018813 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-277e32c1-3192-4fc4-9dad-2655d52d14e9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:50.019507 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-277e32c1-3192-4fc4-9dad-2655d52d14e9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:50.019965 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-277e32c1-3192-4fc4-9dad-2655d52d14e9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:50.020386 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-277e32c1-3192-4fc4-9dad-2655d52d14e9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:50.161721 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-277e32c1-3192-4fc4-9dad-2655d52d14e9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:50.170141 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-277e32c1-3192-4fc4-9dad-2655d52d14e9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1756 microversion: 2.1 time: 0.163067 Sep 21 16:27:50.170788 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 351/619] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:50 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:27:50.244176 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-3c68a8ef-cd41-4653-bf72-bace5a436903 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:50.244769 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-3c68a8ef-cd41-4653-bf72-bace5a436903 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:50.251260 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3c68a8ef-cd41-4653-bf72-bace5a436903 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:50.251746 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3c68a8ef-cd41-4653-bf72-bace5a436903 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:50.252181 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3c68a8ef-cd41-4653-bf72-bace5a436903 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:50.252881 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3c68a8ef-cd41-4653-bf72-bace5a436903 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:50.253336 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3c68a8ef-cd41-4653-bf72-bace5a436903 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:50.253758 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3c68a8ef-cd41-4653-bf72-bace5a436903 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:50.447173 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-3c68a8ef-cd41-4653-bf72-bace5a436903 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:50.450695 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:27:50.457064 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-3c68a8ef-cd41-4653-bf72-bace5a436903 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1735 microversion: 2.1 time: 0.216661 Sep 21 16:27:50.457578 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 269/620] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:50 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1735 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:50.703691 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ab3279f3-f6bf-4e32-90ea-a46b7fb4c0bb tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:50.704304 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ab3279f3-f6bf-4e32-90ea-a46b7fb4c0bb tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 608e4231-8635-45db-b2d6-6b0710c3120f] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:50.710577 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ab3279f3-f6bf-4e32-90ea-a46b7fb4c0bb tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:50.711064 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ab3279f3-f6bf-4e32-90ea-a46b7fb4c0bb tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:50.711559 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ab3279f3-f6bf-4e32-90ea-a46b7fb4c0bb tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:50.712272 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ab3279f3-f6bf-4e32-90ea-a46b7fb4c0bb tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:50.712730 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ab3279f3-f6bf-4e32-90ea-a46b7fb4c0bb tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:50.713152 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ab3279f3-f6bf-4e32-90ea-a46b7fb4c0bb tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:50.854403 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ab3279f3-f6bf-4e32-90ea-a46b7fb4c0bb tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:50.862249 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ab3279f3-f6bf-4e32-90ea-a46b7fb4c0bb tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f" status: 200 len: 1366 microversion: 2.1 time: 0.162531 Sep 21 16:27:50.862979 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 352/621] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:50 2022] GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:51.193473 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-7dd83e0a-e0e4-4ab4-a6f9-542d16b6e1ff tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:51.194101 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-7dd83e0a-e0e4-4ab4-a6f9-542d16b6e1ff tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:51.200489 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7dd83e0a-e0e4-4ab4-a6f9-542d16b6e1ff tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:51.200986 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7dd83e0a-e0e4-4ab4-a6f9-542d16b6e1ff tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:51.201504 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7dd83e0a-e0e4-4ab4-a6f9-542d16b6e1ff tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:51.202235 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7dd83e0a-e0e4-4ab4-a6f9-542d16b6e1ff tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:51.202688 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7dd83e0a-e0e4-4ab4-a6f9-542d16b6e1ff tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:51.203104 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7dd83e0a-e0e4-4ab4-a6f9-542d16b6e1ff tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:51.428719 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-7dd83e0a-e0e4-4ab4-a6f9-542d16b6e1ff tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:51.437723 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-7dd83e0a-e0e4-4ab4-a6f9-542d16b6e1ff tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1756 microversion: 2.1 time: 0.248642 Sep 21 16:27:51.438493 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 270/622] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:51 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1756 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:51.481244 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-b6b0ae14-c142-441d-b10a-720a80512271 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:51.481916 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-b6b0ae14-c142-441d-b10a-720a80512271 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:51.488899 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b6b0ae14-c142-441d-b10a-720a80512271 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:51.489511 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b6b0ae14-c142-441d-b10a-720a80512271 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:51.490108 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b6b0ae14-c142-441d-b10a-720a80512271 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:51.490922 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b6b0ae14-c142-441d-b10a-720a80512271 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:51.491440 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b6b0ae14-c142-441d-b10a-720a80512271 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:51.491854 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b6b0ae14-c142-441d-b10a-720a80512271 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:51.514677 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-dd24d36e-a78d-4f99-b11b-fc3c87aef29d req-6088337d-ae8f-4200-807f-eed69615bced service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "608e4231-8635-45db-b2d6-6b0710c3120f", "tag": "8eb105fe-8645-41dc-876d-e301557328f9"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:27:51.529746 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-dd24d36e-a78d-4f99-b11b-fc3c87aef29d req-6088337d-ae8f-4200-807f-eed69615bced service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:51.530269 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-dd24d36e-a78d-4f99-b11b-fc3c87aef29d req-6088337d-ae8f-4200-807f-eed69615bced service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:51.530702 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-dd24d36e-a78d-4f99-b11b-fc3c87aef29d req-6088337d-ae8f-4200-807f-eed69615bced service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:51.543575 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-dd24d36e-a78d-4f99-b11b-fc3c87aef29d req-6088337d-ae8f-4200-807f-eed69615bced service nova] Creating event network-changed:8eb105fe-8645-41dc-876d-e301557328f9 for instance 608e4231-8635-45db-b2d6-6b0710c3120f on hv-cinder-85862 Sep 21 16:27:51.548802 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-dd24d36e-a78d-4f99-b11b-fc3c87aef29d req-6088337d-ae8f-4200-807f-eed69615bced service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040926 Sep 21 16:27:51.549809 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 271/623] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:27:51.644284 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-b6b0ae14-c142-441d-b10a-720a80512271 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:51.653419 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-b6b0ae14-c142-441d-b10a-720a80512271 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1735 microversion: 2.1 time: 0.176589 Sep 21 16:27:51.653992 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 353/624] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:51 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:51.887924 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-71950665-6021-4df6-9480-367ef647989e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:51.888624 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-71950665-6021-4df6-9480-367ef647989e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 608e4231-8635-45db-b2d6-6b0710c3120f] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:51.894969 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-71950665-6021-4df6-9480-367ef647989e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:51.895382 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-71950665-6021-4df6-9480-367ef647989e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:51.895815 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-71950665-6021-4df6-9480-367ef647989e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:51.896508 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-71950665-6021-4df6-9480-367ef647989e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:51.896964 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-71950665-6021-4df6-9480-367ef647989e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:51.897387 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-71950665-6021-4df6-9480-367ef647989e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:52.181900 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-71950665-6021-4df6-9480-367ef647989e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:52.189570 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-71950665-6021-4df6-9480-367ef647989e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f" status: 200 len: 1366 microversion: 2.1 time: 0.306342 Sep 21 16:27:52.190160 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 272/625] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:51 2022] GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f => generated 1366 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:52.466639 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-542ab58e-944b-4a0d-973a-6ba607cf0381 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:52.467163 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-542ab58e-944b-4a0d-973a-6ba607cf0381 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:52.473112 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-542ab58e-944b-4a0d-973a-6ba607cf0381 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:52.473591 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-542ab58e-944b-4a0d-973a-6ba607cf0381 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:52.474019 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-542ab58e-944b-4a0d-973a-6ba607cf0381 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:52.474726 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-542ab58e-944b-4a0d-973a-6ba607cf0381 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:52.475180 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-542ab58e-944b-4a0d-973a-6ba607cf0381 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:52.475607 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-542ab58e-944b-4a0d-973a-6ba607cf0381 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:52.676548 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-06c27720-0f22-4e81-af9e-cfb6a7423c6a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:52.677195 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-06c27720-0f22-4e81-af9e-cfb6a7423c6a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:52.677514 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-542ab58e-944b-4a0d-973a-6ba607cf0381 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:52.684334 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-06c27720-0f22-4e81-af9e-cfb6a7423c6a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:52.684825 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-06c27720-0f22-4e81-af9e-cfb6a7423c6a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:52.685262 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-06c27720-0f22-4e81-af9e-cfb6a7423c6a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:52.685962 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-06c27720-0f22-4e81-af9e-cfb6a7423c6a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:52.686442 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-06c27720-0f22-4e81-af9e-cfb6a7423c6a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:52.686574 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-542ab58e-944b-4a0d-973a-6ba607cf0381 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1756 microversion: 2.1 time: 0.223830 Sep 21 16:27:52.686863 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-06c27720-0f22-4e81-af9e-cfb6a7423c6a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:52.698067 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 354/626] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:52 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1756 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:52.820560 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-06c27720-0f22-4e81-af9e-cfb6a7423c6a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:52.828663 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-06c27720-0f22-4e81-af9e-cfb6a7423c6a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1735 microversion: 2.1 time: 0.156061 Sep 21 16:27:52.829233 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 273/627] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:52 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:27:53.213313 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-cdf32f62-9c1a-4d63-90e3-370fc55cbcbe tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:53.213914 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-cdf32f62-9c1a-4d63-90e3-370fc55cbcbe tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 608e4231-8635-45db-b2d6-6b0710c3120f] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:53.219853 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cdf32f62-9c1a-4d63-90e3-370fc55cbcbe tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:53.220326 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cdf32f62-9c1a-4d63-90e3-370fc55cbcbe tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:53.220753 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cdf32f62-9c1a-4d63-90e3-370fc55cbcbe tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:53.221437 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cdf32f62-9c1a-4d63-90e3-370fc55cbcbe tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:53.221889 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cdf32f62-9c1a-4d63-90e3-370fc55cbcbe tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:53.222906 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cdf32f62-9c1a-4d63-90e3-370fc55cbcbe tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:53.369894 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-cdf32f62-9c1a-4d63-90e3-370fc55cbcbe tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:53.372290 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:27:53.379939 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-cdf32f62-9c1a-4d63-90e3-370fc55cbcbe tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f" status: 200 len: 1366 microversion: 2.1 time: 0.171056 Sep 21 16:27:53.380519 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 355/628] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:53 2022] GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:53.709610 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-cfb9eac6-23fc-4a81-b30c-70a0b84dcd01 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:53.710250 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-cfb9eac6-23fc-4a81-b30c-70a0b84dcd01 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:53.716630 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cfb9eac6-23fc-4a81-b30c-70a0b84dcd01 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:53.717112 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cfb9eac6-23fc-4a81-b30c-70a0b84dcd01 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:53.717537 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cfb9eac6-23fc-4a81-b30c-70a0b84dcd01 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:53.718265 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cfb9eac6-23fc-4a81-b30c-70a0b84dcd01 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:53.718712 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cfb9eac6-23fc-4a81-b30c-70a0b84dcd01 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:53.719126 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cfb9eac6-23fc-4a81-b30c-70a0b84dcd01 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:53.852659 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-2be6bde0-eb42-4b43-9085-1146e1763813 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:53.853268 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-2be6bde0-eb42-4b43-9085-1146e1763813 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:53.860374 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-cfb9eac6-23fc-4a81-b30c-70a0b84dcd01 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:53.860555 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2be6bde0-eb42-4b43-9085-1146e1763813 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:53.860926 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2be6bde0-eb42-4b43-9085-1146e1763813 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:53.861357 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2be6bde0-eb42-4b43-9085-1146e1763813 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:53.862073 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2be6bde0-eb42-4b43-9085-1146e1763813 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:53.862535 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2be6bde0-eb42-4b43-9085-1146e1763813 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:53.862958 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2be6bde0-eb42-4b43-9085-1146e1763813 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:53.869199 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-cfb9eac6-23fc-4a81-b30c-70a0b84dcd01 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1756 microversion: 2.1 time: 0.163390 Sep 21 16:27:53.869775 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 274/629] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:53 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:53.988509 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-2be6bde0-eb42-4b43-9085-1146e1763813 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:53.997245 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-2be6bde0-eb42-4b43-9085-1146e1763813 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1735 microversion: 2.1 time: 0.149293 Sep 21 16:27:53.997855 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 356/630] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:53 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:27:54.404572 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-5c7f6b49-dd2b-40ad-9b73-947866eb328c tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:54.405180 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-5c7f6b49-dd2b-40ad-9b73-947866eb328c tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 608e4231-8635-45db-b2d6-6b0710c3120f] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:54.411230 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5c7f6b49-dd2b-40ad-9b73-947866eb328c tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:54.411742 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5c7f6b49-dd2b-40ad-9b73-947866eb328c tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:54.412172 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5c7f6b49-dd2b-40ad-9b73-947866eb328c tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:54.412861 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5c7f6b49-dd2b-40ad-9b73-947866eb328c tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:54.413311 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5c7f6b49-dd2b-40ad-9b73-947866eb328c tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:54.413729 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5c7f6b49-dd2b-40ad-9b73-947866eb328c tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:54.548852 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-5c7f6b49-dd2b-40ad-9b73-947866eb328c tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:54.556541 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-5c7f6b49-dd2b-40ad-9b73-947866eb328c tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f" status: 200 len: 1366 microversion: 2.1 time: 0.155853 Sep 21 16:27:54.557106 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 275/631] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:54 2022] GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:54.892605 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-bb764504-0384-4e21-8f2f-74858c30f4f2 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:54.893202 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-bb764504-0384-4e21-8f2f-74858c30f4f2 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:54.900608 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb764504-0384-4e21-8f2f-74858c30f4f2 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:54.901090 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb764504-0384-4e21-8f2f-74858c30f4f2 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:54.901546 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb764504-0384-4e21-8f2f-74858c30f4f2 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:54.902271 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb764504-0384-4e21-8f2f-74858c30f4f2 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:54.902916 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb764504-0384-4e21-8f2f-74858c30f4f2 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:54.903335 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb764504-0384-4e21-8f2f-74858c30f4f2 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:55.020124 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-b3e9b71f-8830-4424-9898-9d8b4ca30faf tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:55.020789 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-b3e9b71f-8830-4424-9898-9d8b4ca30faf tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:55.027833 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b3e9b71f-8830-4424-9898-9d8b4ca30faf tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:55.028333 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b3e9b71f-8830-4424-9898-9d8b4ca30faf tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:55.028769 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b3e9b71f-8830-4424-9898-9d8b4ca30faf tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:55.029480 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b3e9b71f-8830-4424-9898-9d8b4ca30faf tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:55.029935 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b3e9b71f-8830-4424-9898-9d8b4ca30faf tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:55.030389 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b3e9b71f-8830-4424-9898-9d8b4ca30faf tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:55.046723 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-bb764504-0384-4e21-8f2f-74858c30f4f2 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:55.055597 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-bb764504-0384-4e21-8f2f-74858c30f4f2 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1756 microversion: 2.1 time: 0.166863 Sep 21 16:27:55.056203 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 357/632] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:54 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:55.160382 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-b3e9b71f-8830-4424-9898-9d8b4ca30faf tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:55.168507 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-b3e9b71f-8830-4424-9898-9d8b4ca30faf tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1735 microversion: 2.1 time: 0.152297 Sep 21 16:27:55.169084 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 276/633] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:55 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:27:55.579934 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-a65cf9bf-be5b-401a-9a43-fcdab656c299 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:55.580437 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-a65cf9bf-be5b-401a-9a43-fcdab656c299 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 608e4231-8635-45db-b2d6-6b0710c3120f] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:55.586411 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a65cf9bf-be5b-401a-9a43-fcdab656c299 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:55.586884 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a65cf9bf-be5b-401a-9a43-fcdab656c299 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:55.587313 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a65cf9bf-be5b-401a-9a43-fcdab656c299 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:55.587991 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a65cf9bf-be5b-401a-9a43-fcdab656c299 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:55.588442 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a65cf9bf-be5b-401a-9a43-fcdab656c299 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:55.588854 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a65cf9bf-be5b-401a-9a43-fcdab656c299 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:55.714281 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a65cf9bf-be5b-401a-9a43-fcdab656c299 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:55.721786 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-a65cf9bf-be5b-401a-9a43-fcdab656c299 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f" status: 200 len: 1366 microversion: 2.1 time: 0.145775 Sep 21 16:27:55.722386 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 358/634] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:55 2022] GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:56.079688 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-38520c05-7f60-4cfe-b4eb-a382975b4c98 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:56.080295 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-38520c05-7f60-4cfe-b4eb-a382975b4c98 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:56.087390 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-38520c05-7f60-4cfe-b4eb-a382975b4c98 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:56.087884 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-38520c05-7f60-4cfe-b4eb-a382975b4c98 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:56.088326 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-38520c05-7f60-4cfe-b4eb-a382975b4c98 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:56.089040 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-38520c05-7f60-4cfe-b4eb-a382975b4c98 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:56.089490 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-38520c05-7f60-4cfe-b4eb-a382975b4c98 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:56.089912 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-38520c05-7f60-4cfe-b4eb-a382975b4c98 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:56.191721 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-a8ebbfdc-f9ad-4f68-b85d-b6af9ca08e27 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:56.192332 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-a8ebbfdc-f9ad-4f68-b85d-b6af9ca08e27 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:56.199506 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a8ebbfdc-f9ad-4f68-b85d-b6af9ca08e27 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:56.200000 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a8ebbfdc-f9ad-4f68-b85d-b6af9ca08e27 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:56.200434 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a8ebbfdc-f9ad-4f68-b85d-b6af9ca08e27 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:56.201132 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a8ebbfdc-f9ad-4f68-b85d-b6af9ca08e27 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:56.201585 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a8ebbfdc-f9ad-4f68-b85d-b6af9ca08e27 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:56.202007 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a8ebbfdc-f9ad-4f68-b85d-b6af9ca08e27 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:56.245866 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-38520c05-7f60-4cfe-b4eb-a382975b4c98 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:56.254279 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-38520c05-7f60-4cfe-b4eb-a382975b4c98 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1756 microversion: 2.1 time: 0.178352 Sep 21 16:27:56.255066 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 277/635] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:56 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:56.330331 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a8ebbfdc-f9ad-4f68-b85d-b6af9ca08e27 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:56.339057 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-a8ebbfdc-f9ad-4f68-b85d-b6af9ca08e27 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1735 microversion: 2.1 time: 0.151324 Sep 21 16:27:56.339624 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 359/636] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:56 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:27:56.744701 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-a5ca7b8d-ab4d-44c9-bbb5-498fcf77758b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:56.745304 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-a5ca7b8d-ab4d-44c9-bbb5-498fcf77758b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 608e4231-8635-45db-b2d6-6b0710c3120f] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:56.751306 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a5ca7b8d-ab4d-44c9-bbb5-498fcf77758b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:56.751781 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a5ca7b8d-ab4d-44c9-bbb5-498fcf77758b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:56.752208 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a5ca7b8d-ab4d-44c9-bbb5-498fcf77758b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:56.752883 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a5ca7b8d-ab4d-44c9-bbb5-498fcf77758b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:56.753329 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a5ca7b8d-ab4d-44c9-bbb5-498fcf77758b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:56.753742 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a5ca7b8d-ab4d-44c9-bbb5-498fcf77758b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:56.883409 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-a5ca7b8d-ab4d-44c9-bbb5-498fcf77758b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:56.891093 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-a5ca7b8d-ab4d-44c9-bbb5-498fcf77758b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f" status: 200 len: 1366 microversion: 2.1 time: 0.150211 Sep 21 16:27:56.891671 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 278/637] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:56 2022] GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:57.277933 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-1f703ce7-2163-4795-b145-117de417c5d2 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:57.278823 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-1f703ce7-2163-4795-b145-117de417c5d2 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:57.285176 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1f703ce7-2163-4795-b145-117de417c5d2 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:57.285662 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1f703ce7-2163-4795-b145-117de417c5d2 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:57.286119 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1f703ce7-2163-4795-b145-117de417c5d2 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:57.286812 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1f703ce7-2163-4795-b145-117de417c5d2 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:57.287270 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1f703ce7-2163-4795-b145-117de417c5d2 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:57.287693 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1f703ce7-2163-4795-b145-117de417c5d2 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:57.318555 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-92b72405-bd94-4557-8a68-273dbeeaa737 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:57.321461 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-92b72405-bd94-4557-8a68-273dbeeaa737 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:57.328316 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-92b72405-bd94-4557-8a68-273dbeeaa737 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:57.328809 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-92b72405-bd94-4557-8a68-273dbeeaa737 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:57.329248 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-92b72405-bd94-4557-8a68-273dbeeaa737 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:57.329970 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-92b72405-bd94-4557-8a68-273dbeeaa737 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:57.330450 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-92b72405-bd94-4557-8a68-273dbeeaa737 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:57.330870 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-92b72405-bd94-4557-8a68-273dbeeaa737 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:57.362864 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-92b72405-bd94-4557-8a68-273dbeeaa737 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048079 Sep 21 16:27:57.363447 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 279/638] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Sep 21 16:27:57 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 21 16:27:57.368521 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-dd1ff4b6-cb16-4a6f-bcbd-21bdece3e6f3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:57.369304 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-dd1ff4b6-cb16-4a6f-bcbd-21bdece3e6f3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:57.377406 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dd1ff4b6-cb16-4a6f-bcbd-21bdece3e6f3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:57.378287 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dd1ff4b6-cb16-4a6f-bcbd-21bdece3e6f3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:57.378942 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dd1ff4b6-cb16-4a6f-bcbd-21bdece3e6f3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:57.379662 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dd1ff4b6-cb16-4a6f-bcbd-21bdece3e6f3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:57.380119 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dd1ff4b6-cb16-4a6f-bcbd-21bdece3e6f3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:57.380545 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dd1ff4b6-cb16-4a6f-bcbd-21bdece3e6f3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:57.442901 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-1f703ce7-2163-4795-b145-117de417c5d2 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:57.452311 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-1f703ce7-2163-4795-b145-117de417c5d2 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1756 microversion: 2.1 time: 0.178126 Sep 21 16:27:57.452892 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 360/639] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:57 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:57.457689 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-027a81c8-bb8c-4506-893c-9aa228a45223 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:57.458226 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-027a81c8-bb8c-4506-893c-9aa228a45223 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:57.464196 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-027a81c8-bb8c-4506-893c-9aa228a45223 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:57.464684 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-027a81c8-bb8c-4506-893c-9aa228a45223 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:57.465294 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-027a81c8-bb8c-4506-893c-9aa228a45223 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:57.465805 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-027a81c8-bb8c-4506-893c-9aa228a45223 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:57.466394 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-027a81c8-bb8c-4506-893c-9aa228a45223 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:57.466706 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-027a81c8-bb8c-4506-893c-9aa228a45223 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:57.492524 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-027a81c8-bb8c-4506-893c-9aa228a45223 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Going to try to terminate instance {{(pid=120532) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 16:27:57.519545 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-dd1ff4b6-cb16-4a6f-bcbd-21bdece3e6f3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:57.527885 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-dd1ff4b6-cb16-4a6f-bcbd-21bdece3e6f3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1735 microversion: 2.1 time: 0.163486 Sep 21 16:27:57.528454 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 280/640] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:57 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:57.572744 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-027a81c8-bb8c-4506-893c-9aa228a45223 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "DELETE /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 204 len: 0 microversion: 2.1 time: 0.118219 Sep 21 16:27:57.573539 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 361/641] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Sep 21 16:27:57 2022] DELETE /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 21 16:27:57.582274 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-f4d55cc1-5b7e-4388-8cb0-1b728a832870 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:57.582944 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-f4d55cc1-5b7e-4388-8cb0-1b728a832870 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:57.588928 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f4d55cc1-5b7e-4388-8cb0-1b728a832870 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:57.589409 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f4d55cc1-5b7e-4388-8cb0-1b728a832870 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:57.589843 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f4d55cc1-5b7e-4388-8cb0-1b728a832870 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:57.590564 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f4d55cc1-5b7e-4388-8cb0-1b728a832870 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:57.591013 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f4d55cc1-5b7e-4388-8cb0-1b728a832870 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:57.591432 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f4d55cc1-5b7e-4388-8cb0-1b728a832870 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:57.720985 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-f4d55cc1-5b7e-4388-8cb0-1b728a832870 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:57.729192 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-f4d55cc1-5b7e-4388-8cb0-1b728a832870 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1674 microversion: 2.1 time: 0.150880 Sep 21 16:27:57.729751 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 281/642] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:57 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:57.915349 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c9b3c31e-1220-411a-b11e-6ddd4f8e1b97 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:57.916041 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-c9b3c31e-1220-411a-b11e-6ddd4f8e1b97 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 608e4231-8635-45db-b2d6-6b0710c3120f] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:57.921981 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c9b3c31e-1220-411a-b11e-6ddd4f8e1b97 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:57.922487 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c9b3c31e-1220-411a-b11e-6ddd4f8e1b97 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:57.922918 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c9b3c31e-1220-411a-b11e-6ddd4f8e1b97 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:57.923590 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c9b3c31e-1220-411a-b11e-6ddd4f8e1b97 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:57.924038 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c9b3c31e-1220-411a-b11e-6ddd4f8e1b97 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:57.924456 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c9b3c31e-1220-411a-b11e-6ddd4f8e1b97 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:58.053050 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-c9b3c31e-1220-411a-b11e-6ddd4f8e1b97 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:58.061241 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-c9b3c31e-1220-411a-b11e-6ddd4f8e1b97 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f" status: 200 len: 1366 microversion: 2.1 time: 0.150089 Sep 21 16:27:58.061985 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 362/643] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:57 2022] GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:58.139803 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-6b9bc554-e41e-438f-bbb2-8deeebe22154 req-95183f44-e936-480e-a41f-0ee39ddcb524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "608e4231-8635-45db-b2d6-6b0710c3120f", "name": "network-vif-plugged", "status": "completed", "tag": "8eb105fe-8645-41dc-876d-e301557328f9"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:27:58.149685 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-6b9bc554-e41e-438f-bbb2-8deeebe22154 req-95183f44-e936-480e-a41f-0ee39ddcb524 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:58.150181 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-6b9bc554-e41e-438f-bbb2-8deeebe22154 req-95183f44-e936-480e-a41f-0ee39ddcb524 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:58.150608 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-6b9bc554-e41e-438f-bbb2-8deeebe22154 req-95183f44-e936-480e-a41f-0ee39ddcb524 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:58.162811 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-6b9bc554-e41e-438f-bbb2-8deeebe22154 req-95183f44-e936-480e-a41f-0ee39ddcb524 service nova] Creating event network-vif-plugged:8eb105fe-8645-41dc-876d-e301557328f9 for instance 608e4231-8635-45db-b2d6-6b0710c3120f on hv-cinder-85862 Sep 21 16:27:58.168072 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-6b9bc554-e41e-438f-bbb2-8deeebe22154 req-95183f44-e936-480e-a41f-0ee39ddcb524 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031903 Sep 21 16:27:58.168585 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 282/644] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:27:58.183984 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-e45a63f4-8f1a-4bfb-b48b-bcf14464517c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:58.184544 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-e45a63f4-8f1a-4bfb-b48b-bcf14464517c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:58.190481 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e45a63f4-8f1a-4bfb-b48b-bcf14464517c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:58.190975 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e45a63f4-8f1a-4bfb-b48b-bcf14464517c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:58.191403 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e45a63f4-8f1a-4bfb-b48b-bcf14464517c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:58.192092 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e45a63f4-8f1a-4bfb-b48b-bcf14464517c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:58.192545 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e45a63f4-8f1a-4bfb-b48b-bcf14464517c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:58.192993 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e45a63f4-8f1a-4bfb-b48b-bcf14464517c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:58.225519 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-e45a63f4-8f1a-4bfb-b48b-bcf14464517c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64/os-volume_attachments/936592df-02ad-46d1-924d-1ff3cccbc49e" status: 200 len: 194 microversion: 2.20 time: 0.045953 Sep 21 16:27:58.226141 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 363/645] 10.222.0.64 () {60 vars in 1454 bytes} [Wed Sep 21 16:27:58 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64/os-volume_attachments/936592df-02ad-46d1-924d-1ff3cccbc49e => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 16:27:58.295524 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-68b6cf8b-0d8f-421e-8018-51fd1c5b464c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:58.296143 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-68b6cf8b-0d8f-421e-8018-51fd1c5b464c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:58.302165 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-68b6cf8b-0d8f-421e-8018-51fd1c5b464c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:58.302649 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-68b6cf8b-0d8f-421e-8018-51fd1c5b464c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:58.303072 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-68b6cf8b-0d8f-421e-8018-51fd1c5b464c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:58.303751 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-68b6cf8b-0d8f-421e-8018-51fd1c5b464c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:58.304195 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-68b6cf8b-0d8f-421e-8018-51fd1c5b464c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:58.305108 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-68b6cf8b-0d8f-421e-8018-51fd1c5b464c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:58.383476 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.objects.instance [None req-68b6cf8b-0d8f-421e-8018-51fd1c5b464c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lazy-loading 'services' on Instance uuid 5f563aac-6055-4b77-b3bb-894ed14c1f64 {{(pid=120531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 16:27:58.432302 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell0:SELECT=2 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:27:58.453719 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell0:SELECT=10 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:27:58.455645 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-68b6cf8b-0d8f-421e-8018-51fd1c5b464c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "DELETE /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64/os-volume_attachments/936592df-02ad-46d1-924d-1ff3cccbc49e" status: 202 len: 0 microversion: 2.20 time: 0.164185 Sep 21 16:27:58.456235 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 283/646] 10.222.0.64 () {60 vars in 1457 bytes} [Wed Sep 21 16:27:58 2022] DELETE /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64/os-volume_attachments/936592df-02ad-46d1-924d-1ff3cccbc49e => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 21 16:27:58.466336 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-2551a840-d1a8-477f-b1f2-a13647a9c8a0 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:58.468606 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-2551a840-d1a8-477f-b1f2-a13647a9c8a0 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:58.474913 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2551a840-d1a8-477f-b1f2-a13647a9c8a0 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:58.475397 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2551a840-d1a8-477f-b1f2-a13647a9c8a0 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:58.475832 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2551a840-d1a8-477f-b1f2-a13647a9c8a0 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:58.476916 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-061dcc13-66c8-4a27-80af-e327cd0f0be1 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:58.477065 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2551a840-d1a8-477f-b1f2-a13647a9c8a0 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:58.477465 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2551a840-d1a8-477f-b1f2-a13647a9c8a0 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:58.477628 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-061dcc13-66c8-4a27-80af-e327cd0f0be1 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:58.477885 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2551a840-d1a8-477f-b1f2-a13647a9c8a0 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:58.484421 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-061dcc13-66c8-4a27-80af-e327cd0f0be1 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:58.484916 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-061dcc13-66c8-4a27-80af-e327cd0f0be1 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:58.485365 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-061dcc13-66c8-4a27-80af-e327cd0f0be1 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:58.487904 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-061dcc13-66c8-4a27-80af-e327cd0f0be1 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:58.488385 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-061dcc13-66c8-4a27-80af-e327cd0f0be1 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:58.488817 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-061dcc13-66c8-4a27-80af-e327cd0f0be1 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:58.508466 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-2551a840-d1a8-477f-b1f2-a13647a9c8a0 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047055 Sep 21 16:27:58.510570 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 364/647] 10.222.0.64 () {60 vars in 1343 bytes} [Wed Sep 21 16:27:58 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 21 16:27:58.551764 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-46c36290-bd2b-468a-a721-158b5be7357a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:58.552419 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-46c36290-bd2b-468a-a721-158b5be7357a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:58.558909 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-46c36290-bd2b-468a-a721-158b5be7357a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:58.559398 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-46c36290-bd2b-468a-a721-158b5be7357a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:58.559835 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-46c36290-bd2b-468a-a721-158b5be7357a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:58.560535 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-46c36290-bd2b-468a-a721-158b5be7357a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:58.560998 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-46c36290-bd2b-468a-a721-158b5be7357a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:58.561425 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-46c36290-bd2b-468a-a721-158b5be7357a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:58.579704 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell0:SELECT=2 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:27:58.634143 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-061dcc13-66c8-4a27-80af-e327cd0f0be1 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:58.643856 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-061dcc13-66c8-4a27-80af-e327cd0f0be1 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1756 microversion: 2.1 time: 0.171440 Sep 21 16:27:58.654093 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 284/648] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:58 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:27:58.694618 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-46c36290-bd2b-468a-a721-158b5be7357a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:58.702749 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-46c36290-bd2b-468a-a721-158b5be7357a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1735 microversion: 2.1 time: 0.155163 Sep 21 16:27:58.703326 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 365/649] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:58 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:27:58.752577 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-830749cc-6a9a-4c42-a085-7624423b111a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:58.753181 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-830749cc-6a9a-4c42-a085-7624423b111a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:58.759130 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-830749cc-6a9a-4c42-a085-7624423b111a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:58.759609 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-830749cc-6a9a-4c42-a085-7624423b111a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:58.760042 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-830749cc-6a9a-4c42-a085-7624423b111a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:58.760738 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-830749cc-6a9a-4c42-a085-7624423b111a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:58.761187 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-830749cc-6a9a-4c42-a085-7624423b111a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:58.761610 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-830749cc-6a9a-4c42-a085-7624423b111a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:58.894676 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-830749cc-6a9a-4c42-a085-7624423b111a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:58.903244 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-830749cc-6a9a-4c42-a085-7624423b111a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1674 microversion: 2.1 time: 0.154550 Sep 21 16:27:58.903810 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 285/650] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:58 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:59.084706 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-e416244e-a145-4079-adc7-93c56682b1fc tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:59.085221 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-e416244e-a145-4079-adc7-93c56682b1fc tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 608e4231-8635-45db-b2d6-6b0710c3120f] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:59.091728 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e416244e-a145-4079-adc7-93c56682b1fc tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:59.092205 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e416244e-a145-4079-adc7-93c56682b1fc tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:59.092638 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e416244e-a145-4079-adc7-93c56682b1fc tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:59.093320 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e416244e-a145-4079-adc7-93c56682b1fc tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:59.093765 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e416244e-a145-4079-adc7-93c56682b1fc tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:59.094210 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e416244e-a145-4079-adc7-93c56682b1fc tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:59.221571 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-e416244e-a145-4079-adc7-93c56682b1fc tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:59.229109 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-e416244e-a145-4079-adc7-93c56682b1fc tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f" status: 200 len: 1366 microversion: 2.1 time: 0.148340 Sep 21 16:27:59.229682 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 366/651] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:59 2022] GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:59.520988 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-afa01e52-dc4b-4828-bf74-4ce5bc830e54 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:59.523575 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-afa01e52-dc4b-4828-bf74-4ce5bc830e54 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:59.529943 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-afa01e52-dc4b-4828-bf74-4ce5bc830e54 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:59.530462 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-afa01e52-dc4b-4828-bf74-4ce5bc830e54 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:59.530894 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-afa01e52-dc4b-4828-bf74-4ce5bc830e54 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:59.531576 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-afa01e52-dc4b-4828-bf74-4ce5bc830e54 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:59.532025 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-afa01e52-dc4b-4828-bf74-4ce5bc830e54 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:59.532443 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-afa01e52-dc4b-4828-bf74-4ce5bc830e54 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:59.562520 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-afa01e52-dc4b-4828-bf74-4ce5bc830e54 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045425 Sep 21 16:27:59.563091 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 286/652] 10.222.0.64 () {60 vars in 1343 bytes} [Wed Sep 21 16:27:59 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 16:27:59.666853 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-34e156ca-6e25-42b5-98cc-548edd121aa5 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:59.667442 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-34e156ca-6e25-42b5-98cc-548edd121aa5 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:59.673877 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-34e156ca-6e25-42b5-98cc-548edd121aa5 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:59.674321 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-34e156ca-6e25-42b5-98cc-548edd121aa5 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:59.674752 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-34e156ca-6e25-42b5-98cc-548edd121aa5 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:59.675459 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-34e156ca-6e25-42b5-98cc-548edd121aa5 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:59.675905 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-34e156ca-6e25-42b5-98cc-548edd121aa5 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:59.676319 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-34e156ca-6e25-42b5-98cc-548edd121aa5 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:59.726007 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-b4d12f41-8d06-4ce7-be25-47ce368d0981 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:59.726720 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-b4d12f41-8d06-4ce7-be25-47ce368d0981 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:59.732676 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b4d12f41-8d06-4ce7-be25-47ce368d0981 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:59.733159 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b4d12f41-8d06-4ce7-be25-47ce368d0981 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:59.733583 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b4d12f41-8d06-4ce7-be25-47ce368d0981 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:59.734297 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b4d12f41-8d06-4ce7-be25-47ce368d0981 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:59.734743 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b4d12f41-8d06-4ce7-be25-47ce368d0981 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:59.735157 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b4d12f41-8d06-4ce7-be25-47ce368d0981 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:59.741739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:27:59.840713 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-34e156ca-6e25-42b5-98cc-548edd121aa5 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:59.859706 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-34e156ca-6e25-42b5-98cc-548edd121aa5 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1756 microversion: 2.1 time: 0.196372 Sep 21 16:27:59.860558 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 367/653] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:59 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1756 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:27:59.926454 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-86e57a20-68a1-4ace-86fe-efc03a1bb1e8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:27:59.927170 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-86e57a20-68a1-4ace-86fe-efc03a1bb1e8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:27:59.935989 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-86e57a20-68a1-4ace-86fe-efc03a1bb1e8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:59.936490 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-86e57a20-68a1-4ace-86fe-efc03a1bb1e8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:59.936923 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-86e57a20-68a1-4ace-86fe-efc03a1bb1e8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:59.937730 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-86e57a20-68a1-4ace-86fe-efc03a1bb1e8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:27:59.938086 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-b4d12f41-8d06-4ce7-be25-47ce368d0981 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:27:59.938296 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-86e57a20-68a1-4ace-86fe-efc03a1bb1e8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:27:59.938743 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-86e57a20-68a1-4ace-86fe-efc03a1bb1e8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:27:59.946972 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-b4d12f41-8d06-4ce7-be25-47ce368d0981 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1735 microversion: 2.1 time: 0.224745 Sep 21 16:27:59.947745 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 287/654] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:59 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1735 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:28:00.068064 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-86e57a20-68a1-4ace-86fe-efc03a1bb1e8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:00.075784 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-86e57a20-68a1-4ace-86fe-efc03a1bb1e8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1674 microversion: 2.1 time: 0.153424 Sep 21 16:28:00.076353 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 368/655] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:27:59 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:28:00.251337 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-2a45e40c-fd1d-400d-91b2-b74c7f1e72e2 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:00.251849 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-2a45e40c-fd1d-400d-91b2-b74c7f1e72e2 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 608e4231-8635-45db-b2d6-6b0710c3120f] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:00.258342 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2a45e40c-fd1d-400d-91b2-b74c7f1e72e2 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:00.258827 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2a45e40c-fd1d-400d-91b2-b74c7f1e72e2 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:00.259255 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2a45e40c-fd1d-400d-91b2-b74c7f1e72e2 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:00.259945 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2a45e40c-fd1d-400d-91b2-b74c7f1e72e2 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:00.260389 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2a45e40c-fd1d-400d-91b2-b74c7f1e72e2 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:00.260889 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2a45e40c-fd1d-400d-91b2-b74c7f1e72e2 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:00.472515 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-2a45e40c-fd1d-400d-91b2-b74c7f1e72e2 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:00.485653 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-2a45e40c-fd1d-400d-91b2-b74c7f1e72e2 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f" status: 200 len: 1366 microversion: 2.1 time: 0.233734 Sep 21 16:28:00.485653 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 288/656] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:00 2022] GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:28:00.575574 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-1b17cbad-9fd7-4841-851d-079db29c7713 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:00.577789 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-1b17cbad-9fd7-4841-851d-079db29c7713 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:00.584493 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1b17cbad-9fd7-4841-851d-079db29c7713 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:00.584973 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1b17cbad-9fd7-4841-851d-079db29c7713 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:00.585401 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1b17cbad-9fd7-4841-851d-079db29c7713 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:00.586825 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1b17cbad-9fd7-4841-851d-079db29c7713 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:00.587279 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1b17cbad-9fd7-4841-851d-079db29c7713 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:00.587695 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1b17cbad-9fd7-4841-851d-079db29c7713 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:00.616740 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-1b17cbad-9fd7-4841-851d-079db29c7713 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045136 Sep 21 16:28:00.617316 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 369/657] 10.222.0.64 () {60 vars in 1343 bytes} [Wed Sep 21 16:28:00 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 16:28:00.884188 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-5f0c228e-666a-45fe-9c65-ba16b4bc52ce tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:00.885134 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-5f0c228e-666a-45fe-9c65-ba16b4bc52ce tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:00.891267 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5f0c228e-666a-45fe-9c65-ba16b4bc52ce tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:00.891751 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5f0c228e-666a-45fe-9c65-ba16b4bc52ce tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:00.892181 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5f0c228e-666a-45fe-9c65-ba16b4bc52ce tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:00.892875 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5f0c228e-666a-45fe-9c65-ba16b4bc52ce tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:00.893397 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5f0c228e-666a-45fe-9c65-ba16b4bc52ce tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:00.893739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5f0c228e-666a-45fe-9c65-ba16b4bc52ce tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:00.974381 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-7510c947-74dc-462b-832b-84a66a28746f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:00.974983 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-7510c947-74dc-462b-832b-84a66a28746f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:00.981303 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7510c947-74dc-462b-832b-84a66a28746f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:00.981812 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7510c947-74dc-462b-832b-84a66a28746f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:00.982276 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7510c947-74dc-462b-832b-84a66a28746f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:00.982961 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7510c947-74dc-462b-832b-84a66a28746f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:00.983437 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7510c947-74dc-462b-832b-84a66a28746f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:00.983857 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7510c947-74dc-462b-832b-84a66a28746f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:01.113503 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-7510c947-74dc-462b-832b-84a66a28746f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:01.115793 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:28:01.123721 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-7510c947-74dc-462b-832b-84a66a28746f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1735 microversion: 2.1 time: 0.153241 Sep 21 16:28:01.124315 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 370/658] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:00 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:28:01.129753 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-5f0c228e-666a-45fe-9c65-ba16b4bc52ce tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:01.130259 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-2d4a78fd-376c-419f-bd8f-b8467bbe0ab9 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:01.130945 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-2d4a78fd-376c-419f-bd8f-b8467bbe0ab9 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:01.138480 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2d4a78fd-376c-419f-bd8f-b8467bbe0ab9 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:01.138912 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2d4a78fd-376c-419f-bd8f-b8467bbe0ab9 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:01.139432 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-5f0c228e-666a-45fe-9c65-ba16b4bc52ce tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1759 microversion: 2.1 time: 0.259655 Sep 21 16:28:01.139698 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2d4a78fd-376c-419f-bd8f-b8467bbe0ab9 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:01.140510 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 289/659] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:00 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1759 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:28:01.140920 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2d4a78fd-376c-419f-bd8f-b8467bbe0ab9 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:01.141399 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2d4a78fd-376c-419f-bd8f-b8467bbe0ab9 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:01.141823 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2d4a78fd-376c-419f-bd8f-b8467bbe0ab9 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:01.209523 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-2d4a78fd-376c-419f-bd8f-b8467bbe0ab9 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:01.217519 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-2d4a78fd-376c-419f-bd8f-b8467bbe0ab9 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1606 microversion: 2.1 time: 0.092214 Sep 21 16:28:01.218114 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 371/660] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:01 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1606 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:28:01.313316 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-3ff95e2b-d319-4146-b62d-d064548ea289 req-68b56bdc-d848-4ac0-89ae-e5710bffa678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c1436cc-a3f6-4683-abf2-e8835aa53021", "name": "network-vif-deleted", "tag": "2b416c16-2f39-4d35-bf8a-8301720a840d"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:28:01.324314 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-3ff95e2b-d319-4146-b62d-d064548ea289 req-68b56bdc-d848-4ac0-89ae-e5710bffa678 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:01.325057 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-3ff95e2b-d319-4146-b62d-d064548ea289 req-68b56bdc-d848-4ac0-89ae-e5710bffa678 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:01.325637 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-3ff95e2b-d319-4146-b62d-d064548ea289 req-68b56bdc-d848-4ac0-89ae-e5710bffa678 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:01.337747 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-3ff95e2b-d319-4146-b62d-d064548ea289 req-68b56bdc-d848-4ac0-89ae-e5710bffa678 service nova] Creating event network-vif-deleted:2b416c16-2f39-4d35-bf8a-8301720a840d for instance 1c1436cc-a3f6-4683-abf2-e8835aa53021 on hv-cinder-85862 Sep 21 16:28:01.343026 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-3ff95e2b-d319-4146-b62d-d064548ea289 req-68b56bdc-d848-4ac0-89ae-e5710bffa678 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033864 Sep 21 16:28:01.344157 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 290/661] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:28:01.503853 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-efc2c520-322a-43f6-9b15-4a292b8cdeec tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:01.504454 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-efc2c520-322a-43f6-9b15-4a292b8cdeec tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 608e4231-8635-45db-b2d6-6b0710c3120f] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:01.515328 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-efc2c520-322a-43f6-9b15-4a292b8cdeec tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:01.515816 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-efc2c520-322a-43f6-9b15-4a292b8cdeec tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:01.516243 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-efc2c520-322a-43f6-9b15-4a292b8cdeec tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:01.516933 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-efc2c520-322a-43f6-9b15-4a292b8cdeec tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:01.517380 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-efc2c520-322a-43f6-9b15-4a292b8cdeec tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:01.517799 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-efc2c520-322a-43f6-9b15-4a292b8cdeec tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:01.629524 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-14f5e175-3293-411e-b512-bc329002926d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:01.631877 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-14f5e175-3293-411e-b512-bc329002926d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:01.638134 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-14f5e175-3293-411e-b512-bc329002926d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:01.638615 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-14f5e175-3293-411e-b512-bc329002926d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:01.639258 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-14f5e175-3293-411e-b512-bc329002926d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:01.639746 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-14f5e175-3293-411e-b512-bc329002926d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:01.640200 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-14f5e175-3293-411e-b512-bc329002926d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:01.640618 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-14f5e175-3293-411e-b512-bc329002926d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:01.662749 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-efc2c520-322a-43f6-9b15-4a292b8cdeec tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:01.671567 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-14f5e175-3293-411e-b512-bc329002926d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046339 Sep 21 16:28:01.672325 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 291/662] 10.222.0.64 () {60 vars in 1343 bytes} [Wed Sep 21 16:28:01 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 21 16:28:01.672566 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-efc2c520-322a-43f6-9b15-4a292b8cdeec tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f" status: 200 len: 1366 microversion: 2.1 time: 0.172486 Sep 21 16:28:01.674105 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 372/663] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:01 2022] GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:28:02.151273 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-cc985153-3716-4f12-a4b7-b2900e956025 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:02.151823 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-cc985153-3716-4f12-a4b7-b2900e956025 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:02.160151 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cc985153-3716-4f12-a4b7-b2900e956025 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:02.160867 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cc985153-3716-4f12-a4b7-b2900e956025 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:02.161470 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cc985153-3716-4f12-a4b7-b2900e956025 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:02.162475 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cc985153-3716-4f12-a4b7-b2900e956025 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:02.163312 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cc985153-3716-4f12-a4b7-b2900e956025 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:02.163942 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cc985153-3716-4f12-a4b7-b2900e956025 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:02.243280 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-23f73f7f-61d7-4495-a4a3-0c36422e6527 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:02.244036 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-23f73f7f-61d7-4495-a4a3-0c36422e6527 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:02.251895 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-23f73f7f-61d7-4495-a4a3-0c36422e6527 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:02.252672 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-23f73f7f-61d7-4495-a4a3-0c36422e6527 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:02.253163 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-23f73f7f-61d7-4495-a4a3-0c36422e6527 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:02.253891 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-23f73f7f-61d7-4495-a4a3-0c36422e6527 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:02.254379 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-23f73f7f-61d7-4495-a4a3-0c36422e6527 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:02.254806 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-23f73f7f-61d7-4495-a4a3-0c36422e6527 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:02.290653 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-23f73f7f-61d7-4495-a4a3-0c36422e6527 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:02.291406 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-23f73f7f-61d7-4495-a4a3-0c36422e6527 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:02.291841 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-23f73f7f-61d7-4495-a4a3-0c36422e6527 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:02.292292 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.objects.instance [None req-23f73f7f-61d7-4495-a4a3-0c36422e6527 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lazy-loading 'fault' on Instance uuid 1c1436cc-a3f6-4683-abf2-e8835aa53021 {{(pid=120532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 16:28:02.347837 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-23f73f7f-61d7-4495-a4a3-0c36422e6527 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:02.358096 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-23f73f7f-61d7-4495-a4a3-0c36422e6527 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1328 microversion: 2.1 time: 0.120626 Sep 21 16:28:02.359038 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 373/664] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:02 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1328 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:28:02.369261 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-cc985153-3716-4f12-a4b7-b2900e956025 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:02.377834 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-cc985153-3716-4f12-a4b7-b2900e956025 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1735 microversion: 2.1 time: 0.233202 Sep 21 16:28:02.378431 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 292/665] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:02 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1735 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:28:02.684930 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-abd4489e-c36b-4590-ac4a-e8267aa898d4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:02.687210 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-abd4489e-c36b-4590-ac4a-e8267aa898d4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:02.693333 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-abd4489e-c36b-4590-ac4a-e8267aa898d4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:02.693874 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-abd4489e-c36b-4590-ac4a-e8267aa898d4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:02.694334 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-abd4489e-c36b-4590-ac4a-e8267aa898d4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:02.695610 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-abd4489e-c36b-4590-ac4a-e8267aa898d4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:02.696057 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-abd4489e-c36b-4590-ac4a-e8267aa898d4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:02.696326 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d76abcde-4123-424e-936f-7ef041e19e8e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:02.696475 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-abd4489e-c36b-4590-ac4a-e8267aa898d4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:02.696948 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d76abcde-4123-424e-936f-7ef041e19e8e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 608e4231-8635-45db-b2d6-6b0710c3120f] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:02.702900 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d76abcde-4123-424e-936f-7ef041e19e8e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:02.703389 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d76abcde-4123-424e-936f-7ef041e19e8e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:02.703827 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d76abcde-4123-424e-936f-7ef041e19e8e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:02.704522 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d76abcde-4123-424e-936f-7ef041e19e8e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:02.704978 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d76abcde-4123-424e-936f-7ef041e19e8e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:02.705399 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d76abcde-4123-424e-936f-7ef041e19e8e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:02.725871 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-abd4489e-c36b-4590-ac4a-e8267aa898d4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044895 Sep 21 16:28:02.726475 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 374/666] 10.222.0.64 () {60 vars in 1343 bytes} [Wed Sep 21 16:28:02 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 21 16:28:02.837343 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d76abcde-4123-424e-936f-7ef041e19e8e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:02.845746 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d76abcde-4123-424e-936f-7ef041e19e8e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f" status: 200 len: 1366 microversion: 2.1 time: 0.153845 Sep 21 16:28:02.846358 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 293/667] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:02 2022] GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:28:03.381102 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-3d4ed4a5-4b15-435f-bf35-3b10675bec36 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:03.381700 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-3d4ed4a5-4b15-435f-bf35-3b10675bec36 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:03.388104 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3d4ed4a5-4b15-435f-bf35-3b10675bec36 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:03.388579 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3d4ed4a5-4b15-435f-bf35-3b10675bec36 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:03.389003 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3d4ed4a5-4b15-435f-bf35-3b10675bec36 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:03.389682 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3d4ed4a5-4b15-435f-bf35-3b10675bec36 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:03.390156 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3d4ed4a5-4b15-435f-bf35-3b10675bec36 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:03.390577 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3d4ed4a5-4b15-435f-bf35-3b10675bec36 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:03.403084 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-225a96d5-d0f1-4777-b53c-70f6eef2bfcc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:03.403692 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-225a96d5-d0f1-4777-b53c-70f6eef2bfcc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:03.410613 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-225a96d5-d0f1-4777-b53c-70f6eef2bfcc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:03.411096 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-225a96d5-d0f1-4777-b53c-70f6eef2bfcc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:03.411529 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-225a96d5-d0f1-4777-b53c-70f6eef2bfcc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:03.412234 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-225a96d5-d0f1-4777-b53c-70f6eef2bfcc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:03.412707 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-225a96d5-d0f1-4777-b53c-70f6eef2bfcc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:03.413129 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-225a96d5-d0f1-4777-b53c-70f6eef2bfcc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:03.420101 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:28:03.424213 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3d4ed4a5-4b15-435f-bf35-3b10675bec36 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:03.424693 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3d4ed4a5-4b15-435f-bf35-3b10675bec36 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:03.425123 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3d4ed4a5-4b15-435f-bf35-3b10675bec36 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:03.425567 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.objects.instance [None req-3d4ed4a5-4b15-435f-bf35-3b10675bec36 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lazy-loading 'fault' on Instance uuid 1c1436cc-a3f6-4683-abf2-e8835aa53021 {{(pid=120532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 16:28:03.471090 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-3d4ed4a5-4b15-435f-bf35-3b10675bec36 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:03.480709 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-3d4ed4a5-4b15-435f-bf35-3b10675bec36 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1328 microversion: 2.1 time: 0.103398 Sep 21 16:28:03.496976 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 375/668] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:03 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1328 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:28:03.577276 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-225a96d5-d0f1-4777-b53c-70f6eef2bfcc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:03.586258 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-225a96d5-d0f1-4777-b53c-70f6eef2bfcc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1735 microversion: 2.1 time: 0.186311 Sep 21 16:28:03.586838 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 294/669] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:03 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1735 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:28:03.738264 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ccc842b4-9c58-49e6-8f45-b11bf2942627 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:03.740448 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ccc842b4-9c58-49e6-8f45-b11bf2942627 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:03.746357 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ccc842b4-9c58-49e6-8f45-b11bf2942627 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:03.746840 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ccc842b4-9c58-49e6-8f45-b11bf2942627 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:03.747263 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ccc842b4-9c58-49e6-8f45-b11bf2942627 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:03.747949 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ccc842b4-9c58-49e6-8f45-b11bf2942627 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:03.748393 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ccc842b4-9c58-49e6-8f45-b11bf2942627 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:03.748801 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ccc842b4-9c58-49e6-8f45-b11bf2942627 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:03.779553 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ccc842b4-9c58-49e6-8f45-b11bf2942627 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045323 Sep 21 16:28:03.780117 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 376/670] 10.222.0.64 () {60 vars in 1343 bytes} [Wed Sep 21 16:28:03 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:28:03.843326 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-b68a3690-4b65-41ff-9e3d-1803a318e6ce tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:03.843819 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-b68a3690-4b65-41ff-9e3d-1803a318e6ce tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:03.849717 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b68a3690-4b65-41ff-9e3d-1803a318e6ce tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:03.850233 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b68a3690-4b65-41ff-9e3d-1803a318e6ce tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:03.850680 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b68a3690-4b65-41ff-9e3d-1803a318e6ce tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:03.851367 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b68a3690-4b65-41ff-9e3d-1803a318e6ce tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:03.851820 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b68a3690-4b65-41ff-9e3d-1803a318e6ce tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:03.852236 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b68a3690-4b65-41ff-9e3d-1803a318e6ce tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:03.868628 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c680767c-c623-4709-a1a0-b87555bbaded tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:03.869237 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-c680767c-c623-4709-a1a0-b87555bbaded tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 608e4231-8635-45db-b2d6-6b0710c3120f] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:03.875096 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c680767c-c623-4709-a1a0-b87555bbaded tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:03.875576 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c680767c-c623-4709-a1a0-b87555bbaded tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:03.876007 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c680767c-c623-4709-a1a0-b87555bbaded tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:03.876696 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c680767c-c623-4709-a1a0-b87555bbaded tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:03.876869 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-b68a3690-4b65-41ff-9e3d-1803a318e6ce tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Going to try to terminate instance {{(pid=120531) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 16:28:03.877153 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c680767c-c623-4709-a1a0-b87555bbaded tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:03.877571 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c680767c-c623-4709-a1a0-b87555bbaded tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:03.980737 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:28:03.988248 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-b68a3690-4b65-41ff-9e3d-1803a318e6ce tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "DELETE /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 204 len: 0 microversion: 2.20 time: 0.148437 Sep 21 16:28:03.989309 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 295/671] 10.222.0.64 () {60 vars in 1280 bytes} [Wed Sep 21 16:28:03 2022] DELETE /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 21 16:28:03.999326 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-852b1c45-9acb-48c1-8bf1-ca5e8f37aeaf tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:04.001019 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-852b1c45-9acb-48c1-8bf1-ca5e8f37aeaf tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:04.009713 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-852b1c45-9acb-48c1-8bf1-ca5e8f37aeaf tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:04.010231 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-852b1c45-9acb-48c1-8bf1-ca5e8f37aeaf tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:04.010660 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-852b1c45-9acb-48c1-8bf1-ca5e8f37aeaf tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:04.011359 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-852b1c45-9acb-48c1-8bf1-ca5e8f37aeaf tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:04.011809 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-852b1c45-9acb-48c1-8bf1-ca5e8f37aeaf tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:04.012304 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-852b1c45-9acb-48c1-8bf1-ca5e8f37aeaf tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:04.045526 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-c680767c-c623-4709-a1a0-b87555bbaded tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:04.053287 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-c680767c-c623-4709-a1a0-b87555bbaded tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f" status: 200 len: 1555 microversion: 2.1 time: 0.188445 Sep 21 16:28:04.053869 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 377/672] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:03 2022] GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f => generated 1555 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:28:04.076544 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-f4d90e3f-79df-44de-bc49-2b9000b5ed86 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:04.077036 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-f4d90e3f-79df-44de-bc49-2b9000b5ed86 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 608e4231-8635-45db-b2d6-6b0710c3120f] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:04.082979 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f4d90e3f-79df-44de-bc49-2b9000b5ed86 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:04.083465 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f4d90e3f-79df-44de-bc49-2b9000b5ed86 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:04.083897 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f4d90e3f-79df-44de-bc49-2b9000b5ed86 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:04.084598 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f4d90e3f-79df-44de-bc49-2b9000b5ed86 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:04.085086 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f4d90e3f-79df-44de-bc49-2b9000b5ed86 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:04.085555 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f4d90e3f-79df-44de-bc49-2b9000b5ed86 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:04.148267 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-852b1c45-9acb-48c1-8bf1-ca5e8f37aeaf tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:04.156739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-852b1c45-9acb-48c1-8bf1-ca5e8f37aeaf tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:04.158293 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-852b1c45-9acb-48c1-8bf1-ca5e8f37aeaf tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:04.159667 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-852b1c45-9acb-48c1-8bf1-ca5e8f37aeaf tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1724 microversion: 2.20 time: 0.164959 Sep 21 16:28:04.160307 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 296/673] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:28:03 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:28:04.162807 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-f4d90e3f-79df-44de-bc49-2b9000b5ed86 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090276 Sep 21 16:28:04.163507 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 378/674] 10.222.0.64 () {58 vars in 1275 bytes} [Wed Sep 21 16:28:04 2022] GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:28:04.503965 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-169d05e1-5976-4669-86d2-059d2212541c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:04.504585 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-169d05e1-5976-4669-86d2-059d2212541c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:04.511413 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-169d05e1-5976-4669-86d2-059d2212541c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:04.511907 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-169d05e1-5976-4669-86d2-059d2212541c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:04.512343 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-169d05e1-5976-4669-86d2-059d2212541c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:04.513053 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-169d05e1-5976-4669-86d2-059d2212541c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:04.513511 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-169d05e1-5976-4669-86d2-059d2212541c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:04.513926 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-169d05e1-5976-4669-86d2-059d2212541c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:04.547742 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-169d05e1-5976-4669-86d2-059d2212541c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:04.548226 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-169d05e1-5976-4669-86d2-059d2212541c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:04.548658 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-169d05e1-5976-4669-86d2-059d2212541c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:04.549104 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.objects.instance [None req-169d05e1-5976-4669-86d2-059d2212541c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lazy-loading 'fault' on Instance uuid 1c1436cc-a3f6-4683-abf2-e8835aa53021 {{(pid=120531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 16:28:04.594895 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-169d05e1-5976-4669-86d2-059d2212541c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:04.607525 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-169d05e1-5976-4669-86d2-059d2212541c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1328 microversion: 2.1 time: 0.107176 Sep 21 16:28:04.608583 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 297/675] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:04 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1328 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:28:04.612506 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-f3051539-3bc7-4897-9a78-a8c7e7cc5cfd tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:04.613264 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-f3051539-3bc7-4897-9a78-a8c7e7cc5cfd tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:04.622521 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f3051539-3bc7-4897-9a78-a8c7e7cc5cfd tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:04.622791 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f3051539-3bc7-4897-9a78-a8c7e7cc5cfd tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:04.623423 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f3051539-3bc7-4897-9a78-a8c7e7cc5cfd tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:04.624970 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f3051539-3bc7-4897-9a78-a8c7e7cc5cfd tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:04.625636 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f3051539-3bc7-4897-9a78-a8c7e7cc5cfd tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:04.626196 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f3051539-3bc7-4897-9a78-a8c7e7cc5cfd tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:04.872074 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-f3051539-3bc7-4897-9a78-a8c7e7cc5cfd tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:04.880358 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-f3051539-3bc7-4897-9a78-a8c7e7cc5cfd tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1735 microversion: 2.1 time: 0.272375 Sep 21 16:28:04.880945 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 379/676] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:04 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1735 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:28:05.183659 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-20471a45-e39c-4ae4-a5b6-675f9b0d7a5b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:05.184264 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-20471a45-e39c-4ae4-a5b6-675f9b0d7a5b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:05.191366 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-20471a45-e39c-4ae4-a5b6-675f9b0d7a5b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:05.191848 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-20471a45-e39c-4ae4-a5b6-675f9b0d7a5b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:05.192276 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-20471a45-e39c-4ae4-a5b6-675f9b0d7a5b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:05.192963 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-20471a45-e39c-4ae4-a5b6-675f9b0d7a5b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:05.193442 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-20471a45-e39c-4ae4-a5b6-675f9b0d7a5b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:05.193865 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-20471a45-e39c-4ae4-a5b6-675f9b0d7a5b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:05.420498 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-0a983619-e8ea-447b-ab1c-b3e9c6aae28c req-4ba8a876-066a-46c7-be16-07eb0849cc71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "608e4231-8635-45db-b2d6-6b0710c3120f", "tag": "8eb105fe-8645-41dc-876d-e301557328f9"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:28:05.431615 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-0a983619-e8ea-447b-ab1c-b3e9c6aae28c req-4ba8a876-066a-46c7-be16-07eb0849cc71 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:05.432433 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-0a983619-e8ea-447b-ab1c-b3e9c6aae28c req-4ba8a876-066a-46c7-be16-07eb0849cc71 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:05.432986 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-0a983619-e8ea-447b-ab1c-b3e9c6aae28c req-4ba8a876-066a-46c7-be16-07eb0849cc71 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:05.447353 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-0a983619-e8ea-447b-ab1c-b3e9c6aae28c req-4ba8a876-066a-46c7-be16-07eb0849cc71 service nova] Creating event network-changed:8eb105fe-8645-41dc-876d-e301557328f9 for instance 608e4231-8635-45db-b2d6-6b0710c3120f on hv-cinder-85862 Sep 21 16:28:05.452628 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-0a983619-e8ea-447b-ab1c-b3e9c6aae28c req-4ba8a876-066a-46c7-be16-07eb0849cc71 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035820 Sep 21 16:28:05.453563 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 380/677] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:28:05.584828 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-20471a45-e39c-4ae4-a5b6-675f9b0d7a5b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:05.594470 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-20471a45-e39c-4ae4-a5b6-675f9b0d7a5b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:05.596221 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-20471a45-e39c-4ae4-a5b6-675f9b0d7a5b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:05.597574 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-20471a45-e39c-4ae4-a5b6-675f9b0d7a5b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1724 microversion: 2.20 time: 0.417886 Sep 21 16:28:05.598869 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 298/678] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:28:05 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1724 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:28:05.633748 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c10cec04-bdd4-45a2-b23f-57adf873ba9d tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:05.634448 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-c10cec04-bdd4-45a2-b23f-57adf873ba9d tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:05.640659 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c10cec04-bdd4-45a2-b23f-57adf873ba9d tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:05.641153 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c10cec04-bdd4-45a2-b23f-57adf873ba9d tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:05.641791 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c10cec04-bdd4-45a2-b23f-57adf873ba9d tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:05.642878 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c10cec04-bdd4-45a2-b23f-57adf873ba9d tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:05.643515 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c10cec04-bdd4-45a2-b23f-57adf873ba9d tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:05.643938 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c10cec04-bdd4-45a2-b23f-57adf873ba9d tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:05.694124 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c10cec04-bdd4-45a2-b23f-57adf873ba9d tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:05.695295 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c10cec04-bdd4-45a2-b23f-57adf873ba9d tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:05.695770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c10cec04-bdd4-45a2-b23f-57adf873ba9d tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:05.696174 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.objects.instance [None req-c10cec04-bdd4-45a2-b23f-57adf873ba9d tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lazy-loading 'fault' on Instance uuid 1c1436cc-a3f6-4683-abf2-e8835aa53021 {{(pid=120532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 16:28:05.738065 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-c10cec04-bdd4-45a2-b23f-57adf873ba9d tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:05.746437 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-c10cec04-bdd4-45a2-b23f-57adf873ba9d tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 200 len: 1328 microversion: 2.1 time: 0.118373 Sep 21 16:28:05.747014 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 381/679] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:05 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 1328 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:28:05.903467 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-57b9af72-c011-48ff-990e-4c41fb9380e7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:05.904232 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-57b9af72-c011-48ff-990e-4c41fb9380e7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:05.926769 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-57b9af72-c011-48ff-990e-4c41fb9380e7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:05.927274 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-57b9af72-c011-48ff-990e-4c41fb9380e7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:05.927721 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-57b9af72-c011-48ff-990e-4c41fb9380e7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:05.928431 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-57b9af72-c011-48ff-990e-4c41fb9380e7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:05.929466 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-57b9af72-c011-48ff-990e-4c41fb9380e7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:05.929904 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-57b9af72-c011-48ff-990e-4c41fb9380e7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:06.059435 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-57b9af72-c011-48ff-990e-4c41fb9380e7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:06.067906 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-57b9af72-c011-48ff-990e-4c41fb9380e7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1715 microversion: 2.1 time: 0.168305 Sep 21 16:28:06.068476 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 299/680] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:05 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1715 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:28:06.181979 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-1d2cc7fe-13ba-45c0-9fbc-340e25a389fc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:06.182664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-1d2cc7fe-13ba-45c0-9fbc-340e25a389fc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:06.188441 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1d2cc7fe-13ba-45c0-9fbc-340e25a389fc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:06.188908 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1d2cc7fe-13ba-45c0-9fbc-340e25a389fc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:06.189334 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1d2cc7fe-13ba-45c0-9fbc-340e25a389fc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:06.190071 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1d2cc7fe-13ba-45c0-9fbc-340e25a389fc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:06.190525 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1d2cc7fe-13ba-45c0-9fbc-340e25a389fc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:06.190944 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1d2cc7fe-13ba-45c0-9fbc-340e25a389fc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:06.313906 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.wsgi [None req-1d2cc7fe-13ba-45c0-9fbc-340e25a389fc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] HTTP exception thrown: Cannot 'detach_volume' instance c95f478c-11b2-4097-b4b1-551d61fa9664 while it is in vm_state rescued Sep 21 16:28:06.315590 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-1d2cc7fe-13ba-45c0-9fbc-340e25a389fc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Request method failure captured: Sep 21 16:28:06.315590 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: request: DELETE /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664/os-volume_attachments/5daa0358-1a92-4801-95be-3236e23d3e76 HTTP/1.1 Sep 21 16:28:06.315590 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept: application/json Sep 21 16:28:06.315590 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept-Encoding: identity Sep 21 16:28:06.315590 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Connection: close Sep 21 16:28:06.315590 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Length: 0 Sep 21 16:28:06.315590 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Type: application/json Sep 21 16:28:06.315590 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Host: 10.222.0.64 Sep 21 16:28:06.315590 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Openstack-System-Scope: None Sep 21 16:28:06.315590 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: User-Agent: python-urllib3/1.26.12 Sep 21 16:28:06.315590 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Auth-Token: gAAAAABjKzpyl2VCA8qOXz_21Lb4_x9U1Xx-KlcjECNulDWe7htEJ0Af4mLHkpXjsPlA1iQ8jPMrxiWhztqQcFxCTlE1P4S3HVT0CeR12yBvkFP50lGbKEP4T7hlDNnQEqfVaKzVcRuzvbEZYlwT4nr23Om4knGB4vuwh-cjuvcsP1wXC1rngVU Sep 21 16:28:06.315590 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Id: None Sep 21 16:28:06.315590 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Name: None Sep 21 16:28:06.315590 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Identity-Status: Confirmed Sep 21 16:28:06.315590 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Is-Admin-Project: True Sep 21 16:28:06.315590 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Id: default Sep 21 16:28:06.315590 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Name: Default Sep 21 16:28:06.315590 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Id: b93e202a295d427a85fdaf0209951bd5 Sep 21 16:28:06.315590 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-717335908 Sep 21 16:28:06.315590 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Role: member,reader Sep 21 16:28:06.315590 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Roles: member,reader Sep 21 16:28:06.317091 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/b93e202a295d427a85fdaf0209951bd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b93e202a295d427a85fdaf0209951bd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_b93e202a295d427a85fdaf0209951bd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b93e202a295d427a85fdaf0209951bd5"}]}] Sep 21 16:28:06.317091 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant: tempest-ServerRescueNegativeTestJSON-717335908 Sep 21 16:28:06.317091 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Id: b93e202a295d427a85fdaf0209951bd5 Sep 21 16:28:06.317091 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-717335908 Sep 21 16:28:06.317091 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User: tempest-ServerRescueNegativeTestJSON-717335908-project Sep 21 16:28:06.317091 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Id: default Sep 21 16:28:06.317091 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Name: Default Sep 21 16:28:06.317091 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Id: d2382a6610ae42fa865283ed12dd9982 Sep 21 16:28:06.317091 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Name: tempest-ServerRescueNegativeTestJSON-717335908-project Sep 21 16:28:06.317091 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: method: > Sep 21 16:28:06.317091 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: exception: Cannot 'detach_volume' instance c95f478c-11b2-4097-b4b1-551d61fa9664 while it is in vm_state rescued Sep 21 16:28:06.317803 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: action_args: {'server_id': 'c95f478c-11b2-4097-b4b1-551d61fa9664', 'id': '5daa0358-1a92-4801-95be-3236e23d3e76'} Sep 21 16:28:06.317803 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:28:06.317803 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:28:06.317803 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 21 16:28:06.317803 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 21 16:28:06.317803 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 21 16:28:06.317803 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 21 16:28:06.317803 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 21 16:28:06.317803 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 21 16:28:06.317803 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c95f478c-11b2-4097-b4b1-551d61fa9664 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 21 16:28:06.317803 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:28:06.317803 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:28:06.317803 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:28:06.317803 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:28:06.317803 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:28:06.317803 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:28:06.317803 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:28:06.317803 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:28:06.317803 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:28:06.317803 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:28:06.319079 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 21 16:28:06.319079 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 21 16:28:06.319079 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 21 16:28:06.319079 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 21 16:28:06.319079 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c95f478c-11b2-4097-b4b1-551d61fa9664 while it is in vm_state rescued Sep 21 16:28:06.319079 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:28:06.319079 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:28:06.319079 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:28:06.319079 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:28:06.319079 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:28:06.319079 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:28:06.319079 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:28:06.319079 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:28:06.319079 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c95f478c-11b2-4097-b4b1-551d61fa9664 while it is in vm_state rescued Sep 21 16:28:06.319079 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:28:06.319079 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-1d2cc7fe-13ba-45c0-9fbc-340e25a389fc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Returning 409 to user: Cannot 'detach_volume' instance c95f478c-11b2-4097-b4b1-551d61fa9664 while it is in vm_state rescued {{(pid=120532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:28:06.320104 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-1d2cc7fe-13ba-45c0-9fbc-340e25a389fc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "DELETE /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664/os-volume_attachments/5daa0358-1a92-4801-95be-3236e23d3e76" status: 409 len: 152 microversion: 2.1 time: 0.139721 Sep 21 16:28:06.320104 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 382/681] 10.222.0.64 () {58 vars in 1416 bytes} [Wed Sep 21 16:28:06 2022] DELETE /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664/os-volume_attachments/5daa0358-1a92-4801-95be-3236e23d3e76 => generated 152 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 21 16:28:06.326229 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-ef832537-244f-473d-8df7-75324cb9054f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:28:06.326822 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-ef832537-244f-473d-8df7-75324cb9054f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:06.333026 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ef832537-244f-473d-8df7-75324cb9054f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:06.333590 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ef832537-244f-473d-8df7-75324cb9054f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:06.334138 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ef832537-244f-473d-8df7-75324cb9054f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:06.334898 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ef832537-244f-473d-8df7-75324cb9054f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:06.335945 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ef832537-244f-473d-8df7-75324cb9054f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:06.336443 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ef832537-244f-473d-8df7-75324cb9054f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:06.406286 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-ef832537-244f-473d-8df7-75324cb9054f tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "POST /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664/action" status: 202 len: 0 microversion: 2.1 time: 0.083845 Sep 21 16:28:06.409863 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 300/682] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Sep 21 16:28:06 2022] POST /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 16:28:06.415861 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-a0754523-252b-4600-944f-0acd30cb3a65 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:06.416500 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-a0754523-252b-4600-944f-0acd30cb3a65 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:06.426552 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a0754523-252b-4600-944f-0acd30cb3a65 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:06.426965 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a0754523-252b-4600-944f-0acd30cb3a65 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:06.427401 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a0754523-252b-4600-944f-0acd30cb3a65 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:06.428128 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a0754523-252b-4600-944f-0acd30cb3a65 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:06.428589 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a0754523-252b-4600-944f-0acd30cb3a65 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:06.429044 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a0754523-252b-4600-944f-0acd30cb3a65 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:06.641418 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a0754523-252b-4600-944f-0acd30cb3a65 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:06.653286 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-a0754523-252b-4600-944f-0acd30cb3a65 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1723 microversion: 2.1 time: 0.241901 Sep 21 16:28:06.654465 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 383/683] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:06 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:28:06.727762 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-88c4d46b-b627-48d5-9acd-dba7b89e36b2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:06.728505 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-88c4d46b-b627-48d5-9acd-dba7b89e36b2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:06.735936 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-88c4d46b-b627-48d5-9acd-dba7b89e36b2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:06.737201 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-88c4d46b-b627-48d5-9acd-dba7b89e36b2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:06.737635 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-88c4d46b-b627-48d5-9acd-dba7b89e36b2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:06.738364 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-88c4d46b-b627-48d5-9acd-dba7b89e36b2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:06.738833 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-88c4d46b-b627-48d5-9acd-dba7b89e36b2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:06.739222 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-88c4d46b-b627-48d5-9acd-dba7b89e36b2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:06.761170 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:28:06.780714 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-f60b58a9-4e3c-42d8-aab3-d8e42decbfe2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:06.781372 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-f60b58a9-4e3c-42d8-aab3-d8e42decbfe2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:06.788687 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f60b58a9-4e3c-42d8-aab3-d8e42decbfe2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:06.789189 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f60b58a9-4e3c-42d8-aab3-d8e42decbfe2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:06.789631 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f60b58a9-4e3c-42d8-aab3-d8e42decbfe2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:06.790390 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f60b58a9-4e3c-42d8-aab3-d8e42decbfe2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:06.790838 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f60b58a9-4e3c-42d8-aab3-d8e42decbfe2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:06.791554 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f60b58a9-4e3c-42d8-aab3-d8e42decbfe2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:06.808097 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.wsgi [None req-f60b58a9-4e3c-42d8-aab3-d8e42decbfe2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] HTTP exception thrown: Instance 1c1436cc-a3f6-4683-abf2-e8835aa53021 could not be found. Sep 21 16:28:06.810158 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-f60b58a9-4e3c-42d8-aab3-d8e42decbfe2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Request method failure captured: Sep 21 16:28:06.810158 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: request: GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 HTTP/1.1 Sep 21 16:28:06.810158 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept: application/json Sep 21 16:28:06.810158 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept-Encoding: identity Sep 21 16:28:06.810158 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Connection: close Sep 21 16:28:06.810158 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Length: 0 Sep 21 16:28:06.810158 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Type: application/json Sep 21 16:28:06.810158 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Host: 10.222.0.64 Sep 21 16:28:06.810158 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Openstack-System-Scope: None Sep 21 16:28:06.810158 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: User-Agent: python-urllib3/1.26.12 Sep 21 16:28:06.810158 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Auth-Token: gAAAAABjKzpyHhR1ZSfzV-Xd9gOhE0QRKKSIaACmdxmP_TjVPq1jNWq-ZxVfgTb8GscS291dsfNu5pr9fywV7YolB84nDNYMNkwEma38_6kcNu8JKc0A8o_imeJm1RCLDwg__IUVG-9uJoUdWtszbRS3bK1Sv_YTQwl-H7luSNRLBDZz4uR3Q94 Sep 21 16:28:06.810158 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Id: None Sep 21 16:28:06.810158 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Name: None Sep 21 16:28:06.810158 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Identity-Status: Confirmed Sep 21 16:28:06.810158 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Is-Admin-Project: True Sep 21 16:28:06.810158 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Id: default Sep 21 16:28:06.810158 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Name: Default Sep 21 16:28:06.810158 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Id: 9c326adfa14149e5ae1d4eb45f4807b8 Sep 21 16:28:06.810158 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Name: tempest-AttachVolumeTestJSON-1198726165 Sep 21 16:28:06.810158 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Role: member,reader Sep 21 16:28:06.810158 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Roles: member,reader Sep 21 16:28:06.811440 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9c326adfa14149e5ae1d4eb45f4807b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9c326adfa14149e5ae1d4eb45f4807b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9c326adfa14149e5ae1d4eb45f4807b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9c326adfa14149e5ae1d4eb45f4807b8"}]}] Sep 21 16:28:06.811440 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant: tempest-AttachVolumeTestJSON-1198726165 Sep 21 16:28:06.811440 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Id: 9c326adfa14149e5ae1d4eb45f4807b8 Sep 21 16:28:06.811440 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1198726165 Sep 21 16:28:06.811440 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User: tempest-AttachVolumeTestJSON-1198726165-project Sep 21 16:28:06.811440 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Id: default Sep 21 16:28:06.811440 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Name: Default Sep 21 16:28:06.811440 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Id: 2e5204475ce7477f9cfeeffed457a445 Sep 21 16:28:06.811440 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Name: tempest-AttachVolumeTestJSON-1198726165-project Sep 21 16:28:06.811440 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: method: > Sep 21 16:28:06.811440 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: exception: Instance 1c1436cc-a3f6-4683-abf2-e8835aa53021 could not be found. Sep 21 16:28:06.811440 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: action_args: {'id': '1c1436cc-a3f6-4683-abf2-e8835aa53021'} Sep 21 16:28:06.814376 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:28:06.814376 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:28:06.814376 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 16:28:06.814376 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 16:28:06.814376 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 16:28:06.814376 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 16:28:06.814376 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 16:28:06.814376 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 16:28:06.814376 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 16:28:06.814376 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 16:28:06.814376 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c1436cc-a3f6-4683-abf2-e8835aa53021 could not be found. Sep 21 16:28:06.814376 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:28:06.814376 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:28:06.814376 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:28:06.814376 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:28:06.814376 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:28:06.814376 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:28:06.814376 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:28:06.814376 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:28:06.814376 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:28:06.815639 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:28:06.815639 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 16:28:06.815639 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 16:28:06.815639 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 16:28:06.815639 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 16:28:06.815639 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 16:28:06.815639 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:28:06.815639 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c1436cc-a3f6-4683-abf2-e8835aa53021 could not be found. Sep 21 16:28:06.815639 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:28:06.815639 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:28:06.815639 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:28:06.815639 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:28:06.815639 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:28:06.815639 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:28:06.815639 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:28:06.815639 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:28:06.815639 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c1436cc-a3f6-4683-abf2-e8835aa53021 could not be found. Sep 21 16:28:06.815639 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:28:06.816706 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-f60b58a9-4e3c-42d8-aab3-d8e42decbfe2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Returning 404 to user: Instance 1c1436cc-a3f6-4683-abf2-e8835aa53021 could not be found. {{(pid=120532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:28:06.816706 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-f60b58a9-4e3c-42d8-aab3-d8e42decbfe2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 404 len: 111 microversion: 2.1 time: 0.046156 Sep 21 16:28:06.816706 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 384/684] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:06 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 21 16:28:06.826394 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-43bbab18-4b3b-428c-9bfc-2274cf772696 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '.version_select at 0x7fdb88a2f160>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:06.849370 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-43bbab18-4b3b-428c-9bfc-2274cf772696 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1382118449" status: 202 len: 0 microversion: 2.1 time: 0.030022 Sep 21 16:28:06.849955 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 385/685] 10.222.0.64 () {58 vars in 1221 bytes} [Wed Sep 21 16:28:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1382118449 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 16:28:07.256252 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-88c4d46b-b627-48d5-9acd-dba7b89e36b2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:07.265875 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-88c4d46b-b627-48d5-9acd-dba7b89e36b2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:07.267348 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-88c4d46b-b627-48d5-9acd-dba7b89e36b2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:07.269288 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-88c4d46b-b627-48d5-9acd-dba7b89e36b2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1724 microversion: 2.20 time: 0.649637 Sep 21 16:28:07.270229 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 301/686] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:28:06 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1724 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 16:28:07.467004 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-3d428c58-8d5f-4978-9c12-84191164ff1f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Action: 'create', calling method: .version_select at 0x7fdb889c61f0>, body: {"keypair": {"name": "tempest-keypair-1619193929", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJntZA0TnBNuaugqyTgLjKOJf75A36jrHMntvgfqSsw6SQlypPEinnRYX5fohDS9h73OmZgnNqNOMH21Kxb+y5RP/LMu5zpWkBGdqqaawigjnSv3SptVGuaRC1wsdclqw=="}} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:28:07.485037 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.quota [None req-3d428c58-8d5f-4978-9c12-84191164ff1f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Getting quotas for project 9c326adfa14149e5ae1d4eb45f4807b8. Resources: {'key_pairs'} {{(pid=120532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 16:28:07.489249 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.quota [None req-3d428c58-8d5f-4978-9c12-84191164ff1f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Getting quotas for user 2e5204475ce7477f9cfeeffed457a445 and project 9c326adfa14149e5ae1d4eb45f4807b8. Resources: {'key_pairs'} {{(pid=120532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 16:28:07.514698 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-3d428c58-8d5f-4978-9c12-84191164ff1f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053686 Sep 21 16:28:07.515304 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 386/687] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Sep 21 16:28:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:28:07.679684 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-88fde38b-3ebb-446e-8392-d3bfbc070d29 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:07.681051 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-88fde38b-3ebb-446e-8392-d3bfbc070d29 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:07.689773 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-88fde38b-3ebb-446e-8392-d3bfbc070d29 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:07.690610 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-88fde38b-3ebb-446e-8392-d3bfbc070d29 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:07.691284 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-88fde38b-3ebb-446e-8392-d3bfbc070d29 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:07.692268 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-88fde38b-3ebb-446e-8392-d3bfbc070d29 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:07.692758 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-88fde38b-3ebb-446e-8392-d3bfbc070d29 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:07.693344 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-88fde38b-3ebb-446e-8392-d3bfbc070d29 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:08.296267 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-02b7cb4e-cb11-4899-9b6b-9ee83284cd80 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:08.297487 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-02b7cb4e-cb11-4899-9b6b-9ee83284cd80 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:08.303781 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-02b7cb4e-cb11-4899-9b6b-9ee83284cd80 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:08.304493 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-02b7cb4e-cb11-4899-9b6b-9ee83284cd80 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:08.305094 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-02b7cb4e-cb11-4899-9b6b-9ee83284cd80 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:08.306008 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-02b7cb4e-cb11-4899-9b6b-9ee83284cd80 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:08.306665 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-02b7cb4e-cb11-4899-9b6b-9ee83284cd80 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:08.307247 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-02b7cb4e-cb11-4899-9b6b-9ee83284cd80 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:08.495908 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-88fde38b-3ebb-446e-8392-d3bfbc070d29 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:08.511871 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-88fde38b-3ebb-446e-8392-d3bfbc070d29 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1723 microversion: 2.1 time: 0.838137 Sep 21 16:28:08.516001 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 302/688] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:07 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1723 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:28:08.530086 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-02b7cb4e-cb11-4899-9b6b-9ee83284cd80 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:08.543769 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-02b7cb4e-cb11-4899-9b6b-9ee83284cd80 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:08.552444 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-02b7cb4e-cb11-4899-9b6b-9ee83284cd80 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:08.554167 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-02b7cb4e-cb11-4899-9b6b-9ee83284cd80 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1724 microversion: 2.20 time: 0.261921 Sep 21 16:28:08.554719 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 387/689] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:28:08 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 16:28:08.885560 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-9398d30f-6f3b-4771-8bcb-aade0df6aa03 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-629462245", "imageRef": "600db436-ed6c-41b7-89f7-7dd31852a1a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "527f5b0e-37ca-4da6-8599-53723996567f"}], "security_groups": [{"name": "tempest-securitygroup--320610045"}], "key_name": "tempest-keypair-1619193929", "user_data": "}} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:28:09.016970 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-17230746-57d0-4689-a3c5-2863b8d08abd req-75faa813-2f6e-49f2-818f-f201e5238300 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f563aac-6055-4b77-b3bb-894ed14c1f64", "name": "network-vif-deleted", "tag": "252450c8-e7d3-467d-be6e-17b527b01bb8"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:28:09.027257 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-17230746-57d0-4689-a3c5-2863b8d08abd req-75faa813-2f6e-49f2-818f-f201e5238300 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:09.027940 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-17230746-57d0-4689-a3c5-2863b8d08abd req-75faa813-2f6e-49f2-818f-f201e5238300 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:09.028524 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-17230746-57d0-4689-a3c5-2863b8d08abd req-75faa813-2f6e-49f2-818f-f201e5238300 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:09.045857 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-17230746-57d0-4689-a3c5-2863b8d08abd req-75faa813-2f6e-49f2-818f-f201e5238300 service nova] Creating event network-vif-deleted:252450c8-e7d3-467d-be6e-17b527b01bb8 for instance 5f563aac-6055-4b77-b3bb-894ed14c1f64 on hv-cinder-85862 Sep 21 16:28:09.048405 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.network.neutron [None req-9398d30f-6f3b-4771-8bcb-aade0df6aa03 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] validate_networks() for [('527f5b0e-37ca-4da6-8599-53723996567f', None, None, None, None, None)] {{(pid=120531) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 16:28:09.050936 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-17230746-57d0-4689-a3c5-2863b8d08abd req-75faa813-2f6e-49f2-818f-f201e5238300 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037697 Sep 21 16:28:09.051545 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 388/690] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:28:09.486223 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-9398d30f-6f3b-4771-8bcb-aade0df6aa03 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Flavor limits 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 16:28:09.486575 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-9398d30f-6f3b-4771-8bcb-aade0df6aa03 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Image limits 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 16:28:09.487495 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-9398d30f-6f3b-4771-8bcb-aade0df6aa03 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Flavor pref 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 16:28:09.488331 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-9398d30f-6f3b-4771-8bcb-aade0df6aa03 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Image pref 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 16:28:09.489143 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-9398d30f-6f3b-4771-8bcb-aade0df6aa03 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 16:28:09.498889 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9398d30f-6f3b-4771-8bcb-aade0df6aa03 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:09.499520 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9398d30f-6f3b-4771-8bcb-aade0df6aa03 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:09.499928 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9398d30f-6f3b-4771-8bcb-aade0df6aa03 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:09.500751 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9398d30f-6f3b-4771-8bcb-aade0df6aa03 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:09.501452 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9398d30f-6f3b-4771-8bcb-aade0df6aa03 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:09.501788 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9398d30f-6f3b-4771-8bcb-aade0df6aa03 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:09.519683 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.quota [None req-9398d30f-6f3b-4771-8bcb-aade0df6aa03 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Getting quotas for project 9c326adfa14149e5ae1d4eb45f4807b8. Resources: {'cores', 'ram', 'instances'} {{(pid=120531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 16:28:09.524436 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.quota [None req-9398d30f-6f3b-4771-8bcb-aade0df6aa03 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Getting quotas for user 2e5204475ce7477f9cfeeffed457a445 and project 9c326adfa14149e5ae1d4eb45f4807b8. Resources: {'cores', 'ram', 'instances'} {{(pid=120531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 16:28:09.536006 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-9398d30f-6f3b-4771-8bcb-aade0df6aa03 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Going to run 1 instances... {{(pid=120531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 16:28:09.538935 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-9398d30f-6f3b-4771-8bcb-aade0df6aa03 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='600db436-ed6c-41b7-89f7-7dd31852a1a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 16:28:09.543548 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-a7d674ef-b01e-4e98-ace0-899352df581b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:09.544251 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-a7d674ef-b01e-4e98-ace0-899352df581b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:09.552209 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a7d674ef-b01e-4e98-ace0-899352df581b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:09.552777 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a7d674ef-b01e-4e98-ace0-899352df581b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:09.553047 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a7d674ef-b01e-4e98-ace0-899352df581b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:09.553743 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a7d674ef-b01e-4e98-ace0-899352df581b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:09.554245 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a7d674ef-b01e-4e98-ace0-899352df581b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:09.554676 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a7d674ef-b01e-4e98-ace0-899352df581b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:09.592922 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-9398d30f-6f3b-4771-8bcb-aade0df6aa03 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.712062 Sep 21 16:28:09.600788 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 303/691] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Sep 21 16:28:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 21 16:28:09.600788 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-62695b96-33ae-44c0-a911-5e400510433d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:09.600788 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-62695b96-33ae-44c0-a911-5e400510433d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:09.609355 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-62695b96-33ae-44c0-a911-5e400510433d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:09.609844 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-62695b96-33ae-44c0-a911-5e400510433d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:09.610317 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-62695b96-33ae-44c0-a911-5e400510433d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:09.611030 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-62695b96-33ae-44c0-a911-5e400510433d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:09.611479 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-62695b96-33ae-44c0-a911-5e400510433d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:09.611896 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-62695b96-33ae-44c0-a911-5e400510433d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:09.702034 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-62695b96-33ae-44c0-a911-5e400510433d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:09.714889 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-62695b96-33ae-44c0-a911-5e400510433d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:09.717294 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-62695b96-33ae-44c0-a911-5e400510433d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:09.719477 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-62695b96-33ae-44c0-a911-5e400510433d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1657 microversion: 2.20 time: 0.124269 Sep 21 16:28:09.720081 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 304/692] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:28:09 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1657 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:28:09.735290 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a7d674ef-b01e-4e98-ace0-899352df581b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:09.736141 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-52825052-4917-4eaa-9c18-8b857d76dd5f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:09.736141 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-52825052-4917-4eaa-9c18-8b857d76dd5f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:09.746364 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-a7d674ef-b01e-4e98-ace0-899352df581b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1723 microversion: 2.1 time: 0.207991 Sep 21 16:28:09.750566 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 389/693] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:09 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:28:09.788991 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-52825052-4917-4eaa-9c18-8b857d76dd5f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:09.796328 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-52825052-4917-4eaa-9c18-8b857d76dd5f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079" status: 200 len: 1237 microversion: 2.1 time: 0.075130 Sep 21 16:28:09.797261 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 305/694] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:09 2022] GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079 => generated 1237 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:28:10.748821 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-e3e7fa4d-2863-4712-991b-41019fa0a99a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:10.749422 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-e3e7fa4d-2863-4712-991b-41019fa0a99a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:10.756025 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e3e7fa4d-2863-4712-991b-41019fa0a99a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:10.756502 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e3e7fa4d-2863-4712-991b-41019fa0a99a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:10.756929 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e3e7fa4d-2863-4712-991b-41019fa0a99a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:10.757611 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e3e7fa4d-2863-4712-991b-41019fa0a99a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:10.758073 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e3e7fa4d-2863-4712-991b-41019fa0a99a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:10.758498 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e3e7fa4d-2863-4712-991b-41019fa0a99a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:10.777144 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-052e2d39-aa58-4b86-a6cf-90b152c87f01 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:10.777758 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-052e2d39-aa58-4b86-a6cf-90b152c87f01 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:10.784674 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-052e2d39-aa58-4b86-a6cf-90b152c87f01 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:10.785176 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-052e2d39-aa58-4b86-a6cf-90b152c87f01 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:10.785615 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-052e2d39-aa58-4b86-a6cf-90b152c87f01 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:10.786705 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-052e2d39-aa58-4b86-a6cf-90b152c87f01 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:10.786819 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-052e2d39-aa58-4b86-a6cf-90b152c87f01 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:10.787215 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-052e2d39-aa58-4b86-a6cf-90b152c87f01 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:10.790517 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e3e7fa4d-2863-4712-991b-41019fa0a99a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:10.790998 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e3e7fa4d-2863-4712-991b-41019fa0a99a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:10.791424 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e3e7fa4d-2863-4712-991b-41019fa0a99a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:10.791865 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.objects.instance [None req-e3e7fa4d-2863-4712-991b-41019fa0a99a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lazy-loading 'fault' on Instance uuid 5f563aac-6055-4b77-b3bb-894ed14c1f64 {{(pid=120532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 16:28:10.794695 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=100 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:28:10.833015 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-e3e7fa4d-2863-4712-991b-41019fa0a99a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:10.841711 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-e3e7fa4d-2863-4712-991b-41019fa0a99a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:10.843180 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-e3e7fa4d-2863-4712-991b-41019fa0a99a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:10.844321 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-e3e7fa4d-2863-4712-991b-41019fa0a99a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1371 microversion: 2.20 time: 0.099429 Sep 21 16:28:10.844882 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 390/695] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:28:10 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:28:10.849348 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c64f23e0-7bc7-4d00-8df6-3d5b2fdc119a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:10.849948 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-c64f23e0-7bc7-4d00-8df6-3d5b2fdc119a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:10.856709 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c64f23e0-7bc7-4d00-8df6-3d5b2fdc119a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:10.857192 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c64f23e0-7bc7-4d00-8df6-3d5b2fdc119a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:10.857616 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c64f23e0-7bc7-4d00-8df6-3d5b2fdc119a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:10.858324 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c64f23e0-7bc7-4d00-8df6-3d5b2fdc119a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:10.858777 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c64f23e0-7bc7-4d00-8df6-3d5b2fdc119a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:10.859359 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c64f23e0-7bc7-4d00-8df6-3d5b2fdc119a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:10.919583 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-052e2d39-aa58-4b86-a6cf-90b152c87f01 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:10.921845 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-c64f23e0-7bc7-4d00-8df6-3d5b2fdc119a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:10.930072 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-052e2d39-aa58-4b86-a6cf-90b152c87f01 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1723 microversion: 2.1 time: 0.156588 Sep 21 16:28:10.930670 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 306/696] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:10 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:28:10.930787 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-c64f23e0-7bc7-4d00-8df6-3d5b2fdc119a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079" status: 200 len: 1233 microversion: 2.1 time: 0.084537 Sep 21 16:28:10.931239 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 391/697] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:10 2022] GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079 => generated 1233 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:28:11.870672 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-e535460c-25f0-4ee0-9009-22f8149f123c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:11.871305 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-e535460c-25f0-4ee0-9009-22f8149f123c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:11.877395 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e535460c-25f0-4ee0-9009-22f8149f123c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:11.877874 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e535460c-25f0-4ee0-9009-22f8149f123c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:11.878333 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e535460c-25f0-4ee0-9009-22f8149f123c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:11.879020 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e535460c-25f0-4ee0-9009-22f8149f123c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:11.879560 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e535460c-25f0-4ee0-9009-22f8149f123c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:11.879889 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e535460c-25f0-4ee0-9009-22f8149f123c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:11.910136 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e535460c-25f0-4ee0-9009-22f8149f123c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:11.910613 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e535460c-25f0-4ee0-9009-22f8149f123c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:11.911052 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e535460c-25f0-4ee0-9009-22f8149f123c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:11.911494 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.objects.instance [None req-e535460c-25f0-4ee0-9009-22f8149f123c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lazy-loading 'fault' on Instance uuid 5f563aac-6055-4b77-b3bb-894ed14c1f64 {{(pid=120531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 16:28:11.952798 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-f3415aa0-38a0-4fbc-b7de-a0ee4ac94adf tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:11.953396 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-f3415aa0-38a0-4fbc-b7de-a0ee4ac94adf tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:11.955586 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-e535460c-25f0-4ee0-9009-22f8149f123c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:11.959930 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f3415aa0-38a0-4fbc-b7de-a0ee4ac94adf tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:11.960641 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f3415aa0-38a0-4fbc-b7de-a0ee4ac94adf tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:11.961085 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f3415aa0-38a0-4fbc-b7de-a0ee4ac94adf tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:11.962004 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f3415aa0-38a0-4fbc-b7de-a0ee4ac94adf tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:11.962479 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f3415aa0-38a0-4fbc-b7de-a0ee4ac94adf tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:11.962900 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f3415aa0-38a0-4fbc-b7de-a0ee4ac94adf tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:11.964072 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-e535460c-25f0-4ee0-9009-22f8149f123c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:11.965520 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-e535460c-25f0-4ee0-9009-22f8149f123c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:11.966788 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-e535460c-25f0-4ee0-9009-22f8149f123c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 200 len: 1371 microversion: 2.20 time: 0.100872 Sep 21 16:28:11.967343 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 307/698] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:28:11 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 1371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:28:11.982020 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-fe741411-7858-4a3a-87fc-a86c7846cf1c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:11.982665 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-fe741411-7858-4a3a-87fc-a86c7846cf1c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:11.988943 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fe741411-7858-4a3a-87fc-a86c7846cf1c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:11.989476 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fe741411-7858-4a3a-87fc-a86c7846cf1c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:11.989861 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fe741411-7858-4a3a-87fc-a86c7846cf1c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:11.990642 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fe741411-7858-4a3a-87fc-a86c7846cf1c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:11.991702 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fe741411-7858-4a3a-87fc-a86c7846cf1c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:11.992145 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fe741411-7858-4a3a-87fc-a86c7846cf1c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:12.060712 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-fe741411-7858-4a3a-87fc-a86c7846cf1c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:12.068813 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-fe741411-7858-4a3a-87fc-a86c7846cf1c tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079" status: 200 len: 1233 microversion: 2.1 time: 0.100435 Sep 21 16:28:12.069440 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 308/699] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:11 2022] GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079 => generated 1233 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:28:12.103484 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-f3415aa0-38a0-4fbc-b7de-a0ee4ac94adf tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:12.111638 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-f3415aa0-38a0-4fbc-b7de-a0ee4ac94adf tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1729 microversion: 2.1 time: 0.162766 Sep 21 16:28:12.112204 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 392/700] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:11 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:28:12.136540 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-476ae30e-7f8a-47e1-8cfb-cc0ded4e6ecb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:12.137208 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-476ae30e-7f8a-47e1-8cfb-cc0ded4e6ecb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:12.143430 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-476ae30e-7f8a-47e1-8cfb-cc0ded4e6ecb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:12.143910 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-476ae30e-7f8a-47e1-8cfb-cc0ded4e6ecb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:12.144349 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-476ae30e-7f8a-47e1-8cfb-cc0ded4e6ecb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:12.145043 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-476ae30e-7f8a-47e1-8cfb-cc0ded4e6ecb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:12.145495 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-476ae30e-7f8a-47e1-8cfb-cc0ded4e6ecb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:12.145915 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-476ae30e-7f8a-47e1-8cfb-cc0ded4e6ecb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:12.233148 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-476ae30e-7f8a-47e1-8cfb-cc0ded4e6ecb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102214 Sep 21 16:28:12.233757 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 309/701] 10.222.0.64 () {58 vars in 1275 bytes} [Wed Sep 21 16:28:12 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:28:12.995436 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-831f9574-8275-4aa4-8b5c-3c2bb036c04c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:12.996793 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-831f9574-8275-4aa4-8b5c-3c2bb036c04c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:13.007985 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-831f9574-8275-4aa4-8b5c-3c2bb036c04c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:13.008489 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-831f9574-8275-4aa4-8b5c-3c2bb036c04c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:13.009011 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-831f9574-8275-4aa4-8b5c-3c2bb036c04c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:13.009816 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-831f9574-8275-4aa4-8b5c-3c2bb036c04c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:13.010333 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-831f9574-8275-4aa4-8b5c-3c2bb036c04c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:13.010761 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-831f9574-8275-4aa4-8b5c-3c2bb036c04c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:13.027434 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.wsgi [None req-831f9574-8275-4aa4-8b5c-3c2bb036c04c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] HTTP exception thrown: Instance 5f563aac-6055-4b77-b3bb-894ed14c1f64 could not be found. Sep 21 16:28:13.030383 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-831f9574-8275-4aa4-8b5c-3c2bb036c04c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Request method failure captured: Sep 21 16:28:13.030383 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: request: GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 HTTP/1.1 Sep 21 16:28:13.030383 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept: application/json Sep 21 16:28:13.030383 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept-Encoding: identity Sep 21 16:28:13.030383 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Connection: close Sep 21 16:28:13.030383 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Length: 0 Sep 21 16:28:13.030383 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Type: application/json Sep 21 16:28:13.030383 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Host: 10.222.0.64 Sep 21 16:28:13.030383 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Openstack-System-Scope: None Sep 21 16:28:13.030383 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: User-Agent: python-urllib3/1.26.12 Sep 21 16:28:13.030383 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Auth-Token: gAAAAABjKzpqPBT9879oc0XSJnJap7p41i_60pHiJENRMZl-PZirxwim_ebnw2XcMHKvSgxpcv31VHIVan9f1aCkt8BDYV4z0cBUUXoXF0uRY5nRP5uTVkq64HJZZEe_LwK2VKjDxMjCmXOPhdoJVam9hGiP6D01aY06753BFjDEdtusFimRGBw Sep 21 16:28:13.030383 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Id: None Sep 21 16:28:13.030383 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Name: None Sep 21 16:28:13.030383 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Identity-Status: Confirmed Sep 21 16:28:13.030383 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Is-Admin-Project: True Sep 21 16:28:13.030383 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Openstack-Nova-Api-Version: 2.20 Sep 21 16:28:13.030383 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Id: default Sep 21 16:28:13.030383 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Name: Default Sep 21 16:28:13.030383 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Id: 0d61f0fe37cf4dc0ba6a2415ddf14518 Sep 21 16:28:13.030383 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1341530899 Sep 21 16:28:13.030383 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Role: member,reader Sep 21 16:28:13.030383 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Roles: member,reader Sep 21 16:28:13.031929 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0d61f0fe37cf4dc0ba6a2415ddf14518"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0d61f0fe37cf4dc0ba6a2415ddf14518"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0d61f0fe37cf4dc0ba6a2415ddf14518"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0d61f0fe37cf4dc0ba6a2415ddf14518"}]}] Sep 21 16:28:13.031929 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1341530899 Sep 21 16:28:13.031929 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Id: 0d61f0fe37cf4dc0ba6a2415ddf14518 Sep 21 16:28:13.031929 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1341530899 Sep 21 16:28:13.031929 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User: tempest-AttachVolumeShelveTestJSON-1341530899-project Sep 21 16:28:13.031929 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Id: default Sep 21 16:28:13.031929 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Name: Default Sep 21 16:28:13.031929 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Id: 617ba5f9896b457f8182f760ed44aa58 Sep 21 16:28:13.031929 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1341530899-project Sep 21 16:28:13.031929 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: method: > Sep 21 16:28:13.031929 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: exception: Instance 5f563aac-6055-4b77-b3bb-894ed14c1f64 could not be found. Sep 21 16:28:13.031929 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: action_args: {'id': '5f563aac-6055-4b77-b3bb-894ed14c1f64'} Sep 21 16:28:13.032792 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:28:13.032792 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:28:13.032792 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 16:28:13.032792 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 16:28:13.032792 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 16:28:13.032792 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 16:28:13.032792 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 16:28:13.032792 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 16:28:13.032792 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 16:28:13.032792 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 16:28:13.032792 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f563aac-6055-4b77-b3bb-894ed14c1f64 could not be found. Sep 21 16:28:13.032792 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:28:13.032792 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:28:13.032792 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:28:13.032792 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:28:13.032792 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:28:13.032792 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:28:13.032792 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:28:13.032792 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:28:13.032792 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:28:13.034005 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:28:13.034005 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 16:28:13.034005 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 16:28:13.034005 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 16:28:13.034005 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 16:28:13.034005 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 16:28:13.034005 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:28:13.034005 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f563aac-6055-4b77-b3bb-894ed14c1f64 could not be found. Sep 21 16:28:13.034005 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:28:13.034005 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:28:13.034005 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:28:13.034005 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:28:13.034005 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:28:13.034005 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:28:13.034005 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:28:13.034005 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:28:13.034005 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f563aac-6055-4b77-b3bb-894ed14c1f64 could not be found. Sep 21 16:28:13.034005 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:28:13.036593 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-831f9574-8275-4aa4-8b5c-3c2bb036c04c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Returning 404 to user: Instance 5f563aac-6055-4b77-b3bb-894ed14c1f64 could not be found. {{(pid=120532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:28:13.037687 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-831f9574-8275-4aa4-8b5c-3c2bb036c04c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 404 len: 111 microversion: 2.20 time: 0.049309 Sep 21 16:28:13.038652 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 393/702] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:28:12 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 21 16:28:13.047258 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-4baf4381-2966-43bb-b7a4-ffe3a6a5bcb4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '.version_select at 0x7fdb88abeaf0>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:13.080406 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-4baf4381-2966-43bb-b7a4-ffe3a6a5bcb4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1639095373" status: 204 len: 0 microversion: 2.20 time: 0.037152 Sep 21 16:28:13.081141 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 310/703] 10.222.0.64 () {60 vars in 1262 bytes} [Wed Sep 21 16:28:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1639095373 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 21 16:28:13.091532 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-fc7a80c4-9306-484c-8035-3ecfbbc94328 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:13.092390 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-fc7a80c4-9306-484c-8035-3ecfbbc94328 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:13.099446 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fc7a80c4-9306-484c-8035-3ecfbbc94328 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:13.100215 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fc7a80c4-9306-484c-8035-3ecfbbc94328 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:13.100803 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fc7a80c4-9306-484c-8035-3ecfbbc94328 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:13.101681 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fc7a80c4-9306-484c-8035-3ecfbbc94328 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:13.102323 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fc7a80c4-9306-484c-8035-3ecfbbc94328 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:13.102917 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fc7a80c4-9306-484c-8035-3ecfbbc94328 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:13.182365 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-fc7a80c4-9306-484c-8035-3ecfbbc94328 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:13.191247 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-fc7a80c4-9306-484c-8035-3ecfbbc94328 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079" status: 200 len: 1295 microversion: 2.1 time: 0.103529 Sep 21 16:28:13.192041 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 394/704] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:13 2022] GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079 => generated 1295 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:28:13.409475 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-71691586-77f6-4c3e-88f7-eb7c694512a0 req-b11303d7-a437-45c1-9604-963f497a5ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c95f478c-11b2-4097-b4b1-551d61fa9664", "tag": "7cbba0ad-56a3-429e-97a5-3e5eae0b9c40"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:28:13.421415 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-71691586-77f6-4c3e-88f7-eb7c694512a0 req-b11303d7-a437-45c1-9604-963f497a5ed8 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:13.422321 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-71691586-77f6-4c3e-88f7-eb7c694512a0 req-b11303d7-a437-45c1-9604-963f497a5ed8 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:13.422987 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-71691586-77f6-4c3e-88f7-eb7c694512a0 req-b11303d7-a437-45c1-9604-963f497a5ed8 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:13.434859 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-71691586-77f6-4c3e-88f7-eb7c694512a0 req-b11303d7-a437-45c1-9604-963f497a5ed8 service nova] Creating event network-changed:7cbba0ad-56a3-429e-97a5-3e5eae0b9c40 for instance c95f478c-11b2-4097-b4b1-551d61fa9664 on hv-cinder-85862 Sep 21 16:28:13.442422 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-71691586-77f6-4c3e-88f7-eb7c694512a0 req-b11303d7-a437-45c1-9604-963f497a5ed8 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036500 Sep 21 16:28:13.443398 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 311/705] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:28:14.214818 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-8511ed27-dcff-4194-be99-e5841debc8ac tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:14.215429 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-8511ed27-dcff-4194-be99-e5841debc8ac tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:14.222222 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8511ed27-dcff-4194-be99-e5841debc8ac tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:14.222839 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8511ed27-dcff-4194-be99-e5841debc8ac tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:14.223361 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8511ed27-dcff-4194-be99-e5841debc8ac tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:14.224141 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8511ed27-dcff-4194-be99-e5841debc8ac tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:14.224686 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8511ed27-dcff-4194-be99-e5841debc8ac tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:14.225405 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8511ed27-dcff-4194-be99-e5841debc8ac tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:14.294376 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-8511ed27-dcff-4194-be99-e5841debc8ac tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:14.302135 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-8511ed27-dcff-4194-be99-e5841debc8ac tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079" status: 200 len: 1295 microversion: 2.1 time: 0.091036 Sep 21 16:28:14.302703 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 395/706] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:14 2022] GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079 => generated 1295 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:28:14.829087 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-91ed6d7d-2b29-4216-a5ec-d8cd01aa35e7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Action: 'create', calling method: .version_select at 0x7fdb88bfd5e0>, body: {"keypair": {"name": "tempest-keypair-1849809654", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmXeue6tCguLgNBtEON1ebECnRep3NkFgBfoqMPo7x2SXB6aFUK3ViBPv+G6iKtsA51otUNrT5lggOEpIW0UIoa/+WlVcq2IvfSISpTSMjx7uF0HcW5yVcjyyFi1RHfuA=="}} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:28:14.848853 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.quota [None req-91ed6d7d-2b29-4216-a5ec-d8cd01aa35e7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Getting quotas for project 0d61f0fe37cf4dc0ba6a2415ddf14518. Resources: {'key_pairs'} {{(pid=120531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 16:28:14.854225 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.quota [None req-91ed6d7d-2b29-4216-a5ec-d8cd01aa35e7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Getting quotas for user 617ba5f9896b457f8182f760ed44aa58 and project 0d61f0fe37cf4dc0ba6a2415ddf14518. Resources: {'key_pairs'} {{(pid=120531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 16:28:14.880146 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-91ed6d7d-2b29-4216-a5ec-d8cd01aa35e7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.056512 Sep 21 16:28:14.881090 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 312/707] 10.222.0.64 () {62 vars in 1200 bytes} [Wed Sep 21 16:28:14 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 58 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 21 16:28:15.325954 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-a0226259-a404-4e3e-a6b5-679e6e903875 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:15.326653 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-a0226259-a404-4e3e-a6b5-679e6e903875 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:15.333540 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a0226259-a404-4e3e-a6b5-679e6e903875 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:15.334034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a0226259-a404-4e3e-a6b5-679e6e903875 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:15.337500 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a0226259-a404-4e3e-a6b5-679e6e903875 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:15.337500 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a0226259-a404-4e3e-a6b5-679e6e903875 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:15.337500 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a0226259-a404-4e3e-a6b5-679e6e903875 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:15.337500 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a0226259-a404-4e3e-a6b5-679e6e903875 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:15.462248 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-81fa288e-e866-40e7-acc6-a01d732dd38f req-157ea042-48ec-4652-b33e-e7f319e6f51b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c95f478c-11b2-4097-b4b1-551d61fa9664", "tag": "7cbba0ad-56a3-429e-97a5-3e5eae0b9c40"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:28:15.474202 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-81fa288e-e866-40e7-acc6-a01d732dd38f req-157ea042-48ec-4652-b33e-e7f319e6f51b service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:15.475274 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-81fa288e-e866-40e7-acc6-a01d732dd38f req-157ea042-48ec-4652-b33e-e7f319e6f51b service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:15.475904 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-81fa288e-e866-40e7-acc6-a01d732dd38f req-157ea042-48ec-4652-b33e-e7f319e6f51b service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:15.495295 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-81fa288e-e866-40e7-acc6-a01d732dd38f req-157ea042-48ec-4652-b33e-e7f319e6f51b service nova] Creating event network-changed:7cbba0ad-56a3-429e-97a5-3e5eae0b9c40 for instance c95f478c-11b2-4097-b4b1-551d61fa9664 on hv-cinder-85862 Sep 21 16:28:15.498913 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a0226259-a404-4e3e-a6b5-679e6e903875 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:15.504001 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-81fa288e-e866-40e7-acc6-a01d732dd38f req-157ea042-48ec-4652-b33e-e7f319e6f51b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045509 Sep 21 16:28:15.506210 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 313/708] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:28:15.512419 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-a0226259-a404-4e3e-a6b5-679e6e903875 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079" status: 200 len: 1362 microversion: 2.1 time: 0.190536 Sep 21 16:28:15.527486 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 396/709] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:15 2022] GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079 => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:28:16.168988 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-5c62d295-cc97-47d3-b0ec-71a77e8f6a72 req-b50fd028-d3ba-42ea-bf7b-a3d7a091ce6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68300698-35cc-4b4c-8046-7d1ce02c0079", "tag": "0fb5904a-0991-4b4f-b361-c14b24d2bc04"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:28:16.181143 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-5c62d295-cc97-47d3-b0ec-71a77e8f6a72 req-b50fd028-d3ba-42ea-bf7b-a3d7a091ce6c service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:16.181773 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-5c62d295-cc97-47d3-b0ec-71a77e8f6a72 req-b50fd028-d3ba-42ea-bf7b-a3d7a091ce6c service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:16.182038 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-5c62d295-cc97-47d3-b0ec-71a77e8f6a72 req-b50fd028-d3ba-42ea-bf7b-a3d7a091ce6c service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:16.194430 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-5c62d295-cc97-47d3-b0ec-71a77e8f6a72 req-b50fd028-d3ba-42ea-bf7b-a3d7a091ce6c service nova] Creating event network-changed:0fb5904a-0991-4b4f-b361-c14b24d2bc04 for instance 68300698-35cc-4b4c-8046-7d1ce02c0079 on hv-cinder-85862 Sep 21 16:28:16.199133 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-5c62d295-cc97-47d3-b0ec-71a77e8f6a72 req-b50fd028-d3ba-42ea-bf7b-a3d7a091ce6c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036302 Sep 21 16:28:16.199732 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 314/710] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:28:16.595360 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-36d9b223-8bd6-474a-b303-2124ca982f95 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:16.596063 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-36d9b223-8bd6-474a-b303-2124ca982f95 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:16.602200 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-36d9b223-8bd6-474a-b303-2124ca982f95 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:16.602787 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-36d9b223-8bd6-474a-b303-2124ca982f95 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:16.603292 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-36d9b223-8bd6-474a-b303-2124ca982f95 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:16.604061 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-36d9b223-8bd6-474a-b303-2124ca982f95 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:16.604591 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-36d9b223-8bd6-474a-b303-2124ca982f95 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:16.605091 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-36d9b223-8bd6-474a-b303-2124ca982f95 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:16.737944 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-36d9b223-8bd6-474a-b303-2124ca982f95 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:16.746362 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-36d9b223-8bd6-474a-b303-2124ca982f95 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079" status: 200 len: 1362 microversion: 2.1 time: 0.212826 Sep 21 16:28:16.747050 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 397/711] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:16 2022] GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079 => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:28:17.560929 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-b68f64c5-1992-437f-97ed-595869b6e6c6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-390881337", "imageRef": "600db436-ed6c-41b7-89f7-7dd31852a1a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6f1a14e1-0882-4675-b49d-c15411eec58b"}], "security_groups": [{"name": "tempest-securitygroup--11324675"}], "key_name": "tempest-keypair-1849809654", "user_data": "}} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:28:17.671896 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.network.neutron [None req-b68f64c5-1992-437f-97ed-595869b6e6c6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] validate_networks() for [('6f1a14e1-0882-4675-b49d-c15411eec58b', None, None, None, None, None)] {{(pid=120531) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 16:28:17.769323 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-6b5eecab-8940-47de-aff8-0f94a47ec048 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:17.769959 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-6b5eecab-8940-47de-aff8-0f94a47ec048 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:17.772661 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell0:SELECT=4 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:28:17.779076 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6b5eecab-8940-47de-aff8-0f94a47ec048 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:17.779580 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6b5eecab-8940-47de-aff8-0f94a47ec048 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:17.780018 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6b5eecab-8940-47de-aff8-0f94a47ec048 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:17.780736 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6b5eecab-8940-47de-aff8-0f94a47ec048 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:17.781187 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6b5eecab-8940-47de-aff8-0f94a47ec048 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:17.781614 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6b5eecab-8940-47de-aff8-0f94a47ec048 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:17.921546 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-6b5eecab-8940-47de-aff8-0f94a47ec048 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:17.929834 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-6b5eecab-8940-47de-aff8-0f94a47ec048 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079" status: 200 len: 1362 microversion: 2.1 time: 0.164382 Sep 21 16:28:17.930461 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 398/712] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:17 2022] GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:28:18.102226 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-b68f64c5-1992-437f-97ed-595869b6e6c6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Flavor limits 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 16:28:18.102644 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-b68f64c5-1992-437f-97ed-595869b6e6c6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Image limits 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 16:28:18.103109 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-b68f64c5-1992-437f-97ed-595869b6e6c6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Flavor pref 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 16:28:18.103518 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-b68f64c5-1992-437f-97ed-595869b6e6c6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Image pref 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 16:28:18.103953 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-b68f64c5-1992-437f-97ed-595869b6e6c6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 16:28:18.112611 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b68f64c5-1992-437f-97ed-595869b6e6c6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:18.113081 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b68f64c5-1992-437f-97ed-595869b6e6c6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:18.113505 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b68f64c5-1992-437f-97ed-595869b6e6c6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:18.114278 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b68f64c5-1992-437f-97ed-595869b6e6c6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:18.114725 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b68f64c5-1992-437f-97ed-595869b6e6c6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:18.115140 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b68f64c5-1992-437f-97ed-595869b6e6c6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:18.131763 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.quota [None req-b68f64c5-1992-437f-97ed-595869b6e6c6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Getting quotas for project 0d61f0fe37cf4dc0ba6a2415ddf14518. Resources: {'cores', 'ram', 'instances'} {{(pid=120531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 16:28:18.136747 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.quota [None req-b68f64c5-1992-437f-97ed-595869b6e6c6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Getting quotas for user 617ba5f9896b457f8182f760ed44aa58 and project 0d61f0fe37cf4dc0ba6a2415ddf14518. Resources: {'cores', 'ram', 'instances'} {{(pid=120531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 16:28:18.150930 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-b68f64c5-1992-437f-97ed-595869b6e6c6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Going to run 1 instances... {{(pid=120531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 16:28:18.153289 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-b68f64c5-1992-437f-97ed-595869b6e6c6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='600db436-ed6c-41b7-89f7-7dd31852a1a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 16:28:18.200413 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-b68f64c5-1992-437f-97ed-595869b6e6c6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.644129 Sep 21 16:28:18.201058 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 315/713] 10.222.0.64 () {62 vars in 1188 bytes} [Wed Sep 21 16:28:17 2022] POST /compute/v2.1/servers => generated 400 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 21 16:28:18.211972 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-2d8a0c8f-6ae7-46ae-8604-607fc4f6b43f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:18.212568 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-2d8a0c8f-6ae7-46ae-8604-607fc4f6b43f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:18.268855 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-2d8a0c8f-6ae7-46ae-8604-607fc4f6b43f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:18.276421 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-2d8a0c8f-6ae7-46ae-8604-607fc4f6b43f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:18.277859 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-2d8a0c8f-6ae7-46ae-8604-607fc4f6b43f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:18.279278 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-2d8a0c8f-6ae7-46ae-8604-607fc4f6b43f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1281 microversion: 2.20 time: 0.070893 Sep 21 16:28:18.279767 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 399/714] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:28:18 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1281 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:28:18.953444 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-88cf348a-9bd6-43b1-842f-7560e7da9302 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:18.954142 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-88cf348a-9bd6-43b1-842f-7560e7da9302 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:18.963279 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-88cf348a-9bd6-43b1-842f-7560e7da9302 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:18.963760 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-88cf348a-9bd6-43b1-842f-7560e7da9302 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:18.964206 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-88cf348a-9bd6-43b1-842f-7560e7da9302 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:18.964910 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-88cf348a-9bd6-43b1-842f-7560e7da9302 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:18.965367 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-88cf348a-9bd6-43b1-842f-7560e7da9302 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:18.965788 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-88cf348a-9bd6-43b1-842f-7560e7da9302 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:19.117331 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-88cf348a-9bd6-43b1-842f-7560e7da9302 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:19.125415 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-88cf348a-9bd6-43b1-842f-7560e7da9302 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079" status: 200 len: 1362 microversion: 2.1 time: 0.176505 Sep 21 16:28:19.125983 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 316/715] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:18 2022] GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:28:19.303859 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-8255b071-77b6-4789-adee-e1fc0f39a7bb tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:19.304500 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-8255b071-77b6-4789-adee-e1fc0f39a7bb tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:19.311197 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8255b071-77b6-4789-adee-e1fc0f39a7bb tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:19.311685 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8255b071-77b6-4789-adee-e1fc0f39a7bb tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:19.312120 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8255b071-77b6-4789-adee-e1fc0f39a7bb tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:19.312816 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8255b071-77b6-4789-adee-e1fc0f39a7bb tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:19.313274 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8255b071-77b6-4789-adee-e1fc0f39a7bb tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:19.313698 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8255b071-77b6-4789-adee-e1fc0f39a7bb tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:19.374210 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-8255b071-77b6-4789-adee-e1fc0f39a7bb tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:19.382794 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-8255b071-77b6-4789-adee-e1fc0f39a7bb tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:19.384254 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-8255b071-77b6-4789-adee-e1fc0f39a7bb tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:19.385334 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-8255b071-77b6-4789-adee-e1fc0f39a7bb tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1333 microversion: 2.20 time: 0.085343 Sep 21 16:28:19.385904 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 400/716] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:28:19 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1333 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:28:20.150631 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-1e2a372b-e1cb-4c64-840d-1731e07957d0 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:20.151870 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-1e2a372b-e1cb-4c64-840d-1731e07957d0 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:20.164223 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1e2a372b-e1cb-4c64-840d-1731e07957d0 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:20.164223 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1e2a372b-e1cb-4c64-840d-1731e07957d0 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:20.164223 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1e2a372b-e1cb-4c64-840d-1731e07957d0 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:20.164223 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1e2a372b-e1cb-4c64-840d-1731e07957d0 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:20.164697 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1e2a372b-e1cb-4c64-840d-1731e07957d0 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:20.164697 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1e2a372b-e1cb-4c64-840d-1731e07957d0 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:20.374657 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-1e2a372b-e1cb-4c64-840d-1731e07957d0 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:20.383983 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-1e2a372b-e1cb-4c64-840d-1731e07957d0 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079" status: 200 len: 1362 microversion: 2.1 time: 0.238876 Sep 21 16:28:20.398338 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 317/717] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:20 2022] GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079 => generated 1362 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:28:20.415059 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-9e2ec911-8108-4821-a35f-d650ae34cdb9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:20.416590 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-9e2ec911-8108-4821-a35f-d650ae34cdb9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:20.424031 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9e2ec911-8108-4821-a35f-d650ae34cdb9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:20.424547 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9e2ec911-8108-4821-a35f-d650ae34cdb9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:20.425453 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9e2ec911-8108-4821-a35f-d650ae34cdb9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:20.425723 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9e2ec911-8108-4821-a35f-d650ae34cdb9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:20.426229 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9e2ec911-8108-4821-a35f-d650ae34cdb9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:20.426844 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9e2ec911-8108-4821-a35f-d650ae34cdb9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:20.585601 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-9e2ec911-8108-4821-a35f-d650ae34cdb9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:20.594067 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-9e2ec911-8108-4821-a35f-d650ae34cdb9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:20.595593 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-9e2ec911-8108-4821-a35f-d650ae34cdb9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:20.596777 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-9e2ec911-8108-4821-a35f-d650ae34cdb9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1405 microversion: 2.20 time: 0.189263 Sep 21 16:28:20.597413 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 401/718] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:28:20 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1405 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:28:21.140897 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-3b0abf0f-14bc-418b-a80c-5b89760f2a35 req-4dd7bbe4-db4d-4fab-ad76-51eaeaaaca1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce59fd53-2d4c-477e-8326-672737e561f5", "tag": "5abd346c-df9c-4cb2-b976-8f9adc822383"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:28:21.153005 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-3b0abf0f-14bc-418b-a80c-5b89760f2a35 req-4dd7bbe4-db4d-4fab-ad76-51eaeaaaca1c service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:21.153675 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-3b0abf0f-14bc-418b-a80c-5b89760f2a35 req-4dd7bbe4-db4d-4fab-ad76-51eaeaaaca1c service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:21.153951 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-3b0abf0f-14bc-418b-a80c-5b89760f2a35 req-4dd7bbe4-db4d-4fab-ad76-51eaeaaaca1c service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:21.165624 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-3b0abf0f-14bc-418b-a80c-5b89760f2a35 req-4dd7bbe4-db4d-4fab-ad76-51eaeaaaca1c service nova] Creating event network-changed:5abd346c-df9c-4cb2-b976-8f9adc822383 for instance ce59fd53-2d4c-477e-8326-672737e561f5 on hv-cinder-85862 Sep 21 16:28:21.170341 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-3b0abf0f-14bc-418b-a80c-5b89760f2a35 req-4dd7bbe4-db4d-4fab-ad76-51eaeaaaca1c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033240 Sep 21 16:28:21.171254 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 318/719] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:28:21.407583 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-00366966-771d-4f9b-b538-7b8a86f7ef14 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:21.408302 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-00366966-771d-4f9b-b538-7b8a86f7ef14 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:21.414444 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-00366966-771d-4f9b-b538-7b8a86f7ef14 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:21.414952 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-00366966-771d-4f9b-b538-7b8a86f7ef14 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:21.415383 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-00366966-771d-4f9b-b538-7b8a86f7ef14 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:21.416072 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-00366966-771d-4f9b-b538-7b8a86f7ef14 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:21.416527 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-00366966-771d-4f9b-b538-7b8a86f7ef14 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:21.416942 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-00366966-771d-4f9b-b538-7b8a86f7ef14 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:21.497468 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 21 16:28:21.497949 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Wed Sep 21 16:28:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079 (ip 10.222.0.64) !!! Sep 21 16:28:21.560561 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-00366966-771d-4f9b-b538-7b8a86f7ef14 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:21.569056 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-00366966-771d-4f9b-b538-7b8a86f7ef14 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079" status: 200 len: 1362 microversion: 2.1 time: 0.164924 Sep 21 16:28:21.569655 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 402/720] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:21 2022] GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:28:21.623103 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-0849741b-02af-472f-a770-b95274837814 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:21.623783 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-0849741b-02af-472f-a770-b95274837814 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:21.629956 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0849741b-02af-472f-a770-b95274837814 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:21.630528 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0849741b-02af-472f-a770-b95274837814 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:21.630957 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0849741b-02af-472f-a770-b95274837814 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:21.631650 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0849741b-02af-472f-a770-b95274837814 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:21.632096 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0849741b-02af-472f-a770-b95274837814 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:21.632506 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0849741b-02af-472f-a770-b95274837814 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:21.768909 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-0849741b-02af-472f-a770-b95274837814 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:21.777243 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-0849741b-02af-472f-a770-b95274837814 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:21.778738 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-0849741b-02af-472f-a770-b95274837814 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:21.779865 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-0849741b-02af-472f-a770-b95274837814 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1405 microversion: 2.20 time: 0.161068 Sep 21 16:28:21.780429 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 319/721] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:28:21 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:28:22.215339 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-5f4ea5f2-0108-4b6c-830d-833c4c90335b req-67448d2b-26f9-4fce-a0d0-e53c6083a93d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68300698-35cc-4b4c-8046-7d1ce02c0079", "name": "network-vif-plugged", "status": "completed", "tag": "0fb5904a-0991-4b4f-b361-c14b24d2bc04"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:28:22.225926 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-5f4ea5f2-0108-4b6c-830d-833c4c90335b req-67448d2b-26f9-4fce-a0d0-e53c6083a93d service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:22.226443 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-5f4ea5f2-0108-4b6c-830d-833c4c90335b req-67448d2b-26f9-4fce-a0d0-e53c6083a93d service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:22.227535 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-5f4ea5f2-0108-4b6c-830d-833c4c90335b req-67448d2b-26f9-4fce-a0d0-e53c6083a93d service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:22.238936 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-5f4ea5f2-0108-4b6c-830d-833c4c90335b req-67448d2b-26f9-4fce-a0d0-e53c6083a93d service nova] Creating event network-vif-plugged:0fb5904a-0991-4b4f-b361-c14b24d2bc04 for instance 68300698-35cc-4b4c-8046-7d1ce02c0079 on hv-cinder-85862 Sep 21 16:28:22.243994 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-5f4ea5f2-0108-4b6c-830d-833c4c90335b req-67448d2b-26f9-4fce-a0d0-e53c6083a93d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032360 Sep 21 16:28:22.244596 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 403/722] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:28:22.605360 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-093c26c4-d051-4faf-aa61-9abb91c80e38 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:22.605976 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-093c26c4-d051-4faf-aa61-9abb91c80e38 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:22.608461 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:28:22.613758 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-093c26c4-d051-4faf-aa61-9abb91c80e38 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:22.614272 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-093c26c4-d051-4faf-aa61-9abb91c80e38 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:22.614705 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-093c26c4-d051-4faf-aa61-9abb91c80e38 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:22.615551 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-093c26c4-d051-4faf-aa61-9abb91c80e38 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:22.616014 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-093c26c4-d051-4faf-aa61-9abb91c80e38 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:22.616439 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-093c26c4-d051-4faf-aa61-9abb91c80e38 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:22.806204 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-abb7ce20-6f24-40fb-b6cf-184a355026aa tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:22.806903 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-abb7ce20-6f24-40fb-b6cf-184a355026aa tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:22.813798 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-abb7ce20-6f24-40fb-b6cf-184a355026aa tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:22.814352 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-abb7ce20-6f24-40fb-b6cf-184a355026aa tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:22.814779 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-abb7ce20-6f24-40fb-b6cf-184a355026aa tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:22.815658 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-abb7ce20-6f24-40fb-b6cf-184a355026aa tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:22.816114 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-abb7ce20-6f24-40fb-b6cf-184a355026aa tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:22.816532 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-abb7ce20-6f24-40fb-b6cf-184a355026aa tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:22.875055 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-093c26c4-d051-4faf-aa61-9abb91c80e38 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:22.883691 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-093c26c4-d051-4faf-aa61-9abb91c80e38 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079" status: 200 len: 1362 microversion: 2.1 time: 0.282057 Sep 21 16:28:22.884344 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 320/723] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:22 2022] GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079 => generated 1362 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:28:22.959712 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-abb7ce20-6f24-40fb-b6cf-184a355026aa tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:22.968253 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-abb7ce20-6f24-40fb-b6cf-184a355026aa tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:22.969688 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-abb7ce20-6f24-40fb-b6cf-184a355026aa tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:22.970823 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-abb7ce20-6f24-40fb-b6cf-184a355026aa tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1405 microversion: 2.20 time: 0.169657 Sep 21 16:28:22.971389 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 404/724] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:28:22 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1405 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 16:28:23.906684 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-5fbd17bd-5371-4bee-a147-7e75a85a6bf1 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:23.907290 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-5fbd17bd-5371-4bee-a147-7e75a85a6bf1 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:23.913920 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5fbd17bd-5371-4bee-a147-7e75a85a6bf1 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:23.914459 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5fbd17bd-5371-4bee-a147-7e75a85a6bf1 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:23.914887 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5fbd17bd-5371-4bee-a147-7e75a85a6bf1 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:23.915569 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5fbd17bd-5371-4bee-a147-7e75a85a6bf1 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:23.916013 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5fbd17bd-5371-4bee-a147-7e75a85a6bf1 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:23.916426 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5fbd17bd-5371-4bee-a147-7e75a85a6bf1 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:23.995966 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-12539b0d-d4b3-4278-be44-e5a1cd98843f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:23.996579 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-12539b0d-d4b3-4278-be44-e5a1cd98843f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:24.003212 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-12539b0d-d4b3-4278-be44-e5a1cd98843f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:24.003696 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-12539b0d-d4b3-4278-be44-e5a1cd98843f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:24.004135 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-12539b0d-d4b3-4278-be44-e5a1cd98843f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:24.004833 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-12539b0d-d4b3-4278-be44-e5a1cd98843f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:24.005290 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-12539b0d-d4b3-4278-be44-e5a1cd98843f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:24.006293 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-12539b0d-d4b3-4278-be44-e5a1cd98843f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:24.047328 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-5fbd17bd-5371-4bee-a147-7e75a85a6bf1 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:24.058125 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-5fbd17bd-5371-4bee-a147-7e75a85a6bf1 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079" status: 200 len: 1362 microversion: 2.1 time: 0.155152 Sep 21 16:28:24.059148 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 321/725] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:23 2022] GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:28:24.144326 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-12539b0d-d4b3-4278-be44-e5a1cd98843f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:24.153652 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-12539b0d-d4b3-4278-be44-e5a1cd98843f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:24.155139 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-12539b0d-d4b3-4278-be44-e5a1cd98843f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:24.156336 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-12539b0d-d4b3-4278-be44-e5a1cd98843f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1405 microversion: 2.20 time: 0.164284 Sep 21 16:28:24.156936 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 405/726] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:28:23 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 16:28:25.081010 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-9e896979-b57a-41eb-9f8e-ae749664bef4 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:25.081609 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-9e896979-b57a-41eb-9f8e-ae749664bef4 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:25.088461 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9e896979-b57a-41eb-9f8e-ae749664bef4 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:25.089011 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9e896979-b57a-41eb-9f8e-ae749664bef4 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:25.089438 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9e896979-b57a-41eb-9f8e-ae749664bef4 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:25.090154 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9e896979-b57a-41eb-9f8e-ae749664bef4 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:25.090598 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9e896979-b57a-41eb-9f8e-ae749664bef4 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:25.091019 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9e896979-b57a-41eb-9f8e-ae749664bef4 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:25.180941 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ede1288a-dc4b-43e8-9327-b6d6f26a1c21 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:25.181643 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ede1288a-dc4b-43e8-9327-b6d6f26a1c21 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:25.187723 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ede1288a-dc4b-43e8-9327-b6d6f26a1c21 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:25.188214 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ede1288a-dc4b-43e8-9327-b6d6f26a1c21 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:25.188651 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ede1288a-dc4b-43e8-9327-b6d6f26a1c21 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:25.189353 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ede1288a-dc4b-43e8-9327-b6d6f26a1c21 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:25.189811 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ede1288a-dc4b-43e8-9327-b6d6f26a1c21 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:25.190273 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ede1288a-dc4b-43e8-9327-b6d6f26a1c21 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:25.222774 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-9e896979-b57a-41eb-9f8e-ae749664bef4 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:25.232299 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-9e896979-b57a-41eb-9f8e-ae749664bef4 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079" status: 200 len: 1548 microversion: 2.1 time: 0.155105 Sep 21 16:28:25.233709 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 322/727] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:25 2022] GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079 => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:28:25.254737 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-161f6f2d-951e-445f-a654-7d07b6bd587e tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:25.255227 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-161f6f2d-951e-445f-a654-7d07b6bd587e tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:25.261308 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-161f6f2d-951e-445f-a654-7d07b6bd587e tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:25.261790 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-161f6f2d-951e-445f-a654-7d07b6bd587e tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:25.262294 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-161f6f2d-951e-445f-a654-7d07b6bd587e tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:25.263029 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-161f6f2d-951e-445f-a654-7d07b6bd587e tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:25.263470 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-161f6f2d-951e-445f-a654-7d07b6bd587e tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:25.263882 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-161f6f2d-951e-445f-a654-7d07b6bd587e tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:25.338067 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ede1288a-dc4b-43e8-9327-b6d6f26a1c21 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:25.347007 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ede1288a-dc4b-43e8-9327-b6d6f26a1c21 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:25.347902 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-161f6f2d-951e-445f-a654-7d07b6bd587e tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097076 Sep 21 16:28:25.348453 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ede1288a-dc4b-43e8-9327-b6d6f26a1c21 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:25.348599 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 323/728] 10.222.0.64 () {58 vars in 1275 bytes} [Wed Sep 21 16:28:25 2022] GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:28:25.349665 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ede1288a-dc4b-43e8-9327-b6d6f26a1c21 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1405 microversion: 2.20 time: 0.172775 Sep 21 16:28:25.350244 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 406/729] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:28:25 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 16:28:26.226887 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-5552a369-4258-46c9-82c6-4dbdd6af8573 req-354c50c3-cf34-4e7c-b2ae-908e3d0336f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce59fd53-2d4c-477e-8326-672737e561f5", "name": "network-vif-plugged", "status": "completed", "tag": "5abd346c-df9c-4cb2-b976-8f9adc822383"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:28:26.239675 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-5552a369-4258-46c9-82c6-4dbdd6af8573 req-354c50c3-cf34-4e7c-b2ae-908e3d0336f6 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:26.240715 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-5552a369-4258-46c9-82c6-4dbdd6af8573 req-354c50c3-cf34-4e7c-b2ae-908e3d0336f6 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:26.241318 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-5552a369-4258-46c9-82c6-4dbdd6af8573 req-354c50c3-cf34-4e7c-b2ae-908e3d0336f6 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:26.253689 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-5552a369-4258-46c9-82c6-4dbdd6af8573 req-354c50c3-cf34-4e7c-b2ae-908e3d0336f6 service nova] Creating event network-vif-plugged:5abd346c-df9c-4cb2-b976-8f9adc822383 for instance ce59fd53-2d4c-477e-8326-672737e561f5 on hv-cinder-85862 Sep 21 16:28:26.260234 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-5552a369-4258-46c9-82c6-4dbdd6af8573 req-354c50c3-cf34-4e7c-b2ae-908e3d0336f6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038271 Sep 21 16:28:26.261019 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 324/730] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:28:26.374834 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-d6158dab-ea63-4722-a03c-9d2c155c418f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:26.375682 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-d6158dab-ea63-4722-a03c-9d2c155c418f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:26.382992 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d6158dab-ea63-4722-a03c-9d2c155c418f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:26.383775 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d6158dab-ea63-4722-a03c-9d2c155c418f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:26.384214 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d6158dab-ea63-4722-a03c-9d2c155c418f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:26.384954 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d6158dab-ea63-4722-a03c-9d2c155c418f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:26.385424 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d6158dab-ea63-4722-a03c-9d2c155c418f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:26.386019 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d6158dab-ea63-4722-a03c-9d2c155c418f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:26.660306 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-f5477210-58c4-4385-8882-749500290140 req-ee2ac3f5-e972-4862-b9fe-7b3c31e04c3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68300698-35cc-4b4c-8046-7d1ce02c0079", "tag": "0fb5904a-0991-4b4f-b361-c14b24d2bc04"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:28:26.670879 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-f5477210-58c4-4385-8882-749500290140 req-ee2ac3f5-e972-4862-b9fe-7b3c31e04c3d service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:26.671613 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-f5477210-58c4-4385-8882-749500290140 req-ee2ac3f5-e972-4862-b9fe-7b3c31e04c3d service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:26.672040 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-f5477210-58c4-4385-8882-749500290140 req-ee2ac3f5-e972-4862-b9fe-7b3c31e04c3d service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:26.684425 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-f5477210-58c4-4385-8882-749500290140 req-ee2ac3f5-e972-4862-b9fe-7b3c31e04c3d service nova] Creating event network-changed:0fb5904a-0991-4b4f-b361-c14b24d2bc04 for instance 68300698-35cc-4b4c-8046-7d1ce02c0079 on hv-cinder-85862 Sep 21 16:28:26.688194 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d6158dab-ea63-4722-a03c-9d2c155c418f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:26.689538 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-f5477210-58c4-4385-8882-749500290140 req-ee2ac3f5-e972-4862-b9fe-7b3c31e04c3d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033202 Sep 21 16:28:26.690169 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 325/731] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:28:26.697837 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d6158dab-ea63-4722-a03c-9d2c155c418f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:26.699317 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d6158dab-ea63-4722-a03c-9d2c155c418f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:26.700426 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-d6158dab-ea63-4722-a03c-9d2c155c418f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1405 microversion: 2.20 time: 0.330051 Sep 21 16:28:26.700984 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 407/732] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:28:26 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1405 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:28:27.726404 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-6b143d3d-a63b-4a02-99ed-30362b7b06e4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:27.727103 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-6b143d3d-a63b-4a02-99ed-30362b7b06e4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:27.733543 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6b143d3d-a63b-4a02-99ed-30362b7b06e4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:27.734026 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6b143d3d-a63b-4a02-99ed-30362b7b06e4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:27.734512 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6b143d3d-a63b-4a02-99ed-30362b7b06e4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:27.735239 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6b143d3d-a63b-4a02-99ed-30362b7b06e4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:27.735725 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6b143d3d-a63b-4a02-99ed-30362b7b06e4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:27.736145 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6b143d3d-a63b-4a02-99ed-30362b7b06e4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:27.895528 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-6b143d3d-a63b-4a02-99ed-30362b7b06e4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:27.899645 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=100 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:28:27.905249 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-6b143d3d-a63b-4a02-99ed-30362b7b06e4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:27.906720 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-6b143d3d-a63b-4a02-99ed-30362b7b06e4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:27.907823 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-6b143d3d-a63b-4a02-99ed-30362b7b06e4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1405 microversion: 2.20 time: 0.186886 Sep 21 16:28:27.908376 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 326/733] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:28:27 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1405 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:28:28.933445 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-3980fddc-cefe-46ea-8092-b21e6ce31710 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:28.934072 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-3980fddc-cefe-46ea-8092-b21e6ce31710 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:28.936507 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell0:SELECT=2 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:28:28.942347 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3980fddc-cefe-46ea-8092-b21e6ce31710 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:28.942838 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3980fddc-cefe-46ea-8092-b21e6ce31710 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:28.943277 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3980fddc-cefe-46ea-8092-b21e6ce31710 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:28.943971 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3980fddc-cefe-46ea-8092-b21e6ce31710 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:28.944424 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3980fddc-cefe-46ea-8092-b21e6ce31710 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:28.944848 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3980fddc-cefe-46ea-8092-b21e6ce31710 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:29.076186 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-3980fddc-cefe-46ea-8092-b21e6ce31710 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:29.084814 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-3980fddc-cefe-46ea-8092-b21e6ce31710 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:29.086290 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-3980fddc-cefe-46ea-8092-b21e6ce31710 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:29.087440 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-3980fddc-cefe-46ea-8092-b21e6ce31710 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1597 microversion: 2.20 time: 0.157895 Sep 21 16:28:29.088004 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 408/734] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:28:28 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1597 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:28:29.111461 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-557af6a9-426f-4625-a3df-2bb9be165407 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:29.111972 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-557af6a9-426f-4625-a3df-2bb9be165407 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:29.113918 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell0:SELECT=4 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:28:29.114631 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell0:SELECT=18 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:28:29.120879 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-557af6a9-426f-4625-a3df-2bb9be165407 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:29.121362 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-557af6a9-426f-4625-a3df-2bb9be165407 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:29.121796 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-557af6a9-426f-4625-a3df-2bb9be165407 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:29.122529 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-557af6a9-426f-4625-a3df-2bb9be165407 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:29.122976 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-557af6a9-426f-4625-a3df-2bb9be165407 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:29.123397 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-557af6a9-426f-4625-a3df-2bb9be165407 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:29.201240 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-557af6a9-426f-4625-a3df-2bb9be165407 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093490 Sep 21 16:28:29.201847 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 327/735] 10.222.0.64 () {60 vars in 1316 bytes} [Wed Sep 21 16:28:29 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 16:28:30.364128 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-7815f2f0-b0c1-4761-8a9e-9236d0e23691 req-660e4ff3-0c1d-4b2b-9215-2956a284450e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce59fd53-2d4c-477e-8326-672737e561f5", "tag": "5abd346c-df9c-4cb2-b976-8f9adc822383"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:28:30.372141 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-7815f2f0-b0c1-4761-8a9e-9236d0e23691 req-660e4ff3-0c1d-4b2b-9215-2956a284450e service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:30.372615 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-7815f2f0-b0c1-4761-8a9e-9236d0e23691 req-660e4ff3-0c1d-4b2b-9215-2956a284450e service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:30.373039 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-7815f2f0-b0c1-4761-8a9e-9236d0e23691 req-660e4ff3-0c1d-4b2b-9215-2956a284450e service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:30.384686 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-7815f2f0-b0c1-4761-8a9e-9236d0e23691 req-660e4ff3-0c1d-4b2b-9215-2956a284450e service nova] Creating event network-changed:5abd346c-df9c-4cb2-b976-8f9adc822383 for instance ce59fd53-2d4c-477e-8326-672737e561f5 on hv-cinder-85862 Sep 21 16:28:30.394658 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-7815f2f0-b0c1-4761-8a9e-9236d0e23691 req-660e4ff3-0c1d-4b2b-9215-2956a284450e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036457 Sep 21 16:28:30.395271 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 409/736] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:28:44.743477 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_api:SELECT=15 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:28:44.744235 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=4 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:28:44.748535 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-c26599b0-645d-4a9e-b5e7-78011f1d70f4 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-262557277"}} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:28:44.749069 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-c26599b0-645d-4a9e-b5e7-78011f1d70f4 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:44.757598 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c26599b0-645d-4a9e-b5e7-78011f1d70f4 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:44.758111 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c26599b0-645d-4a9e-b5e7-78011f1d70f4 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:44.758540 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c26599b0-645d-4a9e-b5e7-78011f1d70f4 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:44.759241 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c26599b0-645d-4a9e-b5e7-78011f1d70f4 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:44.759679 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c26599b0-645d-4a9e-b5e7-78011f1d70f4 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:44.760094 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c26599b0-645d-4a9e-b5e7-78011f1d70f4 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:44.892170 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.network.security_group_api [None req-c26599b0-645d-4a9e-b5e7-78011f1d70f4 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Removing security group 88c546e3-3110-4dd8-98ff-d254a32672bb from port e9fd8d4f-e98f-46e3-af56-5c8429307f9b Sep 21 16:28:45.233646 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-c26599b0-645d-4a9e-b5e7-78011f1d70f4 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "POST /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd/action" status: 202 len: 0 microversion: 2.1 time: 0.491515 Sep 21 16:28:45.242085 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 328/737] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Sep 21 16:28:44 2022] POST /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 16:28:45.242876 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:28:45.242876 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=99 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:28:45.318628 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-ca59803a-301b-4301-a7c3-dcd506c8168d req-431fdd8c-c113-454f-8729-09f8c462bb9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec70a608-9135-4656-a030-6429493b68fd", "tag": "e9fd8d4f-e98f-46e3-af56-5c8429307f9b"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:28:45.329783 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-ca59803a-301b-4301-a7c3-dcd506c8168d req-431fdd8c-c113-454f-8729-09f8c462bb9a service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:45.330412 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-ca59803a-301b-4301-a7c3-dcd506c8168d req-431fdd8c-c113-454f-8729-09f8c462bb9a service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:45.330924 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-ca59803a-301b-4301-a7c3-dcd506c8168d req-431fdd8c-c113-454f-8729-09f8c462bb9a service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:45.342725 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-ca59803a-301b-4301-a7c3-dcd506c8168d req-431fdd8c-c113-454f-8729-09f8c462bb9a service nova] Creating event network-changed:e9fd8d4f-e98f-46e3-af56-5c8429307f9b for instance ec70a608-9135-4656-a030-6429493b68fd on hv-cinder-85862 Sep 21 16:28:45.348905 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-ca59803a-301b-4301-a7c3-dcd506c8168d req-431fdd8c-c113-454f-8729-09f8c462bb9a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110987 Sep 21 16:28:45.349794 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 410/738] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:28:46.313543 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-2850835f-c7c7-42ca-8554-a7be7bf92e98 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:46.314335 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-2850835f-c7c7-42ca-8554-a7be7bf92e98 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:46.321841 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2850835f-c7c7-42ca-8554-a7be7bf92e98 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:46.322437 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2850835f-c7c7-42ca-8554-a7be7bf92e98 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:46.323070 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2850835f-c7c7-42ca-8554-a7be7bf92e98 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:46.323792 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2850835f-c7c7-42ca-8554-a7be7bf92e98 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:46.324266 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2850835f-c7c7-42ca-8554-a7be7bf92e98 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:46.324875 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2850835f-c7c7-42ca-8554-a7be7bf92e98 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:46.389625 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-39ff97f1-c0e1-487c-90fe-90fcc8760681 req-f86285e1-7faa-40c2-971b-abb7591454a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec70a608-9135-4656-a030-6429493b68fd", "tag": "e9fd8d4f-e98f-46e3-af56-5c8429307f9b"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:28:46.401488 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-39ff97f1-c0e1-487c-90fe-90fcc8760681 req-f86285e1-7faa-40c2-971b-abb7591454a0 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:46.402508 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-39ff97f1-c0e1-487c-90fe-90fcc8760681 req-f86285e1-7faa-40c2-971b-abb7591454a0 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:46.403084 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-39ff97f1-c0e1-487c-90fe-90fcc8760681 req-f86285e1-7faa-40c2-971b-abb7591454a0 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:46.414603 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-39ff97f1-c0e1-487c-90fe-90fcc8760681 req-f86285e1-7faa-40c2-971b-abb7591454a0 service nova] Creating event network-changed:e9fd8d4f-e98f-46e3-af56-5c8429307f9b for instance ec70a608-9135-4656-a030-6429493b68fd on hv-cinder-85862 Sep 21 16:28:46.419912 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-39ff97f1-c0e1-487c-90fe-90fcc8760681 req-f86285e1-7faa-40c2-971b-abb7591454a0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107548 Sep 21 16:28:46.420754 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 411/739] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:28:46.422770 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.objects.instance [None req-2850835f-c7c7-42ca-8554-a7be7bf92e98 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lazy-loading 'services' on Instance uuid ec70a608-9135-4656-a030-6429493b68fd {{(pid=120531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 16:28:46.501123 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-2850835f-c7c7-42ca-8554-a7be7bf92e98 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "DELETE /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd/os-volume_attachments/c1943197-77d4-4241-bb47-1797a34a37a6" status: 202 len: 0 microversion: 2.1 time: 0.191702 Sep 21 16:28:46.502204 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 329/740] 10.222.0.64 () {58 vars in 1416 bytes} [Wed Sep 21 16:28:46 2022] DELETE /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd/os-volume_attachments/c1943197-77d4-4241-bb47-1797a34a37a6 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 16:28:46.512136 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-3a64f54b-0c2f-44ef-9732-a0e7adfe5e5a tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:46.514757 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-3a64f54b-0c2f-44ef-9732-a0e7adfe5e5a tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:46.522641 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3a64f54b-0c2f-44ef-9732-a0e7adfe5e5a tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:46.523692 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3a64f54b-0c2f-44ef-9732-a0e7adfe5e5a tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:46.524321 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3a64f54b-0c2f-44ef-9732-a0e7adfe5e5a tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:46.525219 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3a64f54b-0c2f-44ef-9732-a0e7adfe5e5a tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:46.525739 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3a64f54b-0c2f-44ef-9732-a0e7adfe5e5a tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:46.526745 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3a64f54b-0c2f-44ef-9732-a0e7adfe5e5a tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:46.559030 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-3a64f54b-0c2f-44ef-9732-a0e7adfe5e5a tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051336 Sep 21 16:28:46.559611 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 412/741] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Sep 21 16:28:46 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:28:47.573256 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-48580d5b-e1c2-47e8-8432-8afb0ed6d7e9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:47.575584 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-48580d5b-e1c2-47e8-8432-8afb0ed6d7e9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:47.581817 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-48580d5b-e1c2-47e8-8432-8afb0ed6d7e9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:47.582333 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-48580d5b-e1c2-47e8-8432-8afb0ed6d7e9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:47.583280 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-48580d5b-e1c2-47e8-8432-8afb0ed6d7e9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:47.583971 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-48580d5b-e1c2-47e8-8432-8afb0ed6d7e9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:47.584420 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-48580d5b-e1c2-47e8-8432-8afb0ed6d7e9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:47.584839 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-48580d5b-e1c2-47e8-8432-8afb0ed6d7e9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:47.613535 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-48580d5b-e1c2-47e8-8432-8afb0ed6d7e9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045166 Sep 21 16:28:47.614142 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 330/742] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Sep 21 16:28:47 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 21 16:28:47.624746 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-51f8e222-358c-4f41-a304-df8b444dd626 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:47.625217 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-51f8e222-358c-4f41-a304-df8b444dd626 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:47.632118 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-51f8e222-358c-4f41-a304-df8b444dd626 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:47.632675 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-51f8e222-358c-4f41-a304-df8b444dd626 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:47.633108 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-51f8e222-358c-4f41-a304-df8b444dd626 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:47.634122 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-51f8e222-358c-4f41-a304-df8b444dd626 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:47.634752 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-51f8e222-358c-4f41-a304-df8b444dd626 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:47.635253 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-51f8e222-358c-4f41-a304-df8b444dd626 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:47.713775 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.wsgi [None req-51f8e222-358c-4f41-a304-df8b444dd626 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] HTTP exception thrown: Instance ec70a608-9135-4656-a030-6429493b68fd is not attached to volume c1943197-77d4-4241-bb47-1797a34a37a6 Sep 21 16:28:47.738385 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-51f8e222-358c-4f41-a304-df8b444dd626 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Request method failure captured: Sep 21 16:28:47.738385 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: request: DELETE /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd/os-volume_attachments/c1943197-77d4-4241-bb47-1797a34a37a6 HTTP/1.1 Sep 21 16:28:47.738385 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept: application/json Sep 21 16:28:47.738385 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept-Encoding: identity Sep 21 16:28:47.738385 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Connection: close Sep 21 16:28:47.738385 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Length: 0 Sep 21 16:28:47.738385 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Type: application/json Sep 21 16:28:47.738385 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Host: 10.222.0.64 Sep 21 16:28:47.738385 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Openstack-System-Scope: None Sep 21 16:28:47.738385 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: User-Agent: python-urllib3/1.26.12 Sep 21 16:28:47.738385 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Auth-Token: gAAAAABjKzr5ZmlKo5ErUU24NwjcYDdJItno6wE4-ByteHwv1w3CHBijdCFcFADfbF2p-7ImmcfwL1vNHK-LTjwCZP5xRpTx4C-BtRk0rnsF5BYQ0QOwyTCnPjmlD86B8XDJNsSQnjW68m4lma4sHSmgO5dkQQT8sE6B0vXRVG1k0TXaa3jOvKM Sep 21 16:28:47.738385 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Id: None Sep 21 16:28:47.738385 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Name: None Sep 21 16:28:47.738385 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Identity-Status: Confirmed Sep 21 16:28:47.738385 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Is-Admin-Project: True Sep 21 16:28:47.738385 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Id: default Sep 21 16:28:47.738385 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Name: Default Sep 21 16:28:47.738385 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Id: f1939a4a2ffd40c49d04b42983fba762 Sep 21 16:28:47.738385 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Name: tempest-TestMinimumBasicScenario-2066222600 Sep 21 16:28:47.738385 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Role: member,reader Sep 21 16:28:47.738385 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Roles: member,reader Sep 21 16:28:47.740099 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f1939a4a2ffd40c49d04b42983fba762"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f1939a4a2ffd40c49d04b42983fba762"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f1939a4a2ffd40c49d04b42983fba762"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f1939a4a2ffd40c49d04b42983fba762"}]}] Sep 21 16:28:47.740099 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant: tempest-TestMinimumBasicScenario-2066222600 Sep 21 16:28:47.740099 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Id: f1939a4a2ffd40c49d04b42983fba762 Sep 21 16:28:47.740099 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2066222600 Sep 21 16:28:47.740099 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User: tempest-TestMinimumBasicScenario-2066222600-project Sep 21 16:28:47.740099 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Id: default Sep 21 16:28:47.740099 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Name: Default Sep 21 16:28:47.740099 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Id: 70d318fe37c344649a165ef9a06a7b74 Sep 21 16:28:47.740099 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Name: tempest-TestMinimumBasicScenario-2066222600-project Sep 21 16:28:47.740099 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: method: > Sep 21 16:28:47.740099 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: exception: Instance ec70a608-9135-4656-a030-6429493b68fd is not attached to volume c1943197-77d4-4241-bb47-1797a34a37a6 Sep 21 16:28:47.741166 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: action_args: {'server_id': 'ec70a608-9135-4656-a030-6429493b68fd', 'id': 'c1943197-77d4-4241-bb47-1797a34a37a6'} Sep 21 16:28:47.741166 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:28:47.741166 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:28:47.741166 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 21 16:28:47.741166 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 21 16:28:47.741166 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 21 16:28:47.741166 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 21 16:28:47.741166 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 21 16:28:47.741166 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 21 16:28:47.741166 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c1943197-77d4-4241-bb47-1797a34a37a6. Sep 21 16:28:47.741166 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:28:47.741166 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:28:47.741166 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:28:47.741166 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:28:47.741166 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:28:47.741166 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:28:47.741166 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:28:47.741166 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:28:47.741166 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:28:47.742538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:28:47.742538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 21 16:28:47.742538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 21 16:28:47.742538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec70a608-9135-4656-a030-6429493b68fd is not attached to volume c1943197-77d4-4241-bb47-1797a34a37a6 Sep 21 16:28:47.742538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:28:47.742538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:28:47.742538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:28:47.742538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:28:47.742538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:28:47.742538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:28:47.742538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:28:47.742538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:28:47.742538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec70a608-9135-4656-a030-6429493b68fd is not attached to volume c1943197-77d4-4241-bb47-1797a34a37a6 Sep 21 16:28:47.742538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:28:47.742538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-51f8e222-358c-4f41-a304-df8b444dd626 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Returning 404 to user: Instance ec70a608-9135-4656-a030-6429493b68fd is not attached to volume c1943197-77d4-4241-bb47-1797a34a37a6 {{(pid=120532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:28:47.743810 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-51f8e222-358c-4f41-a304-df8b444dd626 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "DELETE /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd/os-volume_attachments/c1943197-77d4-4241-bb47-1797a34a37a6" status: 404 len: 154 microversion: 2.1 time: 0.119127 Sep 21 16:28:47.743810 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 413/743] 10.222.0.64 () {58 vars in 1416 bytes} [Wed Sep 21 16:28:47 2022] DELETE /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd/os-volume_attachments/c1943197-77d4-4241-bb47-1797a34a37a6 => generated 154 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 16:28:48.880761 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-c0983ab4-18f2-4c35-a41c-b128c8bdc8f6 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:48.881276 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-c0983ab4-18f2-4c35-a41c-b128c8bdc8f6 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:48.887686 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c0983ab4-18f2-4c35-a41c-b128c8bdc8f6 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:48.888166 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c0983ab4-18f2-4c35-a41c-b128c8bdc8f6 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:48.888601 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c0983ab4-18f2-4c35-a41c-b128c8bdc8f6 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:48.889288 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c0983ab4-18f2-4c35-a41c-b128c8bdc8f6 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:48.889740 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c0983ab4-18f2-4c35-a41c-b128c8bdc8f6 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:48.890198 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c0983ab4-18f2-4c35-a41c-b128c8bdc8f6 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:48.915289 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-c0983ab4-18f2-4c35-a41c-b128c8bdc8f6 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Going to try to terminate instance {{(pid=120531) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 16:28:48.989673 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-c0983ab4-18f2-4c35-a41c-b128c8bdc8f6 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "DELETE /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 204 len: 0 microversion: 2.1 time: 0.112365 Sep 21 16:28:48.990728 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 331/744] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Sep 21 16:28:48 2022] DELETE /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 21 16:28:48.999024 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-86416647-bda6-4678-8a0d-a7dcde8d46ae tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:48.999646 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-86416647-bda6-4678-8a0d-a7dcde8d46ae tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:49.006692 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-86416647-bda6-4678-8a0d-a7dcde8d46ae tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:49.007181 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-86416647-bda6-4678-8a0d-a7dcde8d46ae tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:49.007616 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-86416647-bda6-4678-8a0d-a7dcde8d46ae tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:49.008325 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-86416647-bda6-4678-8a0d-a7dcde8d46ae tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:49.008778 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-86416647-bda6-4678-8a0d-a7dcde8d46ae tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:49.009203 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-86416647-bda6-4678-8a0d-a7dcde8d46ae tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:49.141609 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-86416647-bda6-4678-8a0d-a7dcde8d46ae tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:49.149690 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-86416647-bda6-4678-8a0d-a7dcde8d46ae tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1554 microversion: 2.1 time: 0.154839 Sep 21 16:28:49.150291 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 414/745] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:48 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:28:49.350750 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-53703e36-1461-4ffb-9073-597579db8861 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:49.351326 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-53703e36-1461-4ffb-9073-597579db8861 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 608e4231-8635-45db-b2d6-6b0710c3120f] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:49.357185 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-53703e36-1461-4ffb-9073-597579db8861 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:49.357659 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-53703e36-1461-4ffb-9073-597579db8861 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:49.358111 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-53703e36-1461-4ffb-9073-597579db8861 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:49.358792 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-53703e36-1461-4ffb-9073-597579db8861 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:49.359238 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-53703e36-1461-4ffb-9073-597579db8861 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:49.359652 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-53703e36-1461-4ffb-9073-597579db8861 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:49.382784 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-53703e36-1461-4ffb-9073-597579db8861 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f/ips" status: 200 len: 148 microversion: 2.1 time: 0.093714 Sep 21 16:28:49.383379 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 332/746] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Sep 21 16:28:49 2022] GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f/ips => generated 148 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:28:50.172343 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-a63ba72c-31ae-4603-8860-7e51d7e3aac9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:50.172994 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-a63ba72c-31ae-4603-8860-7e51d7e3aac9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:50.179608 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a63ba72c-31ae-4603-8860-7e51d7e3aac9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:50.180087 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a63ba72c-31ae-4603-8860-7e51d7e3aac9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:50.180517 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a63ba72c-31ae-4603-8860-7e51d7e3aac9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:50.181202 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a63ba72c-31ae-4603-8860-7e51d7e3aac9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:50.181651 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a63ba72c-31ae-4603-8860-7e51d7e3aac9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:50.182097 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a63ba72c-31ae-4603-8860-7e51d7e3aac9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:50.308064 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a63ba72c-31ae-4603-8860-7e51d7e3aac9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:50.315746 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-a63ba72c-31ae-4603-8860-7e51d7e3aac9 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1554 microversion: 2.1 time: 0.147296 Sep 21 16:28:50.316313 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 415/747] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:50 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1554 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:28:50.715826 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-00edf495-0cc6-44a9-ad99-1029df309395 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e8a67fa-baa7-4fff-8caf-0563d7e1ea91"}} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:28:50.718362 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-00edf495-0cc6-44a9-ad99-1029df309395 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 608e4231-8635-45db-b2d6-6b0710c3120f] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:50.724808 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-00edf495-0cc6-44a9-ad99-1029df309395 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:50.725283 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-00edf495-0cc6-44a9-ad99-1029df309395 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:50.725710 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-00edf495-0cc6-44a9-ad99-1029df309395 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:50.726423 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-00edf495-0cc6-44a9-ad99-1029df309395 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:50.726869 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-00edf495-0cc6-44a9-ad99-1029df309395 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:50.727285 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-00edf495-0cc6-44a9-ad99-1029df309395 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:51.119982 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-00edf495-0cc6-44a9-ad99-1029df309395 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "POST /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.407883 Sep 21 16:28:51.120604 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 333/748] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Sep 21 16:28:50 2022] POST /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f/os-volume_attachments => generated 194 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:28:51.339038 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-9863e917-df8f-4c63-8481-8191640582c8 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:51.339659 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-9863e917-df8f-4c63-8481-8191640582c8 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:51.346356 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9863e917-df8f-4c63-8481-8191640582c8 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:51.346844 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9863e917-df8f-4c63-8481-8191640582c8 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:51.347273 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9863e917-df8f-4c63-8481-8191640582c8 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:51.347997 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9863e917-df8f-4c63-8481-8191640582c8 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:51.348435 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9863e917-df8f-4c63-8481-8191640582c8 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:51.348845 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9863e917-df8f-4c63-8481-8191640582c8 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:51.482998 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-9863e917-df8f-4c63-8481-8191640582c8 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:51.493366 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-9863e917-df8f-4c63-8481-8191640582c8 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1554 microversion: 2.1 time: 0.158135 Sep 21 16:28:51.493945 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 416/749] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:51 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:28:51.794230 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-0b58c724-c3d9-4a18-86a0-094d20f73413 req-4850ed8b-59b1-42e4-b899-8e8181fc51d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec70a608-9135-4656-a030-6429493b68fd", "name": "network-vif-deleted", "tag": "e9fd8d4f-e98f-46e3-af56-5c8429307f9b"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:28:51.806873 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-0b58c724-c3d9-4a18-86a0-094d20f73413 req-4850ed8b-59b1-42e4-b899-8e8181fc51d4 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:51.807460 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-0b58c724-c3d9-4a18-86a0-094d20f73413 req-4850ed8b-59b1-42e4-b899-8e8181fc51d4 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:51.807943 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-0b58c724-c3d9-4a18-86a0-094d20f73413 req-4850ed8b-59b1-42e4-b899-8e8181fc51d4 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:51.820586 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-0b58c724-c3d9-4a18-86a0-094d20f73413 req-4850ed8b-59b1-42e4-b899-8e8181fc51d4 service nova] Creating event network-vif-deleted:e9fd8d4f-e98f-46e3-af56-5c8429307f9b for instance ec70a608-9135-4656-a030-6429493b68fd on hv-cinder-85862 Sep 21 16:28:51.825596 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-0b58c724-c3d9-4a18-86a0-094d20f73413 req-4850ed8b-59b1-42e4-b899-8e8181fc51d4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035961 Sep 21 16:28:51.826242 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 334/750] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:28:52.519871 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-9b198452-96a7-4f72-9d89-b3abb93e5161 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:52.520508 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-9b198452-96a7-4f72-9d89-b3abb93e5161 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:52.527377 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9b198452-96a7-4f72-9d89-b3abb93e5161 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:52.527864 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9b198452-96a7-4f72-9d89-b3abb93e5161 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:52.529223 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9b198452-96a7-4f72-9d89-b3abb93e5161 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:52.529976 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9b198452-96a7-4f72-9d89-b3abb93e5161 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:52.530456 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9b198452-96a7-4f72-9d89-b3abb93e5161 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:52.530888 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9b198452-96a7-4f72-9d89-b3abb93e5161 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:52.565519 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9b198452-96a7-4f72-9d89-b3abb93e5161 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:52.566001 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9b198452-96a7-4f72-9d89-b3abb93e5161 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:52.566464 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9b198452-96a7-4f72-9d89-b3abb93e5161 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:52.567422 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.objects.instance [None req-9b198452-96a7-4f72-9d89-b3abb93e5161 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lazy-loading 'fault' on Instance uuid ec70a608-9135-4656-a030-6429493b68fd {{(pid=120532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 16:28:52.616150 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-9b198452-96a7-4f72-9d89-b3abb93e5161 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d318fe37c344649a165ef9a06a7b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1939a4a2ffd40c49d04b42983fba762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:52.624413 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-9b198452-96a7-4f72-9d89-b3abb93e5161 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 200 len: 1348 microversion: 2.1 time: 0.108351 Sep 21 16:28:52.625000 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 417/751] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:52 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 1348 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:28:53.652844 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-f0f9e93b-067f-4ffc-8809-9d512a74aa21 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:53.654016 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-f0f9e93b-067f-4ffc-8809-9d512a74aa21 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] [instance: ec70a608-9135-4656-a030-6429493b68fd] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:53.661887 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f0f9e93b-067f-4ffc-8809-9d512a74aa21 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:53.662414 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f0f9e93b-067f-4ffc-8809-9d512a74aa21 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:53.662849 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f0f9e93b-067f-4ffc-8809-9d512a74aa21 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:53.663591 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f0f9e93b-067f-4ffc-8809-9d512a74aa21 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:53.664047 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f0f9e93b-067f-4ffc-8809-9d512a74aa21 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:53.664466 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f0f9e93b-067f-4ffc-8809-9d512a74aa21 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:53.679683 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.wsgi [None req-f0f9e93b-067f-4ffc-8809-9d512a74aa21 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] HTTP exception thrown: Instance ec70a608-9135-4656-a030-6429493b68fd could not be found. Sep 21 16:28:53.681351 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-f0f9e93b-067f-4ffc-8809-9d512a74aa21 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Request method failure captured: Sep 21 16:28:53.681351 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: request: GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd HTTP/1.1 Sep 21 16:28:53.681351 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept: application/json Sep 21 16:28:53.681351 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept-Encoding: identity Sep 21 16:28:53.681351 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Connection: close Sep 21 16:28:53.681351 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Length: 0 Sep 21 16:28:53.681351 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Type: application/json Sep 21 16:28:53.681351 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Host: 10.222.0.64 Sep 21 16:28:53.681351 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Openstack-System-Scope: None Sep 21 16:28:53.681351 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: User-Agent: python-urllib3/1.26.12 Sep 21 16:28:53.681351 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Auth-Token: gAAAAABjKzr5ZmlKo5ErUU24NwjcYDdJItno6wE4-ByteHwv1w3CHBijdCFcFADfbF2p-7ImmcfwL1vNHK-LTjwCZP5xRpTx4C-BtRk0rnsF5BYQ0QOwyTCnPjmlD86B8XDJNsSQnjW68m4lma4sHSmgO5dkQQT8sE6B0vXRVG1k0TXaa3jOvKM Sep 21 16:28:53.681351 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Id: None Sep 21 16:28:53.681351 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Name: None Sep 21 16:28:53.681351 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Identity-Status: Confirmed Sep 21 16:28:53.681351 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Is-Admin-Project: True Sep 21 16:28:53.681351 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Id: default Sep 21 16:28:53.681351 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Name: Default Sep 21 16:28:53.681351 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Id: f1939a4a2ffd40c49d04b42983fba762 Sep 21 16:28:53.681351 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Name: tempest-TestMinimumBasicScenario-2066222600 Sep 21 16:28:53.681351 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Role: member,reader Sep 21 16:28:53.681351 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Roles: member,reader Sep 21 16:28:53.683762 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f1939a4a2ffd40c49d04b42983fba762"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f1939a4a2ffd40c49d04b42983fba762"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f1939a4a2ffd40c49d04b42983fba762"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f1939a4a2ffd40c49d04b42983fba762"}]}] Sep 21 16:28:53.683762 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant: tempest-TestMinimumBasicScenario-2066222600 Sep 21 16:28:53.683762 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Id: f1939a4a2ffd40c49d04b42983fba762 Sep 21 16:28:53.683762 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2066222600 Sep 21 16:28:53.683762 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User: tempest-TestMinimumBasicScenario-2066222600-project Sep 21 16:28:53.683762 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Id: default Sep 21 16:28:53.683762 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Name: Default Sep 21 16:28:53.683762 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Id: 70d318fe37c344649a165ef9a06a7b74 Sep 21 16:28:53.683762 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Name: tempest-TestMinimumBasicScenario-2066222600-project Sep 21 16:28:53.683762 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: method: > Sep 21 16:28:53.683762 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: exception: Instance ec70a608-9135-4656-a030-6429493b68fd could not be found. Sep 21 16:28:53.683762 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: action_args: {'id': 'ec70a608-9135-4656-a030-6429493b68fd'} Sep 21 16:28:53.685330 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:28:53.685330 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:28:53.685330 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 16:28:53.685330 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 16:28:53.685330 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 16:28:53.685330 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 16:28:53.685330 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 16:28:53.685330 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 16:28:53.685330 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 16:28:53.685330 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 16:28:53.685330 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec70a608-9135-4656-a030-6429493b68fd could not be found. Sep 21 16:28:53.685330 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:28:53.685330 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:28:53.685330 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:28:53.685330 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:28:53.685330 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:28:53.685330 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:28:53.685330 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:28:53.685330 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:28:53.685330 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:28:53.687577 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:28:53.687577 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 16:28:53.687577 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 16:28:53.687577 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 16:28:53.687577 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 16:28:53.687577 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 16:28:53.687577 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:28:53.687577 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec70a608-9135-4656-a030-6429493b68fd could not be found. Sep 21 16:28:53.687577 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:28:53.687577 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:28:53.687577 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:28:53.687577 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:28:53.687577 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:28:53.687577 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:28:53.687577 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:28:53.687577 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:28:53.687577 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec70a608-9135-4656-a030-6429493b68fd could not be found. Sep 21 16:28:53.687577 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:28:53.689598 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-f0f9e93b-067f-4ffc-8809-9d512a74aa21 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Returning 404 to user: Instance ec70a608-9135-4656-a030-6429493b68fd could not be found. {{(pid=120531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:28:53.689598 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-f0f9e93b-067f-4ffc-8809-9d512a74aa21 tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd" status: 404 len: 111 microversion: 2.1 time: 0.036927 Sep 21 16:28:53.689598 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 335/752] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:53 2022] GET /compute/v2.1/servers/ec70a608-9135-4656-a030-6429493b68fd => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 16:28:53.692885 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-4bd75592-d824-4f90-a7b5-e0369e35a87d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] Calling method '.version_select at 0x7fdb88a2f550>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:53.717851 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-4bd75592-d824-4f90-a7b5-e0369e35a87d tempest-TestMinimumBasicScenario-2066222600 tempest-TestMinimumBasicScenario-2066222600-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1566029887" status: 202 len: 0 microversion: 2.1 time: 0.029602 Sep 21 16:28:53.718491 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 418/753] 10.222.0.64 () {58 vars in 1272 bytes} [Wed Sep 21 16:28:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1566029887 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 16:28:54.560893 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-735b57bf-c530-4d17-bd7b-f46d998afd57 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:54.561376 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-735b57bf-c530-4d17-bd7b-f46d998afd57 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:54.568504 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-735b57bf-c530-4d17-bd7b-f46d998afd57 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:54.568987 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-735b57bf-c530-4d17-bd7b-f46d998afd57 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:54.569410 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-735b57bf-c530-4d17-bd7b-f46d998afd57 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:54.570121 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-735b57bf-c530-4d17-bd7b-f46d998afd57 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:54.570573 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-735b57bf-c530-4d17-bd7b-f46d998afd57 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:54.570993 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-735b57bf-c530-4d17-bd7b-f46d998afd57 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:54.658947 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.objects.instance [None req-735b57bf-c530-4d17-bd7b-f46d998afd57 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lazy-loading 'services' on Instance uuid c95f478c-11b2-4097-b4b1-551d61fa9664 {{(pid=120531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 16:28:54.740237 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-735b57bf-c530-4d17-bd7b-f46d998afd57 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "DELETE /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664/os-volume_attachments/5daa0358-1a92-4801-95be-3236e23d3e76" status: 202 len: 0 microversion: 2.1 time: 0.183120 Sep 21 16:28:54.740914 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 336/754] 10.222.0.64 () {58 vars in 1416 bytes} [Wed Sep 21 16:28:54 2022] DELETE /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664/os-volume_attachments/5daa0358-1a92-4801-95be-3236e23d3e76 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 16:28:54.749975 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-f60b87f4-e387-4edb-94b1-cfd7e8f67344 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:54.752817 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-f60b87f4-e387-4edb-94b1-cfd7e8f67344 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:54.759899 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f60b87f4-e387-4edb-94b1-cfd7e8f67344 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:54.760342 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f60b87f4-e387-4edb-94b1-cfd7e8f67344 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:54.760776 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f60b87f4-e387-4edb-94b1-cfd7e8f67344 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:54.761762 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f60b87f4-e387-4edb-94b1-cfd7e8f67344 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:54.762230 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f60b87f4-e387-4edb-94b1-cfd7e8f67344 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:54.762666 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f60b87f4-e387-4edb-94b1-cfd7e8f67344 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:54.795655 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-f60b87f4-e387-4edb-94b1-cfd7e8f67344 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050191 Sep 21 16:28:54.796305 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 419/755] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Sep 21 16:28:54 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:28:55.810020 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-ac33db7c-66d2-4423-9240-44bf9294c64a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:55.813875 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-ac33db7c-66d2-4423-9240-44bf9294c64a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:55.824581 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ac33db7c-66d2-4423-9240-44bf9294c64a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:55.825397 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ac33db7c-66d2-4423-9240-44bf9294c64a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:55.826119 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ac33db7c-66d2-4423-9240-44bf9294c64a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:55.827368 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ac33db7c-66d2-4423-9240-44bf9294c64a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:55.828204 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ac33db7c-66d2-4423-9240-44bf9294c64a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:55.828910 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ac33db7c-66d2-4423-9240-44bf9294c64a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:55.884839 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-ac33db7c-66d2-4423-9240-44bf9294c64a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079684 Sep 21 16:28:55.885904 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 337/756] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Sep 21 16:28:55 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:28:56.900015 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-5e0d9b9d-bc0b-481f-8d83-2317efaeafb7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:56.902990 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-5e0d9b9d-bc0b-481f-8d83-2317efaeafb7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:56.914167 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5e0d9b9d-bc0b-481f-8d83-2317efaeafb7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:56.914670 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5e0d9b9d-bc0b-481f-8d83-2317efaeafb7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:56.915112 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5e0d9b9d-bc0b-481f-8d83-2317efaeafb7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:56.915823 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5e0d9b9d-bc0b-481f-8d83-2317efaeafb7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:56.916277 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5e0d9b9d-bc0b-481f-8d83-2317efaeafb7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:56.916699 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5e0d9b9d-bc0b-481f-8d83-2317efaeafb7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:56.948658 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-5e0d9b9d-bc0b-481f-8d83-2317efaeafb7 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054235 Sep 21 16:28:56.949226 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 420/757] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Sep 21 16:28:56 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:28:57.961396 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-ada1985c-7e41-42eb-826c-fb0cf37ef5a6 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:57.963620 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-ada1985c-7e41-42eb-826c-fb0cf37ef5a6 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:57.980890 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ada1985c-7e41-42eb-826c-fb0cf37ef5a6 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:57.981403 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ada1985c-7e41-42eb-826c-fb0cf37ef5a6 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:57.981848 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ada1985c-7e41-42eb-826c-fb0cf37ef5a6 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:57.989095 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ada1985c-7e41-42eb-826c-fb0cf37ef5a6 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:57.989542 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ada1985c-7e41-42eb-826c-fb0cf37ef5a6 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:57.989977 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ada1985c-7e41-42eb-826c-fb0cf37ef5a6 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:58.037874 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-ada1985c-7e41-42eb-826c-fb0cf37ef5a6 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080837 Sep 21 16:28:58.038501 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 338/758] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Sep 21 16:28:57 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:28:58.757569 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-d23d6a6a-4cc1-4765-8ef7-fa42e020bc67 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e8a67fa-baa7-4fff-8caf-0563d7e1ea91"}} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:28:58.760044 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-d23d6a6a-4cc1-4765-8ef7-fa42e020bc67 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 608e4231-8635-45db-b2d6-6b0710c3120f] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:58.766804 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d23d6a6a-4cc1-4765-8ef7-fa42e020bc67 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:58.767293 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d23d6a6a-4cc1-4765-8ef7-fa42e020bc67 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:58.767735 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d23d6a6a-4cc1-4765-8ef7-fa42e020bc67 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:58.768439 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d23d6a6a-4cc1-4765-8ef7-fa42e020bc67 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:58.768894 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d23d6a6a-4cc1-4765-8ef7-fa42e020bc67 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:58.769855 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d23d6a6a-4cc1-4765-8ef7-fa42e020bc67 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:58.859434 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.wsgi [None req-d23d6a6a-4cc1-4765-8ef7-fa42e020bc67 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] HTTP exception thrown: Invalid volume: volume 6e8a67fa-baa7-4fff-8caf-0563d7e1ea91 is already attached to instances: 608e4231-8635-45db-b2d6-6b0710c3120f Sep 21 16:28:58.861057 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-d23d6a6a-4cc1-4765-8ef7-fa42e020bc67 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Request method failure captured: Sep 21 16:28:58.861057 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: request: POST /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f/os-volume_attachments HTTP/1.1 Sep 21 16:28:58.861057 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept: application/json Sep 21 16:28:58.861057 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept-Encoding: identity Sep 21 16:28:58.861057 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Connection: close Sep 21 16:28:58.861057 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Length: 74 Sep 21 16:28:58.861057 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Type: application/json Sep 21 16:28:58.861057 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Host: 10.222.0.64 Sep 21 16:28:58.861057 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Openstack-System-Scope: None Sep 21 16:28:58.861057 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: User-Agent: python-urllib3/1.26.12 Sep 21 16:28:58.861057 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Auth-Token: gAAAAABjKzptDl5Jwme7JQaRL3V8XsiXvjsgkfXKC5CR9zEf_XxPd1NsWodDna8_dBwDJyu9_lHil_M0vLPPzmX177kcKqWx5X8mqOmQSrRLHHx1LRIv3gdLEkJSUiwMVF6fR-kEaNic5IQ5zuSAZa0555zHli7HQ0zguOZ1COKKRN-ARxj0HyM Sep 21 16:28:58.861057 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Id: None Sep 21 16:28:58.861057 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Name: None Sep 21 16:28:58.861057 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Identity-Status: Confirmed Sep 21 16:28:58.861057 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Is-Admin-Project: True Sep 21 16:28:58.861057 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Id: default Sep 21 16:28:58.861057 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Name: Default Sep 21 16:28:58.861057 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Id: ce7a3e77ddf14b48986752434dda6d33 Sep 21 16:28:58.861057 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Name: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:28:58.861057 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Role: member,reader Sep 21 16:28:58.861057 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Roles: member,reader Sep 21 16:28:58.862687 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce7a3e77ddf14b48986752434dda6d33"}]}] Sep 21 16:28:58.862687 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:28:58.862687 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Id: ce7a3e77ddf14b48986752434dda6d33 Sep 21 16:28:58.862687 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:28:58.862687 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User: tempest-AttachVolumeNegativeTest-67026365-project Sep 21 16:28:58.862687 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Id: default Sep 21 16:28:58.862687 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Name: Default Sep 21 16:28:58.862687 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Id: b917d84a650f4355a676e315ea039f0e Sep 21 16:28:58.862687 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Name: tempest-AttachVolumeNegativeTest-67026365-project Sep 21 16:28:58.862687 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Sep 21 16:28:58.862687 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: {"volumeAttachment": {"volumeId": "6e8a67fa-baa7-4fff-8caf-0563d7e1ea91"}} Sep 21 16:28:58.862687 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: method: > Sep 21 16:28:58.864245 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: exception: Invalid volume: volume 6e8a67fa-baa7-4fff-8caf-0563d7e1ea91 is already attached to instances: 608e4231-8635-45db-b2d6-6b0710c3120f Sep 21 16:28:58.864245 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: action_args: {'server_id': '608e4231-8635-45db-b2d6-6b0710c3120f', 'body': {'volumeAttachment': {'volumeId': '6e8a67fa-baa7-4fff-8caf-0563d7e1ea91'}}} Sep 21 16:28:58.864245 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:28:58.864245 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:28:58.864245 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 21 16:28:58.864245 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 21 16:28:58.864245 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 21 16:28:58.864245 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 21 16:28:58.864245 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 21 16:28:58.864245 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 21 16:28:58.864245 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 21 16:28:58.864245 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 21 16:28:58.864245 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 21 16:28:58.864245 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 21 16:28:58.864245 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6e8a67fa-baa7-4fff-8caf-0563d7e1ea91 is already attached to instances: 608e4231-8635-45db-b2d6-6b0710c3120f Sep 21 16:28:58.864245 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:28:58.864245 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:28:58.864245 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:28:58.864245 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:28:58.865452 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:28:58.865452 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:28:58.865452 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:28:58.865452 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:28:58.865452 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:28:58.865452 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:28:58.865452 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 21 16:28:58.865452 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 21 16:28:58.865452 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 21 16:28:58.865452 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 21 16:28:58.865452 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 21 16:28:58.865452 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 21 16:28:58.865452 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 21 16:28:58.865452 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 21 16:28:58.865452 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6e8a67fa-baa7-4fff-8caf-0563d7e1ea91 is already attached to instances: 608e4231-8635-45db-b2d6-6b0710c3120f Sep 21 16:28:58.865452 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:28:58.865452 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:28:58.865452 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:28:58.865452 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:28:58.865452 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:28:58.866955 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:28:58.866955 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:28:58.866955 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:28:58.866955 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6e8a67fa-baa7-4fff-8caf-0563d7e1ea91 is already attached to instances: 608e4231-8635-45db-b2d6-6b0710c3120f Sep 21 16:28:58.866955 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:28:58.866955 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-d23d6a6a-4cc1-4765-8ef7-fa42e020bc67 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Returning 400 to user: Invalid volume: volume 6e8a67fa-baa7-4fff-8caf-0563d7e1ea91 is already attached to instances: 608e4231-8635-45db-b2d6-6b0710c3120f {{(pid=120532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:28:58.866955 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-d23d6a6a-4cc1-4765-8ef7-fa42e020bc67 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "POST /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.109416 Sep 21 16:28:58.869751 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 421/759] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Sep 21 16:28:58 2022] POST /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f/os-volume_attachments => generated 174 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 21 16:28:58.946691 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-0c3d556f-a63c-4dc1-af42-f8c471dc36a0 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:58.947185 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-0c3d556f-a63c-4dc1-af42-f8c471dc36a0 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 608e4231-8635-45db-b2d6-6b0710c3120f] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:58.953302 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0c3d556f-a63c-4dc1-af42-f8c471dc36a0 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:58.953792 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0c3d556f-a63c-4dc1-af42-f8c471dc36a0 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:58.954254 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0c3d556f-a63c-4dc1-af42-f8c471dc36a0 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:58.954954 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0c3d556f-a63c-4dc1-af42-f8c471dc36a0 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:58.955408 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0c3d556f-a63c-4dc1-af42-f8c471dc36a0 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:58.955825 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0c3d556f-a63c-4dc1-af42-f8c471dc36a0 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:59.048913 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.objects.instance [None req-0c3d556f-a63c-4dc1-af42-f8c471dc36a0 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lazy-loading 'services' on Instance uuid 608e4231-8635-45db-b2d6-6b0710c3120f {{(pid=120531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 16:28:59.051798 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ef1273e9-a833-4e01-9d22-76337a52398a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:59.054356 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ef1273e9-a833-4e01-9d22-76337a52398a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:59.060677 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ef1273e9-a833-4e01-9d22-76337a52398a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:59.062612 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ef1273e9-a833-4e01-9d22-76337a52398a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:59.063116 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ef1273e9-a833-4e01-9d22-76337a52398a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:59.063996 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ef1273e9-a833-4e01-9d22-76337a52398a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:59.064548 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ef1273e9-a833-4e01-9d22-76337a52398a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:59.065104 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ef1273e9-a833-4e01-9d22-76337a52398a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:59.127209 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ef1273e9-a833-4e01-9d22-76337a52398a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080456 Sep 21 16:28:59.127801 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 422/760] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Sep 21 16:28:59 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 21 16:28:59.155727 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-0c3d556f-a63c-4dc1-af42-f8c471dc36a0 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "DELETE /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f/os-volume_attachments/6e8a67fa-baa7-4fff-8caf-0563d7e1ea91" status: 202 len: 0 microversion: 2.1 time: 0.212670 Sep 21 16:28:59.156366 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 339/761] 10.222.0.64 () {58 vars in 1416 bytes} [Wed Sep 21 16:28:58 2022] DELETE /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f/os-volume_attachments/6e8a67fa-baa7-4fff-8caf-0563d7e1ea91 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 16:28:59.168372 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-0f94a16a-1c29-467a-a280-e892af9a8b8e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:59.171338 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-0f94a16a-1c29-467a-a280-e892af9a8b8e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 608e4231-8635-45db-b2d6-6b0710c3120f] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:59.181595 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0f94a16a-1c29-467a-a280-e892af9a8b8e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:59.182449 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0f94a16a-1c29-467a-a280-e892af9a8b8e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:59.183334 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0f94a16a-1c29-467a-a280-e892af9a8b8e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:59.184416 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0f94a16a-1c29-467a-a280-e892af9a8b8e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:59.185125 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0f94a16a-1c29-467a-a280-e892af9a8b8e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:59.185692 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0f94a16a-1c29-467a-a280-e892af9a8b8e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:59.221428 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-0f94a16a-1c29-467a-a280-e892af9a8b8e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057988 Sep 21 16:28:59.230117 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 423/762] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Sep 21 16:28:59 2022] GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:28:59.281497 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-3cd70940-fc2d-4e7b-aa7c-62646ceae23b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:59.282208 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-3cd70940-fc2d-4e7b-aa7c-62646ceae23b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:59.289501 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3cd70940-fc2d-4e7b-aa7c-62646ceae23b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:59.290121 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3cd70940-fc2d-4e7b-aa7c-62646ceae23b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:59.291370 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3cd70940-fc2d-4e7b-aa7c-62646ceae23b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:59.292303 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3cd70940-fc2d-4e7b-aa7c-62646ceae23b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:59.292990 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3cd70940-fc2d-4e7b-aa7c-62646ceae23b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:59.293614 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3cd70940-fc2d-4e7b-aa7c-62646ceae23b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:59.341376 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-3cd70940-fc2d-4e7b-aa7c-62646ceae23b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Going to try to terminate instance {{(pid=120531) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 16:28:59.375533 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=5,nova_cell1:UPDATE=3 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:28:59.442363 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-3cd70940-fc2d-4e7b-aa7c-62646ceae23b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "DELETE /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 204 len: 0 microversion: 2.1 time: 0.165349 Sep 21 16:28:59.443237 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 340/763] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Sep 21 16:28:59 2022] DELETE /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 21 16:28:59.451830 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-2fe093e5-21b5-4dfb-ac06-8855b0a4ae5b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:28:59.452441 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-2fe093e5-21b5-4dfb-ac06-8855b0a4ae5b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:28:59.459385 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2fe093e5-21b5-4dfb-ac06-8855b0a4ae5b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:59.459917 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2fe093e5-21b5-4dfb-ac06-8855b0a4ae5b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:59.460376 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2fe093e5-21b5-4dfb-ac06-8855b0a4ae5b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:59.461095 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2fe093e5-21b5-4dfb-ac06-8855b0a4ae5b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:28:59.461555 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2fe093e5-21b5-4dfb-ac06-8855b0a4ae5b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:28:59.462385 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2fe093e5-21b5-4dfb-ac06-8855b0a4ae5b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:28:59.599718 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-2fe093e5-21b5-4dfb-ac06-8855b0a4ae5b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:28:59.607810 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-2fe093e5-21b5-4dfb-ac06-8855b0a4ae5b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1689 microversion: 2.1 time: 0.160194 Sep 21 16:28:59.608390 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 424/764] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:28:59 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:00.251931 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-57a6dba1-f73b-473e-bdcc-5182638eaa67 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:00.254435 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-57a6dba1-f73b-473e-bdcc-5182638eaa67 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 608e4231-8635-45db-b2d6-6b0710c3120f] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:00.261631 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-57a6dba1-f73b-473e-bdcc-5182638eaa67 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:00.262773 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-57a6dba1-f73b-473e-bdcc-5182638eaa67 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:00.263218 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-57a6dba1-f73b-473e-bdcc-5182638eaa67 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:00.263955 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-57a6dba1-f73b-473e-bdcc-5182638eaa67 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:00.264416 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-57a6dba1-f73b-473e-bdcc-5182638eaa67 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:00.264844 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-57a6dba1-f73b-473e-bdcc-5182638eaa67 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:00.301934 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-57a6dba1-f73b-473e-bdcc-5182638eaa67 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055099 Sep 21 16:29:00.302574 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 341/765] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Sep 21 16:29:00 2022] GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:29:00.635673 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-7786434f-1e88-4871-8b4c-49854733572d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:00.636760 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-7786434f-1e88-4871-8b4c-49854733572d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:00.648964 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7786434f-1e88-4871-8b4c-49854733572d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:00.650161 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7786434f-1e88-4871-8b4c-49854733572d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:00.650723 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7786434f-1e88-4871-8b4c-49854733572d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:00.651882 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7786434f-1e88-4871-8b4c-49854733572d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:00.652658 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7786434f-1e88-4871-8b4c-49854733572d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:00.653101 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7786434f-1e88-4871-8b4c-49854733572d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:00.909497 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-7786434f-1e88-4871-8b4c-49854733572d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:00.920420 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-7786434f-1e88-4871-8b4c-49854733572d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1689 microversion: 2.1 time: 0.292951 Sep 21 16:29:00.921313 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 425/766] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:00 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1689 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:01.317232 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-4e1cf006-6038-4460-a56a-17caa9066244 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:01.320499 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-4e1cf006-6038-4460-a56a-17caa9066244 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 608e4231-8635-45db-b2d6-6b0710c3120f] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:01.328099 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4e1cf006-6038-4460-a56a-17caa9066244 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:01.328762 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4e1cf006-6038-4460-a56a-17caa9066244 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:01.329298 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4e1cf006-6038-4460-a56a-17caa9066244 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:01.330203 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4e1cf006-6038-4460-a56a-17caa9066244 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:01.330781 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4e1cf006-6038-4460-a56a-17caa9066244 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:01.331304 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4e1cf006-6038-4460-a56a-17caa9066244 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:01.375455 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-4e1cf006-6038-4460-a56a-17caa9066244 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064535 Sep 21 16:29:01.376641 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 342/767] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Sep 21 16:29:01 2022] GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:29:01.949342 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-9c5bab95-9be8-4569-bf1e-505ca365cb7b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:01.950423 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-9c5bab95-9be8-4569-bf1e-505ca365cb7b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:01.959199 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9c5bab95-9be8-4569-bf1e-505ca365cb7b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:01.959792 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9c5bab95-9be8-4569-bf1e-505ca365cb7b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:01.960499 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9c5bab95-9be8-4569-bf1e-505ca365cb7b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:01.961624 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9c5bab95-9be8-4569-bf1e-505ca365cb7b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:01.962184 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9c5bab95-9be8-4569-bf1e-505ca365cb7b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:01.962681 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9c5bab95-9be8-4569-bf1e-505ca365cb7b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:02.124558 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-9c5bab95-9be8-4569-bf1e-505ca365cb7b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:02.134144 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-9c5bab95-9be8-4569-bf1e-505ca365cb7b tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1689 microversion: 2.1 time: 0.190491 Sep 21 16:29:02.134768 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 426/768] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:01 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1689 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:02.388908 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-bf408cd3-089b-4bb0-b3ae-a7de7fd8fd84 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:02.391727 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-bf408cd3-089b-4bb0-b3ae-a7de7fd8fd84 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 608e4231-8635-45db-b2d6-6b0710c3120f] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:02.399377 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bf408cd3-089b-4bb0-b3ae-a7de7fd8fd84 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:02.399863 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bf408cd3-089b-4bb0-b3ae-a7de7fd8fd84 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:02.400289 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bf408cd3-089b-4bb0-b3ae-a7de7fd8fd84 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:02.400985 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bf408cd3-089b-4bb0-b3ae-a7de7fd8fd84 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:02.401434 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bf408cd3-089b-4bb0-b3ae-a7de7fd8fd84 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:02.401846 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bf408cd3-089b-4bb0-b3ae-a7de7fd8fd84 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:02.433858 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-bf408cd3-089b-4bb0-b3ae-a7de7fd8fd84 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048818 Sep 21 16:29:02.434471 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 343/769] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Sep 21 16:29:02 2022] GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:29:03.160457 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-88a13aed-7817-4518-a2b7-4b1130133f04 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:03.161125 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-88a13aed-7817-4518-a2b7-4b1130133f04 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:03.167819 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-88a13aed-7817-4518-a2b7-4b1130133f04 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:03.168321 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-88a13aed-7817-4518-a2b7-4b1130133f04 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:03.168759 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-88a13aed-7817-4518-a2b7-4b1130133f04 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:03.169620 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-88a13aed-7817-4518-a2b7-4b1130133f04 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:03.170234 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-88a13aed-7817-4518-a2b7-4b1130133f04 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:03.170676 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-88a13aed-7817-4518-a2b7-4b1130133f04 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:03.367154 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-88a13aed-7817-4518-a2b7-4b1130133f04 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:03.376520 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-88a13aed-7817-4518-a2b7-4b1130133f04 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1689 microversion: 2.1 time: 0.221345 Sep 21 16:29:03.377701 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 427/770] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:03 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1689 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:03.447518 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-6edfb090-7efc-425b-a4f8-92531a19d8e7 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:03.450659 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-6edfb090-7efc-425b-a4f8-92531a19d8e7 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 608e4231-8635-45db-b2d6-6b0710c3120f] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:03.457951 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6edfb090-7efc-425b-a4f8-92531a19d8e7 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:03.458657 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6edfb090-7efc-425b-a4f8-92531a19d8e7 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:03.459382 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6edfb090-7efc-425b-a4f8-92531a19d8e7 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:03.460724 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6edfb090-7efc-425b-a4f8-92531a19d8e7 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:03.461302 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6edfb090-7efc-425b-a4f8-92531a19d8e7 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:03.461793 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6edfb090-7efc-425b-a4f8-92531a19d8e7 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:03.497056 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-6edfb090-7efc-425b-a4f8-92531a19d8e7 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053856 Sep 21 16:29:03.503273 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 344/771] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Sep 21 16:29:03 2022] GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 21 16:29:03.571346 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ff07f8bf-9789-476d-a607-59ba803f0891 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:03.571859 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ff07f8bf-9789-476d-a607-59ba803f0891 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 608e4231-8635-45db-b2d6-6b0710c3120f] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:03.578182 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ff07f8bf-9789-476d-a607-59ba803f0891 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:03.578679 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ff07f8bf-9789-476d-a607-59ba803f0891 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:03.579122 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ff07f8bf-9789-476d-a607-59ba803f0891 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:03.579836 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ff07f8bf-9789-476d-a607-59ba803f0891 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:03.580296 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ff07f8bf-9789-476d-a607-59ba803f0891 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:03.580727 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ff07f8bf-9789-476d-a607-59ba803f0891 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:03.601288 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=100 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:29:03.612594 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ff07f8bf-9789-476d-a607-59ba803f0891 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 608e4231-8635-45db-b2d6-6b0710c3120f] Going to try to terminate instance {{(pid=120532) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 16:29:03.713166 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ff07f8bf-9789-476d-a607-59ba803f0891 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "DELETE /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f" status: 204 len: 0 microversion: 2.1 time: 0.145195 Sep 21 16:29:03.714245 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 428/772] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Sep 21 16:29:03 2022] DELETE /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 21 16:29:03.724609 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d29477fb-13c9-4abc-8e18-027ec4e10082 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:03.725325 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d29477fb-13c9-4abc-8e18-027ec4e10082 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 608e4231-8635-45db-b2d6-6b0710c3120f] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:03.731888 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d29477fb-13c9-4abc-8e18-027ec4e10082 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:03.732377 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d29477fb-13c9-4abc-8e18-027ec4e10082 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:03.733035 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d29477fb-13c9-4abc-8e18-027ec4e10082 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:03.733752 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d29477fb-13c9-4abc-8e18-027ec4e10082 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:03.734248 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d29477fb-13c9-4abc-8e18-027ec4e10082 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:03.734670 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d29477fb-13c9-4abc-8e18-027ec4e10082 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:03.961123 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d29477fb-13c9-4abc-8e18-027ec4e10082 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:03.969332 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d29477fb-13c9-4abc-8e18-027ec4e10082 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f" status: 200 len: 1679 microversion: 2.1 time: 0.249753 Sep 21 16:29:03.969844 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 345/773] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:03 2022] GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f => generated 1679 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:04.312980 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-cf712aa7-38d3-436e-9f45-fae6a0a7de9f req-2ec491ab-af3a-422c-9392-2dc823b4575e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c95f478c-11b2-4097-b4b1-551d61fa9664", "name": "network-vif-deleted", "tag": "7cbba0ad-56a3-429e-97a5-3e5eae0b9c40"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:29:04.323259 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-cf712aa7-38d3-436e-9f45-fae6a0a7de9f req-2ec491ab-af3a-422c-9392-2dc823b4575e service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:04.323736 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-cf712aa7-38d3-436e-9f45-fae6a0a7de9f req-2ec491ab-af3a-422c-9392-2dc823b4575e service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:04.324356 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-cf712aa7-38d3-436e-9f45-fae6a0a7de9f req-2ec491ab-af3a-422c-9392-2dc823b4575e service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:04.336117 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-cf712aa7-38d3-436e-9f45-fae6a0a7de9f req-2ec491ab-af3a-422c-9392-2dc823b4575e service nova] Creating event network-vif-deleted:7cbba0ad-56a3-429e-97a5-3e5eae0b9c40 for instance c95f478c-11b2-4097-b4b1-551d61fa9664 on hv-cinder-85862 Sep 21 16:29:04.341171 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-cf712aa7-38d3-436e-9f45-fae6a0a7de9f req-2ec491ab-af3a-422c-9392-2dc823b4575e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032201 Sep 21 16:29:04.342125 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 429/774] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:29:04.416975 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-c0a8dbf2-8cdb-4e5e-b864-1d98e4e8810d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:04.417767 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-c0a8dbf2-8cdb-4e5e-b864-1d98e4e8810d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:04.424493 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c0a8dbf2-8cdb-4e5e-b864-1d98e4e8810d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:04.425112 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c0a8dbf2-8cdb-4e5e-b864-1d98e4e8810d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:04.426455 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c0a8dbf2-8cdb-4e5e-b864-1d98e4e8810d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:04.426455 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c0a8dbf2-8cdb-4e5e-b864-1d98e4e8810d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:04.426987 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c0a8dbf2-8cdb-4e5e-b864-1d98e4e8810d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:04.427465 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c0a8dbf2-8cdb-4e5e-b864-1d98e4e8810d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:04.499031 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-c0a8dbf2-8cdb-4e5e-b864-1d98e4e8810d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:04.513228 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-c0a8dbf2-8cdb-4e5e-b864-1d98e4e8810d tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1621 microversion: 2.1 time: 0.100009 Sep 21 16:29:04.514844 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 346/775] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:04 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1621 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:04.994064 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-a272e736-9b03-4754-a368-037180e8205f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:04.994763 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-a272e736-9b03-4754-a368-037180e8205f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 608e4231-8635-45db-b2d6-6b0710c3120f] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:05.001348 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a272e736-9b03-4754-a368-037180e8205f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:05.001842 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a272e736-9b03-4754-a368-037180e8205f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:05.002312 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a272e736-9b03-4754-a368-037180e8205f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:05.003035 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a272e736-9b03-4754-a368-037180e8205f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:05.004113 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a272e736-9b03-4754-a368-037180e8205f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:05.004543 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a272e736-9b03-4754-a368-037180e8205f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:05.208356 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a272e736-9b03-4754-a368-037180e8205f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:05.218650 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-a272e736-9b03-4754-a368-037180e8205f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f" status: 200 len: 1679 microversion: 2.1 time: 0.228909 Sep 21 16:29:05.219261 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 430/776] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:04 2022] GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f => generated 1679 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:05.539878 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-4496fe16-ba7c-48a5-8104-ff81a6bc6327 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:05.540435 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-4496fe16-ba7c-48a5-8104-ff81a6bc6327 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:05.547416 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4496fe16-ba7c-48a5-8104-ff81a6bc6327 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:05.548010 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4496fe16-ba7c-48a5-8104-ff81a6bc6327 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:05.548601 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4496fe16-ba7c-48a5-8104-ff81a6bc6327 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:05.549320 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4496fe16-ba7c-48a5-8104-ff81a6bc6327 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:05.549949 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4496fe16-ba7c-48a5-8104-ff81a6bc6327 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:05.550591 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4496fe16-ba7c-48a5-8104-ff81a6bc6327 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:05.586515 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4496fe16-ba7c-48a5-8104-ff81a6bc6327 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:05.587324 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4496fe16-ba7c-48a5-8104-ff81a6bc6327 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:05.587787 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4496fe16-ba7c-48a5-8104-ff81a6bc6327 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:05.588201 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.objects.instance [None req-4496fe16-ba7c-48a5-8104-ff81a6bc6327 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lazy-loading 'fault' on Instance uuid c95f478c-11b2-4097-b4b1-551d61fa9664 {{(pid=120531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 16:29:05.687447 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-4496fe16-ba7c-48a5-8104-ff81a6bc6327 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:05.695703 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-4496fe16-ba7c-48a5-8104-ff81a6bc6327 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 200 len: 1335 microversion: 2.1 time: 0.160819 Sep 21 16:29:05.696303 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 347/777] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:05 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 1335 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:06.243922 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-8378b30f-7a2c-46ec-ba99-ef1c2d033bbb tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:06.246333 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-8378b30f-7a2c-46ec-ba99-ef1c2d033bbb tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 608e4231-8635-45db-b2d6-6b0710c3120f] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:06.252309 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8378b30f-7a2c-46ec-ba99-ef1c2d033bbb tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:06.252806 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8378b30f-7a2c-46ec-ba99-ef1c2d033bbb tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:06.253871 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8378b30f-7a2c-46ec-ba99-ef1c2d033bbb tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:06.254673 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8378b30f-7a2c-46ec-ba99-ef1c2d033bbb tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:06.255133 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8378b30f-7a2c-46ec-ba99-ef1c2d033bbb tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:06.255558 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8378b30f-7a2c-46ec-ba99-ef1c2d033bbb tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:06.428188 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-8378b30f-7a2c-46ec-ba99-ef1c2d033bbb tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:06.438414 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-8378b30f-7a2c-46ec-ba99-ef1c2d033bbb tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f" status: 200 len: 1679 microversion: 2.1 time: 0.198295 Sep 21 16:29:06.439111 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 431/778] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:06 2022] GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f => generated 1679 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:06.694938 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-0fcc6e7e-7478-40cf-b801-947493569f07 req-9bb0e4d0-f49f-4d4f-892a-405eb00496f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "608e4231-8635-45db-b2d6-6b0710c3120f", "name": "network-vif-deleted", "tag": "8eb105fe-8645-41dc-876d-e301557328f9"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:29:06.707586 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-0fcc6e7e-7478-40cf-b801-947493569f07 req-9bb0e4d0-f49f-4d4f-892a-405eb00496f5 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:06.708973 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-0fcc6e7e-7478-40cf-b801-947493569f07 req-9bb0e4d0-f49f-4d4f-892a-405eb00496f5 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:06.710093 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-0fcc6e7e-7478-40cf-b801-947493569f07 req-9bb0e4d0-f49f-4d4f-892a-405eb00496f5 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:06.729110 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-f63b9775-2078-4878-8b78-c66f2bfc79e3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:06.729738 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-f63b9775-2078-4878-8b78-c66f2bfc79e3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: c95f478c-11b2-4097-b4b1-551d61fa9664] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:06.730941 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-0fcc6e7e-7478-40cf-b801-947493569f07 req-9bb0e4d0-f49f-4d4f-892a-405eb00496f5 service nova] Creating event network-vif-deleted:8eb105fe-8645-41dc-876d-e301557328f9 for instance 608e4231-8635-45db-b2d6-6b0710c3120f on hv-cinder-85862 Sep 21 16:29:06.744472 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-0fcc6e7e-7478-40cf-b801-947493569f07 req-9bb0e4d0-f49f-4d4f-892a-405eb00496f5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051433 Sep 21 16:29:06.745861 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f63b9775-2078-4878-8b78-c66f2bfc79e3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:06.746093 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 348/779] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:29:06.746777 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f63b9775-2078-4878-8b78-c66f2bfc79e3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:06.747507 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f63b9775-2078-4878-8b78-c66f2bfc79e3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:06.752293 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f63b9775-2078-4878-8b78-c66f2bfc79e3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:06.753112 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f63b9775-2078-4878-8b78-c66f2bfc79e3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:06.753772 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f63b9775-2078-4878-8b78-c66f2bfc79e3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:06.770713 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.wsgi [None req-f63b9775-2078-4878-8b78-c66f2bfc79e3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] HTTP exception thrown: Instance c95f478c-11b2-4097-b4b1-551d61fa9664 could not be found. Sep 21 16:29:06.772569 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-f63b9775-2078-4878-8b78-c66f2bfc79e3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Request method failure captured: Sep 21 16:29:06.772569 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: request: GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 HTTP/1.1 Sep 21 16:29:06.772569 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept: application/json Sep 21 16:29:06.772569 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept-Encoding: identity Sep 21 16:29:06.772569 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Connection: close Sep 21 16:29:06.772569 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Length: 0 Sep 21 16:29:06.772569 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Type: application/json Sep 21 16:29:06.772569 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Host: 10.222.0.64 Sep 21 16:29:06.772569 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Openstack-System-Scope: None Sep 21 16:29:06.772569 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: User-Agent: python-urllib3/1.26.12 Sep 21 16:29:06.772569 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Auth-Token: gAAAAABjKzpyl2VCA8qOXz_21Lb4_x9U1Xx-KlcjECNulDWe7htEJ0Af4mLHkpXjsPlA1iQ8jPMrxiWhztqQcFxCTlE1P4S3HVT0CeR12yBvkFP50lGbKEP4T7hlDNnQEqfVaKzVcRuzvbEZYlwT4nr23Om4knGB4vuwh-cjuvcsP1wXC1rngVU Sep 21 16:29:06.772569 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Id: None Sep 21 16:29:06.772569 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Name: None Sep 21 16:29:06.772569 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Identity-Status: Confirmed Sep 21 16:29:06.772569 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Is-Admin-Project: True Sep 21 16:29:06.772569 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Id: default Sep 21 16:29:06.772569 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Name: Default Sep 21 16:29:06.772569 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Id: b93e202a295d427a85fdaf0209951bd5 Sep 21 16:29:06.772569 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-717335908 Sep 21 16:29:06.772569 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Role: member,reader Sep 21 16:29:06.772569 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Roles: member,reader Sep 21 16:29:06.774493 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/b93e202a295d427a85fdaf0209951bd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b93e202a295d427a85fdaf0209951bd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_b93e202a295d427a85fdaf0209951bd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b93e202a295d427a85fdaf0209951bd5"}]}] Sep 21 16:29:06.774493 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant: tempest-ServerRescueNegativeTestJSON-717335908 Sep 21 16:29:06.774493 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Id: b93e202a295d427a85fdaf0209951bd5 Sep 21 16:29:06.774493 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-717335908 Sep 21 16:29:06.774493 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User: tempest-ServerRescueNegativeTestJSON-717335908-project Sep 21 16:29:06.774493 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Id: default Sep 21 16:29:06.774493 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Name: Default Sep 21 16:29:06.774493 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Id: d2382a6610ae42fa865283ed12dd9982 Sep 21 16:29:06.774493 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Name: tempest-ServerRescueNegativeTestJSON-717335908-project Sep 21 16:29:06.774493 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: method: > Sep 21 16:29:06.774493 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: exception: Instance c95f478c-11b2-4097-b4b1-551d61fa9664 could not be found. Sep 21 16:29:06.774493 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: action_args: {'id': 'c95f478c-11b2-4097-b4b1-551d61fa9664'} Sep 21 16:29:06.775538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:29:06.775538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:29:06.775538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 16:29:06.775538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 16:29:06.775538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 16:29:06.775538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 16:29:06.775538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 16:29:06.775538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 16:29:06.775538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 16:29:06.775538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 16:29:06.775538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c95f478c-11b2-4097-b4b1-551d61fa9664 could not be found. Sep 21 16:29:06.775538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:29:06.775538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:29:06.775538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:29:06.775538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:29:06.775538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:29:06.775538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:29:06.775538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:29:06.775538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:29:06.775538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:29:06.777047 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:29:06.777047 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 16:29:06.777047 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 16:29:06.777047 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 16:29:06.777047 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 16:29:06.777047 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 16:29:06.777047 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:29:06.777047 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c95f478c-11b2-4097-b4b1-551d61fa9664 could not be found. Sep 21 16:29:06.777047 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:29:06.777047 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:29:06.777047 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:29:06.777047 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:29:06.777047 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:29:06.777047 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:29:06.777047 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:29:06.777047 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:29:06.777047 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c95f478c-11b2-4097-b4b1-551d61fa9664 could not be found. Sep 21 16:29:06.777047 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:29:06.778537 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-f63b9775-2078-4878-8b78-c66f2bfc79e3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Returning 404 to user: Instance c95f478c-11b2-4097-b4b1-551d61fa9664 could not be found. {{(pid=120532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:29:06.779162 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-f63b9775-2078-4878-8b78-c66f2bfc79e3 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664" status: 404 len: 111 microversion: 2.1 time: 0.058943 Sep 21 16:29:06.783040 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 432/780] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:06 2022] GET /compute/v2.1/servers/c95f478c-11b2-4097-b4b1-551d61fa9664 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 21 16:29:06.789426 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-dceca82d-32f9-4880-a98a-3c7fb3582cdb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '.version_select at 0x7fdb88a98820>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:06.813006 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-dceca82d-32f9-4880-a98a-3c7fb3582cdb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1452663926" status: 202 len: 0 microversion: 2.1 time: 0.028266 Sep 21 16:29:06.814503 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 349/781] 10.222.0.64 () {58 vars in 1221 bytes} [Wed Sep 21 16:29:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1452663926 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 21 16:29:07.483369 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-40ad2777-6eb7-4e2f-9345-ac028073864b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:07.485219 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-40ad2777-6eb7-4e2f-9345-ac028073864b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 608e4231-8635-45db-b2d6-6b0710c3120f] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:07.495956 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-40ad2777-6eb7-4e2f-9345-ac028073864b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:07.496721 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-40ad2777-6eb7-4e2f-9345-ac028073864b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:07.497295 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-40ad2777-6eb7-4e2f-9345-ac028073864b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:07.498432 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-40ad2777-6eb7-4e2f-9345-ac028073864b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:07.498893 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-40ad2777-6eb7-4e2f-9345-ac028073864b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:07.499465 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-40ad2777-6eb7-4e2f-9345-ac028073864b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:07.539495 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-40ad2777-6eb7-4e2f-9345-ac028073864b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:07.539863 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-40ad2777-6eb7-4e2f-9345-ac028073864b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:07.540294 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-40ad2777-6eb7-4e2f-9345-ac028073864b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:07.541063 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.objects.instance [None req-40ad2777-6eb7-4e2f-9345-ac028073864b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lazy-loading 'fault' on Instance uuid 608e4231-8635-45db-b2d6-6b0710c3120f {{(pid=120532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 16:29:07.593363 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-40ad2777-6eb7-4e2f-9345-ac028073864b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:07.603925 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-40ad2777-6eb7-4e2f-9345-ac028073864b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f" status: 200 len: 1330 microversion: 2.1 time: 0.127012 Sep 21 16:29:07.604514 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 433/782] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:07 2022] GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f => generated 1330 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:08.630304 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-7bbff541-f028-46ac-90f3-d54cf903a578 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:08.631169 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-7bbff541-f028-46ac-90f3-d54cf903a578 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 608e4231-8635-45db-b2d6-6b0710c3120f] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:08.640111 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7bbff541-f028-46ac-90f3-d54cf903a578 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:08.640594 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7bbff541-f028-46ac-90f3-d54cf903a578 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:08.641150 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7bbff541-f028-46ac-90f3-d54cf903a578 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:08.641940 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7bbff541-f028-46ac-90f3-d54cf903a578 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:08.642435 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7bbff541-f028-46ac-90f3-d54cf903a578 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:08.642921 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7bbff541-f028-46ac-90f3-d54cf903a578 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:08.658370 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.wsgi [None req-7bbff541-f028-46ac-90f3-d54cf903a578 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] HTTP exception thrown: Instance 608e4231-8635-45db-b2d6-6b0710c3120f could not be found. Sep 21 16:29:08.660649 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-7bbff541-f028-46ac-90f3-d54cf903a578 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Request method failure captured: Sep 21 16:29:08.660649 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: request: GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f HTTP/1.1 Sep 21 16:29:08.660649 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept: application/json Sep 21 16:29:08.660649 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept-Encoding: identity Sep 21 16:29:08.660649 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Connection: close Sep 21 16:29:08.660649 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Length: 0 Sep 21 16:29:08.660649 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Type: application/json Sep 21 16:29:08.660649 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Host: 10.222.0.64 Sep 21 16:29:08.660649 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Openstack-System-Scope: None Sep 21 16:29:08.660649 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: User-Agent: python-urllib3/1.26.12 Sep 21 16:29:08.660649 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Auth-Token: gAAAAABjKzptDl5Jwme7JQaRL3V8XsiXvjsgkfXKC5CR9zEf_XxPd1NsWodDna8_dBwDJyu9_lHil_M0vLPPzmX177kcKqWx5X8mqOmQSrRLHHx1LRIv3gdLEkJSUiwMVF6fR-kEaNic5IQ5zuSAZa0555zHli7HQ0zguOZ1COKKRN-ARxj0HyM Sep 21 16:29:08.660649 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Id: None Sep 21 16:29:08.660649 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Name: None Sep 21 16:29:08.660649 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Identity-Status: Confirmed Sep 21 16:29:08.660649 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Is-Admin-Project: True Sep 21 16:29:08.660649 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Id: default Sep 21 16:29:08.660649 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Name: Default Sep 21 16:29:08.660649 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Id: ce7a3e77ddf14b48986752434dda6d33 Sep 21 16:29:08.660649 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Name: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:29:08.660649 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Role: member,reader Sep 21 16:29:08.660649 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Roles: member,reader Sep 21 16:29:08.663151 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce7a3e77ddf14b48986752434dda6d33"}]}] Sep 21 16:29:08.663151 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:29:08.663151 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Id: ce7a3e77ddf14b48986752434dda6d33 Sep 21 16:29:08.663151 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:29:08.663151 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User: tempest-AttachVolumeNegativeTest-67026365-project Sep 21 16:29:08.663151 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Id: default Sep 21 16:29:08.663151 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Name: Default Sep 21 16:29:08.663151 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Id: b917d84a650f4355a676e315ea039f0e Sep 21 16:29:08.663151 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Name: tempest-AttachVolumeNegativeTest-67026365-project Sep 21 16:29:08.663151 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: method: > Sep 21 16:29:08.663151 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: exception: Instance 608e4231-8635-45db-b2d6-6b0710c3120f could not be found. Sep 21 16:29:08.663151 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: action_args: {'id': '608e4231-8635-45db-b2d6-6b0710c3120f'} Sep 21 16:29:08.664734 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:29:08.664734 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:29:08.664734 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 16:29:08.664734 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 16:29:08.664734 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 16:29:08.664734 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 16:29:08.664734 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 16:29:08.664734 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 16:29:08.664734 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 16:29:08.664734 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 16:29:08.664734 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 608e4231-8635-45db-b2d6-6b0710c3120f could not be found. Sep 21 16:29:08.664734 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:29:08.664734 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:29:08.664734 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:29:08.664734 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:29:08.664734 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:29:08.664734 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:29:08.664734 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:29:08.664734 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:29:08.664734 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:29:08.667160 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:29:08.667160 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 16:29:08.667160 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 16:29:08.667160 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 16:29:08.667160 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 16:29:08.667160 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 16:29:08.667160 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:29:08.667160 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 608e4231-8635-45db-b2d6-6b0710c3120f could not be found. Sep 21 16:29:08.667160 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:29:08.667160 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:29:08.667160 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:29:08.667160 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:29:08.667160 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:29:08.667160 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:29:08.667160 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:29:08.667160 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:29:08.667160 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 608e4231-8635-45db-b2d6-6b0710c3120f could not be found. Sep 21 16:29:08.667160 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:29:08.669254 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-7bbff541-f028-46ac-90f3-d54cf903a578 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Returning 404 to user: Instance 608e4231-8635-45db-b2d6-6b0710c3120f could not be found. {{(pid=120531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:29:08.669254 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-7bbff541-f028-46ac-90f3-d54cf903a578 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f" status: 404 len: 111 microversion: 2.1 time: 0.036911 Sep 21 16:29:08.669254 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 350/783] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:08 2022] GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 16:29:08.675616 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-e9f53bf8-ea92-483c-972b-c27e68320bd5 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '.version_select at 0x7fdb88a62430>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:08.704557 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-e9f53bf8-ea92-483c-972b-c27e68320bd5 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-90004007" status: 202 len: 0 microversion: 2.1 time: 0.036295 Sep 21 16:29:08.705140 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 434/784] 10.222.0.64 () {58 vars in 1215 bytes} [Wed Sep 21 16:29:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-90004007 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 16:29:09.411794 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-a62c5efe-2c7c-4e2d-8f91-3601014d56ac tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Action: 'create', calling method: .version_select at 0x7fdb88a89d30>, body: {"keypair": {"name": "tempest-keypair-524913399", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOO88u9pwFDwG+SxW6e4WCY8Zv2h28ovtgzYfxI1ltY29kmuVFB4maqUBLpD4donPCFc1DFSSyzWAw1/hfCLQvx5FvPXyEvYEcRn5vvz/5lmQ+lNNdCXWx84bP5tzi9zhQ=="}} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:29:09.434160 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.quota [None req-a62c5efe-2c7c-4e2d-8f91-3601014d56ac tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Getting quotas for project ce7a3e77ddf14b48986752434dda6d33. Resources: {'key_pairs'} {{(pid=120531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 16:29:09.438488 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.quota [None req-a62c5efe-2c7c-4e2d-8f91-3601014d56ac tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Getting quotas for user b917d84a650f4355a676e315ea039f0e and project ce7a3e77ddf14b48986752434dda6d33. Resources: {'key_pairs'} {{(pid=120531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 16:29:09.462889 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-a62c5efe-2c7c-4e2d-8f91-3601014d56ac tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.054969 Sep 21 16:29:09.463551 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 351/785] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Sep 21 16:29:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:29:10.103749 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-5cb52a34-8670-4553-9e1b-e60db704556a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:10.104296 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-5cb52a34-8670-4553-9e1b-e60db704556a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:10.111053 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5cb52a34-8670-4553-9e1b-e60db704556a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:10.111549 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5cb52a34-8670-4553-9e1b-e60db704556a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:10.111984 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5cb52a34-8670-4553-9e1b-e60db704556a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:10.112720 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5cb52a34-8670-4553-9e1b-e60db704556a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:10.113176 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5cb52a34-8670-4553-9e1b-e60db704556a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:10.113625 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5cb52a34-8670-4553-9e1b-e60db704556a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:10.140886 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-5cb52a34-8670-4553-9e1b-e60db704556a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Going to try to terminate instance {{(pid=120532) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 16:29:10.240059 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-5cb52a34-8670-4553-9e1b-e60db704556a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "DELETE /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 204 len: 0 microversion: 2.1 time: 0.140506 Sep 21 16:29:10.242263 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 435/786] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Sep 21 16:29:10 2022] DELETE /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 21 16:29:10.253967 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-8152b5f1-7923-4225-a71d-3d4834a8e2f8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:10.255375 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-8152b5f1-7923-4225-a71d-3d4834a8e2f8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:10.264926 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8152b5f1-7923-4225-a71d-3d4834a8e2f8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:10.265569 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8152b5f1-7923-4225-a71d-3d4834a8e2f8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:10.266276 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8152b5f1-7923-4225-a71d-3d4834a8e2f8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:10.267096 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8152b5f1-7923-4225-a71d-3d4834a8e2f8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:10.267622 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8152b5f1-7923-4225-a71d-3d4834a8e2f8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:10.268114 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8152b5f1-7923-4225-a71d-3d4834a8e2f8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:10.435966 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-8152b5f1-7923-4225-a71d-3d4834a8e2f8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:10.444528 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-8152b5f1-7923-4225-a71d-3d4834a8e2f8 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1508 microversion: 2.1 time: 0.198871 Sep 21 16:29:10.445113 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 352/787] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:10 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1508 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:10.873706 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-5c2b4b5a-bda3-4e37-b4b9-8a687870e794 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1264145421", "imageRef": "600db436-ed6c-41b7-89f7-7dd31852a1a7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8e8cfcce-7266-4377-accc-1ed5295280a6"}], "security_groups": [{"name": "tempest-securitygroup--44041653"}], "key_name": "tempest-keypair-524913399", "user_data": "}} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:29:10.994643 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.network.neutron [None req-5c2b4b5a-bda3-4e37-b4b9-8a687870e794 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] validate_networks() for [('8e8cfcce-7266-4377-accc-1ed5295280a6', None, None, None, None, None)] {{(pid=120532) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 16:29:11.468852 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-63d586a5-e0f2-48f0-8284-a6ec90a72df4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:11.469469 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-63d586a5-e0f2-48f0-8284-a6ec90a72df4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:11.476680 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-63d586a5-e0f2-48f0-8284-a6ec90a72df4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:11.477175 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-63d586a5-e0f2-48f0-8284-a6ec90a72df4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:11.477756 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-63d586a5-e0f2-48f0-8284-a6ec90a72df4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:11.478627 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-63d586a5-e0f2-48f0-8284-a6ec90a72df4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:11.479248 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-63d586a5-e0f2-48f0-8284-a6ec90a72df4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:11.479688 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-63d586a5-e0f2-48f0-8284-a6ec90a72df4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:11.483100 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-5c2b4b5a-bda3-4e37-b4b9-8a687870e794 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Flavor limits 0:0:0 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 16:29:11.484112 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-5c2b4b5a-bda3-4e37-b4b9-8a687870e794 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Image limits 0:0:0 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 16:29:11.484589 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-5c2b4b5a-bda3-4e37-b4b9-8a687870e794 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Flavor pref 0:0:0 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 16:29:11.484989 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-5c2b4b5a-bda3-4e37-b4b9-8a687870e794 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Image pref 0:0:0 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 16:29:11.485600 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-5c2b4b5a-bda3-4e37-b4b9-8a687870e794 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 16:29:11.497390 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5c2b4b5a-bda3-4e37-b4b9-8a687870e794 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:11.497988 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5c2b4b5a-bda3-4e37-b4b9-8a687870e794 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:11.498592 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5c2b4b5a-bda3-4e37-b4b9-8a687870e794 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:11.499655 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5c2b4b5a-bda3-4e37-b4b9-8a687870e794 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:11.500346 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5c2b4b5a-bda3-4e37-b4b9-8a687870e794 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:11.500781 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5c2b4b5a-bda3-4e37-b4b9-8a687870e794 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:11.523853 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.quota [None req-5c2b4b5a-bda3-4e37-b4b9-8a687870e794 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Getting quotas for project ce7a3e77ddf14b48986752434dda6d33. Resources: {'cores', 'ram', 'instances'} {{(pid=120532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 16:29:11.530586 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.quota [None req-5c2b4b5a-bda3-4e37-b4b9-8a687870e794 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Getting quotas for user b917d84a650f4355a676e315ea039f0e and project ce7a3e77ddf14b48986752434dda6d33. Resources: {'cores', 'ram', 'instances'} {{(pid=120532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 16:29:11.542971 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-5c2b4b5a-bda3-4e37-b4b9-8a687870e794 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Going to run 1 instances... {{(pid=120532) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 16:29:11.545431 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-5c2b4b5a-bda3-4e37-b4b9-8a687870e794 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 591bdacc-1358-430f-961a-f648f5cf8e19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='600db436-ed6c-41b7-89f7-7dd31852a1a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120532) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 16:29:11.607506 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-5c2b4b5a-bda3-4e37-b4b9-8a687870e794 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.738395 Sep 21 16:29:11.608191 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 436/788] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Sep 21 16:29:10 2022] POST /compute/v2.1/servers => generated 400 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 21 16:29:11.621104 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-261fe1c6-e2be-4e63-8120-d89725fa5b7e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:11.621729 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-261fe1c6-e2be-4e63-8120-d89725fa5b7e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 591bdacc-1358-430f-961a-f648f5cf8e19] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:11.703688 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-261fe1c6-e2be-4e63-8120-d89725fa5b7e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:11.718120 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-261fe1c6-e2be-4e63-8120-d89725fa5b7e tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19" status: 200 len: 1241 microversion: 2.1 time: 0.100428 Sep 21 16:29:11.719244 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 437/789] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:11 2022] GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19 => generated 1241 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:12.020067 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-63d586a5-e0f2-48f0-8284-a6ec90a72df4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:12.032936 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-63d586a5-e0f2-48f0-8284-a6ec90a72df4 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1508 microversion: 2.1 time: 0.568129 Sep 21 16:29:12.034480 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 353/790] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:11 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1508 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:29:12.468652 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-f99e2a85-7e43-40eb-9bd2-be0fe1566163 req-78361f06-5ea6-41b5-a354-8e4b3bcfd5e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ef57390-7f44-4191-bee4-bacbdd74290c", "name": "network-vif-deleted", "tag": "710045ab-6156-4322-9f3c-1697ccbafdd0"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:29:12.482372 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-f99e2a85-7e43-40eb-9bd2-be0fe1566163 req-78361f06-5ea6-41b5-a354-8e4b3bcfd5e2 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:12.482904 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-f99e2a85-7e43-40eb-9bd2-be0fe1566163 req-78361f06-5ea6-41b5-a354-8e4b3bcfd5e2 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:12.483346 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-f99e2a85-7e43-40eb-9bd2-be0fe1566163 req-78361f06-5ea6-41b5-a354-8e4b3bcfd5e2 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:12.500925 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-f99e2a85-7e43-40eb-9bd2-be0fe1566163 req-78361f06-5ea6-41b5-a354-8e4b3bcfd5e2 service nova] Creating event network-vif-deleted:710045ab-6156-4322-9f3c-1697ccbafdd0 for instance 7ef57390-7f44-4191-bee4-bacbdd74290c on hv-cinder-85862 Sep 21 16:29:12.512550 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-f99e2a85-7e43-40eb-9bd2-be0fe1566163 req-78361f06-5ea6-41b5-a354-8e4b3bcfd5e2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048402 Sep 21 16:29:12.513174 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 438/791] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:29:12.744710 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-34d8db3c-2b76-4588-a6e3-625fb0536d38 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:12.745335 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-34d8db3c-2b76-4588-a6e3-625fb0536d38 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 591bdacc-1358-430f-961a-f648f5cf8e19] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:12.753453 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-34d8db3c-2b76-4588-a6e3-625fb0536d38 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:12.753944 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-34d8db3c-2b76-4588-a6e3-625fb0536d38 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:12.754442 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-34d8db3c-2b76-4588-a6e3-625fb0536d38 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:12.755165 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-34d8db3c-2b76-4588-a6e3-625fb0536d38 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:12.755653 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-34d8db3c-2b76-4588-a6e3-625fb0536d38 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:12.756310 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-34d8db3c-2b76-4588-a6e3-625fb0536d38 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:12.844216 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-34d8db3c-2b76-4588-a6e3-625fb0536d38 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:12.852945 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-34d8db3c-2b76-4588-a6e3-625fb0536d38 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19" status: 200 len: 1293 microversion: 2.1 time: 0.112164 Sep 21 16:29:12.853544 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 354/792] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:12 2022] GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19 => generated 1293 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:13.064423 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-e635c7e6-3a72-4448-9cb0-68de1681312e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:13.065177 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-e635c7e6-3a72-4448-9cb0-68de1681312e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:13.073775 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e635c7e6-3a72-4448-9cb0-68de1681312e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:13.074764 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e635c7e6-3a72-4448-9cb0-68de1681312e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:13.075285 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e635c7e6-3a72-4448-9cb0-68de1681312e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:13.076175 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e635c7e6-3a72-4448-9cb0-68de1681312e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:13.076800 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e635c7e6-3a72-4448-9cb0-68de1681312e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:13.077125 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e635c7e6-3a72-4448-9cb0-68de1681312e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:13.118021 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:29:13.125247 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e635c7e6-3a72-4448-9cb0-68de1681312e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:13.125916 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e635c7e6-3a72-4448-9cb0-68de1681312e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:13.126390 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e635c7e6-3a72-4448-9cb0-68de1681312e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:13.126846 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.objects.instance [None req-e635c7e6-3a72-4448-9cb0-68de1681312e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lazy-loading 'fault' on Instance uuid 7ef57390-7f44-4191-bee4-bacbdd74290c {{(pid=120532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 16:29:13.185393 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-e635c7e6-3a72-4448-9cb0-68de1681312e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:13.194255 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-e635c7e6-3a72-4448-9cb0-68de1681312e tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 200 len: 1311 microversion: 2.1 time: 0.133716 Sep 21 16:29:13.201791 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-850f76e3-ad93-4390-86e6-d0fa1cf17d41 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:13.202410 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-850f76e3-ad93-4390-86e6-d0fa1cf17d41 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:13.206953 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 439/793] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:13 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 1311 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:13.210575 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-850f76e3-ad93-4390-86e6-d0fa1cf17d41 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:13.213102 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-850f76e3-ad93-4390-86e6-d0fa1cf17d41 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:13.213813 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-850f76e3-ad93-4390-86e6-d0fa1cf17d41 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:13.215809 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-850f76e3-ad93-4390-86e6-d0fa1cf17d41 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:13.216285 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-850f76e3-ad93-4390-86e6-d0fa1cf17d41 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:13.216714 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-850f76e3-ad93-4390-86e6-d0fa1cf17d41 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:13.243066 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-850f76e3-ad93-4390-86e6-d0fa1cf17d41 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079/ips" status: 200 len: 146 microversion: 2.1 time: 0.044870 Sep 21 16:29:13.243744 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 355/794] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Sep 21 16:29:13 2022] GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079/ips => generated 146 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:29:13.803995 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-eadd7660-e180-4acf-aa6e-a6c3bb14f297 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:13.804612 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-eadd7660-e180-4acf-aa6e-a6c3bb14f297 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:13.811204 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-eadd7660-e180-4acf-aa6e-a6c3bb14f297 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:13.811693 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-eadd7660-e180-4acf-aa6e-a6c3bb14f297 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:13.812133 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-eadd7660-e180-4acf-aa6e-a6c3bb14f297 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:13.812841 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-eadd7660-e180-4acf-aa6e-a6c3bb14f297 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:13.813300 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-eadd7660-e180-4acf-aa6e-a6c3bb14f297 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:13.813725 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-eadd7660-e180-4acf-aa6e-a6c3bb14f297 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:13.841115 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-eadd7660-e180-4acf-aa6e-a6c3bb14f297 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5/ips" status: 200 len: 152 microversion: 2.20 time: 0.041795 Sep 21 16:29:13.849923 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 440/795] 10.222.0.64 () {60 vars in 1289 bytes} [Wed Sep 21 16:29:13 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5/ips => generated 152 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 16:29:13.877655 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-a27464d4-f1b6-4173-b976-69cd4389f8cd tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:13.878289 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-a27464d4-f1b6-4173-b976-69cd4389f8cd tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 591bdacc-1358-430f-961a-f648f5cf8e19] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:13.886030 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a27464d4-f1b6-4173-b976-69cd4389f8cd tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:13.886637 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a27464d4-f1b6-4173-b976-69cd4389f8cd tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:13.887033 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a27464d4-f1b6-4173-b976-69cd4389f8cd tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:13.887878 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a27464d4-f1b6-4173-b976-69cd4389f8cd tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:13.888394 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a27464d4-f1b6-4173-b976-69cd4389f8cd tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:13.888868 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a27464d4-f1b6-4173-b976-69cd4389f8cd tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:14.098336 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-a27464d4-f1b6-4173-b976-69cd4389f8cd tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:14.113002 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-a27464d4-f1b6-4173-b976-69cd4389f8cd tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19" status: 200 len: 1365 microversion: 2.1 time: 0.238404 Sep 21 16:29:14.114143 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 356/796] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:13 2022] GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19 => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:14.219652 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c2b60e6a-79a3-44b6-b315-c1e849e72cdb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:14.220285 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-c2b60e6a-79a3-44b6-b315-c1e849e72cdb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 7ef57390-7f44-4191-bee4-bacbdd74290c] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:14.233034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c2b60e6a-79a3-44b6-b315-c1e849e72cdb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:14.235884 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c2b60e6a-79a3-44b6-b315-c1e849e72cdb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:14.251948 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c2b60e6a-79a3-44b6-b315-c1e849e72cdb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:14.251948 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c2b60e6a-79a3-44b6-b315-c1e849e72cdb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:14.251948 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c2b60e6a-79a3-44b6-b315-c1e849e72cdb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:14.251948 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c2b60e6a-79a3-44b6-b315-c1e849e72cdb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:14.270692 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.wsgi [None req-c2b60e6a-79a3-44b6-b315-c1e849e72cdb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] HTTP exception thrown: Instance 7ef57390-7f44-4191-bee4-bacbdd74290c could not be found. Sep 21 16:29:14.272292 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c2b60e6a-79a3-44b6-b315-c1e849e72cdb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Request method failure captured: Sep 21 16:29:14.272292 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: request: GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c HTTP/1.1 Sep 21 16:29:14.272292 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept: application/json Sep 21 16:29:14.272292 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept-Encoding: identity Sep 21 16:29:14.272292 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Connection: close Sep 21 16:29:14.272292 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Length: 0 Sep 21 16:29:14.272292 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Type: application/json Sep 21 16:29:14.272292 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Host: 10.222.0.64 Sep 21 16:29:14.272292 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Openstack-System-Scope: None Sep 21 16:29:14.272292 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: User-Agent: python-urllib3/1.26.12 Sep 21 16:29:14.272292 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Auth-Token: gAAAAABjKzpyl2VCA8qOXz_21Lb4_x9U1Xx-KlcjECNulDWe7htEJ0Af4mLHkpXjsPlA1iQ8jPMrxiWhztqQcFxCTlE1P4S3HVT0CeR12yBvkFP50lGbKEP4T7hlDNnQEqfVaKzVcRuzvbEZYlwT4nr23Om4knGB4vuwh-cjuvcsP1wXC1rngVU Sep 21 16:29:14.272292 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Id: None Sep 21 16:29:14.272292 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Name: None Sep 21 16:29:14.272292 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Identity-Status: Confirmed Sep 21 16:29:14.272292 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Is-Admin-Project: True Sep 21 16:29:14.272292 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Id: default Sep 21 16:29:14.272292 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Name: Default Sep 21 16:29:14.272292 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Id: b93e202a295d427a85fdaf0209951bd5 Sep 21 16:29:14.272292 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-717335908 Sep 21 16:29:14.272292 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Role: member,reader Sep 21 16:29:14.272292 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Roles: member,reader Sep 21 16:29:14.273777 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/b93e202a295d427a85fdaf0209951bd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b93e202a295d427a85fdaf0209951bd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_b93e202a295d427a85fdaf0209951bd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b93e202a295d427a85fdaf0209951bd5"}]}] Sep 21 16:29:14.273777 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant: tempest-ServerRescueNegativeTestJSON-717335908 Sep 21 16:29:14.273777 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Id: b93e202a295d427a85fdaf0209951bd5 Sep 21 16:29:14.273777 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-717335908 Sep 21 16:29:14.273777 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User: tempest-ServerRescueNegativeTestJSON-717335908-project Sep 21 16:29:14.273777 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Id: default Sep 21 16:29:14.273777 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Name: Default Sep 21 16:29:14.273777 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Id: d2382a6610ae42fa865283ed12dd9982 Sep 21 16:29:14.273777 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Name: tempest-ServerRescueNegativeTestJSON-717335908-project Sep 21 16:29:14.273777 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: method: > Sep 21 16:29:14.273777 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: exception: Instance 7ef57390-7f44-4191-bee4-bacbdd74290c could not be found. Sep 21 16:29:14.273777 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: action_args: {'id': '7ef57390-7f44-4191-bee4-bacbdd74290c'} Sep 21 16:29:14.279191 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:29:14.279191 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:29:14.279191 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 16:29:14.279191 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 16:29:14.279191 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 16:29:14.279191 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 16:29:14.279191 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 16:29:14.279191 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 16:29:14.279191 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 16:29:14.279191 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 16:29:14.279191 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ef57390-7f44-4191-bee4-bacbdd74290c could not be found. Sep 21 16:29:14.279191 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:29:14.279191 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:29:14.279191 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:29:14.279191 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:29:14.279191 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:29:14.279191 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:29:14.279191 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:29:14.279191 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:29:14.279191 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:29:14.280895 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:29:14.280895 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 16:29:14.280895 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 16:29:14.280895 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 16:29:14.280895 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 16:29:14.280895 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 16:29:14.280895 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:29:14.280895 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ef57390-7f44-4191-bee4-bacbdd74290c could not be found. Sep 21 16:29:14.280895 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:29:14.280895 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:29:14.280895 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:29:14.280895 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:29:14.280895 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:29:14.280895 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:29:14.280895 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:29:14.280895 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:29:14.280895 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ef57390-7f44-4191-bee4-bacbdd74290c could not be found. Sep 21 16:29:14.280895 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:29:14.282136 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c2b60e6a-79a3-44b6-b315-c1e849e72cdb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Returning 404 to user: Instance 7ef57390-7f44-4191-bee4-bacbdd74290c could not be found. {{(pid=120532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:29:14.282136 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-c2b60e6a-79a3-44b6-b315-c1e849e72cdb tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c" status: 404 len: 111 microversion: 2.1 time: 0.058702 Sep 21 16:29:14.282136 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 441/797] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:14 2022] GET /compute/v2.1/servers/7ef57390-7f44-4191-bee4-bacbdd74290c => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 16:29:14.285648 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-74da5ce3-63ac-4f73-ad89-80d63183fe11 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:14.286960 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-74da5ce3-63ac-4f73-ad89-80d63183fe11 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:14.293159 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-74da5ce3-63ac-4f73-ad89-80d63183fe11 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:14.293729 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-74da5ce3-63ac-4f73-ad89-80d63183fe11 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:14.294455 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-74da5ce3-63ac-4f73-ad89-80d63183fe11 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:14.295263 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-74da5ce3-63ac-4f73-ad89-80d63183fe11 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:14.295724 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-74da5ce3-63ac-4f73-ad89-80d63183fe11 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:14.296154 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-74da5ce3-63ac-4f73-ad89-80d63183fe11 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:14.327379 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-74da5ce3-63ac-4f73-ad89-80d63183fe11 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Going to try to terminate instance {{(pid=120531) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 16:29:14.429238 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-74da5ce3-63ac-4f73-ad89-80d63183fe11 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "DELETE /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 204 len: 0 microversion: 2.1 time: 0.147614 Sep 21 16:29:14.430010 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 357/798] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Sep 21 16:29:14 2022] DELETE /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 21 16:29:14.438997 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-400f3b4f-f46e-4503-8ec3-822543ef0f8a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:14.439618 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-400f3b4f-f46e-4503-8ec3-822543ef0f8a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:14.446701 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-400f3b4f-f46e-4503-8ec3-822543ef0f8a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:14.447189 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-400f3b4f-f46e-4503-8ec3-822543ef0f8a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:14.447622 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-400f3b4f-f46e-4503-8ec3-822543ef0f8a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:14.448340 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-400f3b4f-f46e-4503-8ec3-822543ef0f8a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:14.448798 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-400f3b4f-f46e-4503-8ec3-822543ef0f8a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:14.449222 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-400f3b4f-f46e-4503-8ec3-822543ef0f8a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:14.614259 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-400f3b4f-f46e-4503-8ec3-822543ef0f8a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:14.629410 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-400f3b4f-f46e-4503-8ec3-822543ef0f8a tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 200 len: 1522 microversion: 2.1 time: 0.194441 Sep 21 16:29:14.638357 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 442/799] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:14 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:29:14.652296 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-1a912da4-0352-4f97-9e8a-a792f940490b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dbb50fa1-404e-48e2-b233-42b5ff78524e"}} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:29:14.655238 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-1a912da4-0352-4f97-9e8a-a792f940490b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:14.662245 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1a912da4-0352-4f97-9e8a-a792f940490b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:14.662785 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1a912da4-0352-4f97-9e8a-a792f940490b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:14.663276 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1a912da4-0352-4f97-9e8a-a792f940490b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:14.664003 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1a912da4-0352-4f97-9e8a-a792f940490b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:14.664492 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1a912da4-0352-4f97-9e8a-a792f940490b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:14.664992 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1a912da4-0352-4f97-9e8a-a792f940490b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:14.669399 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:29:14.908493 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-1ea4efcb-587f-4f00-a767-377ef2ccc736 req-e14ecdab-b41b-454f-ba51-856bb889e597 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "591bdacc-1358-430f-961a-f648f5cf8e19", "tag": "1caf6ff4-eb49-4542-a687-9ca98562df23"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:29:14.920331 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-1ea4efcb-587f-4f00-a767-377ef2ccc736 req-e14ecdab-b41b-454f-ba51-856bb889e597 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:14.920893 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-1ea4efcb-587f-4f00-a767-377ef2ccc736 req-e14ecdab-b41b-454f-ba51-856bb889e597 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:14.921431 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-1ea4efcb-587f-4f00-a767-377ef2ccc736 req-e14ecdab-b41b-454f-ba51-856bb889e597 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:14.934012 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-1ea4efcb-587f-4f00-a767-377ef2ccc736 req-e14ecdab-b41b-454f-ba51-856bb889e597 service nova] Creating event network-changed:1caf6ff4-eb49-4542-a687-9ca98562df23 for instance 591bdacc-1358-430f-961a-f648f5cf8e19 on hv-cinder-85862 Sep 21 16:29:14.939215 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-1ea4efcb-587f-4f00-a767-377ef2ccc736 req-e14ecdab-b41b-454f-ba51-856bb889e597 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034415 Sep 21 16:29:14.939835 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 443/800] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:29:15.138003 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-80535375-ccf6-4c7c-8e4c-4228097e9a73 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:15.138603 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-80535375-ccf6-4c7c-8e4c-4228097e9a73 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 591bdacc-1358-430f-961a-f648f5cf8e19] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:15.146115 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-80535375-ccf6-4c7c-8e4c-4228097e9a73 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:15.146613 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-80535375-ccf6-4c7c-8e4c-4228097e9a73 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:15.147042 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-80535375-ccf6-4c7c-8e4c-4228097e9a73 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:15.147758 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-80535375-ccf6-4c7c-8e4c-4228097e9a73 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:15.148209 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-80535375-ccf6-4c7c-8e4c-4228097e9a73 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:15.148642 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-80535375-ccf6-4c7c-8e4c-4228097e9a73 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:15.289144 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-80535375-ccf6-4c7c-8e4c-4228097e9a73 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:15.297177 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-80535375-ccf6-4c7c-8e4c-4228097e9a73 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19" status: 200 len: 1365 microversion: 2.1 time: 0.163594 Sep 21 16:29:15.297754 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 444/801] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:15 2022] GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:29:15.655577 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-375de7ff-0661-42d5-a4cb-40ca3fd2b290 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:15.656210 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-375de7ff-0661-42d5-a4cb-40ca3fd2b290 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:15.662972 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-375de7ff-0661-42d5-a4cb-40ca3fd2b290 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:15.663457 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-375de7ff-0661-42d5-a4cb-40ca3fd2b290 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:15.663891 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-375de7ff-0661-42d5-a4cb-40ca3fd2b290 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:15.664580 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-375de7ff-0661-42d5-a4cb-40ca3fd2b290 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:15.665034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-375de7ff-0661-42d5-a4cb-40ca3fd2b290 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:15.665455 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-375de7ff-0661-42d5-a4cb-40ca3fd2b290 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:15.795181 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-375de7ff-0661-42d5-a4cb-40ca3fd2b290 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:15.803786 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-375de7ff-0661-42d5-a4cb-40ca3fd2b290 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 200 len: 1522 microversion: 2.1 time: 0.152006 Sep 21 16:29:15.804376 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 445/802] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:15 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:29:15.976046 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-0d1c921b-25f5-489b-a5d7-3045ba6206cc tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:29:15.976737 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-0d1c921b-25f5-489b-a5d7-3045ba6206cc tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:15.983488 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0d1c921b-25f5-489b-a5d7-3045ba6206cc tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:15.983979 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0d1c921b-25f5-489b-a5d7-3045ba6206cc tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:15.984417 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0d1c921b-25f5-489b-a5d7-3045ba6206cc tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:15.985133 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0d1c921b-25f5-489b-a5d7-3045ba6206cc tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:15.985588 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0d1c921b-25f5-489b-a5d7-3045ba6206cc tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:15.986016 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0d1c921b-25f5-489b-a5d7-3045ba6206cc tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:16.010744 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.objects.instance [None req-0d1c921b-25f5-489b-a5d7-3045ba6206cc tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lazy-loading 'flavor' on Instance uuid ce59fd53-2d4c-477e-8326-672737e561f5 {{(pid=120532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 16:29:16.041635 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:29:16.213372 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-0d1c921b-25f5-489b-a5d7-3045ba6206cc tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "POST /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5/action" status: 202 len: 0 microversion: 2.20 time: 0.241915 Sep 21 16:29:16.214149 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 446/803] 10.222.0.64 () {62 vars in 1319 bytes} [Wed Sep 21 16:29:15 2022] POST /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 21 16:29:16.224241 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-5a655128-f8f9-4e58-ba0f-a66bcd338d42 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:16.224942 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-5a655128-f8f9-4e58-ba0f-a66bcd338d42 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:16.231649 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5a655128-f8f9-4e58-ba0f-a66bcd338d42 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:16.232207 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5a655128-f8f9-4e58-ba0f-a66bcd338d42 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:16.232684 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5a655128-f8f9-4e58-ba0f-a66bcd338d42 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:16.233445 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5a655128-f8f9-4e58-ba0f-a66bcd338d42 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:16.233942 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5a655128-f8f9-4e58-ba0f-a66bcd338d42 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:16.234457 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5a655128-f8f9-4e58-ba0f-a66bcd338d42 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:16.403939 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5a655128-f8f9-4e58-ba0f-a66bcd338d42 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:16.412630 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5a655128-f8f9-4e58-ba0f-a66bcd338d42 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:16.414214 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5a655128-f8f9-4e58-ba0f-a66bcd338d42 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:16.415432 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-5a655128-f8f9-4e58-ba0f-a66bcd338d42 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1722 microversion: 2.20 time: 0.196372 Sep 21 16:29:16.416008 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 447/804] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:29:16 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 16:29:16.420729 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-4e14fe61-2ef7-4c91-a94a-0ed64691fd8a tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:16.421341 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-4e14fe61-2ef7-4c91-a94a-0ed64691fd8a tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 591bdacc-1358-430f-961a-f648f5cf8e19] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:16.427622 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4e14fe61-2ef7-4c91-a94a-0ed64691fd8a tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:16.428193 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4e14fe61-2ef7-4c91-a94a-0ed64691fd8a tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:16.428688 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4e14fe61-2ef7-4c91-a94a-0ed64691fd8a tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:16.429575 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4e14fe61-2ef7-4c91-a94a-0ed64691fd8a tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:16.430134 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4e14fe61-2ef7-4c91-a94a-0ed64691fd8a tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:16.430630 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4e14fe61-2ef7-4c91-a94a-0ed64691fd8a tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:16.568086 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-4e14fe61-2ef7-4c91-a94a-0ed64691fd8a tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:16.582438 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-4e14fe61-2ef7-4c91-a94a-0ed64691fd8a tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19" status: 200 len: 1365 microversion: 2.1 time: 0.163968 Sep 21 16:29:16.590529 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 448/805] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:16 2022] GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:16.691601 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-1a912da4-0352-4f97-9e8a-a792f940490b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "POST /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.043146 Sep 21 16:29:16.692516 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 358/806] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Sep 21 16:29:14 2022] POST /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079/os-volume_attachments => generated 194 bytes in 2046 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:29:16.829677 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-375c464e-90a4-4d78-b54f-baa4cf4d6cd5 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:16.831148 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-375c464e-90a4-4d78-b54f-baa4cf4d6cd5 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:16.839011 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-375c464e-90a4-4d78-b54f-baa4cf4d6cd5 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:16.839517 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-375c464e-90a4-4d78-b54f-baa4cf4d6cd5 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:16.839954 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-375c464e-90a4-4d78-b54f-baa4cf4d6cd5 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:16.841543 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-375c464e-90a4-4d78-b54f-baa4cf4d6cd5 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:16.842000 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-375c464e-90a4-4d78-b54f-baa4cf4d6cd5 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:16.842525 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-375c464e-90a4-4d78-b54f-baa4cf4d6cd5 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:16.997102 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-375c464e-90a4-4d78-b54f-baa4cf4d6cd5 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:17.006060 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-375c464e-90a4-4d78-b54f-baa4cf4d6cd5 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 200 len: 1522 microversion: 2.1 time: 0.182254 Sep 21 16:29:17.006663 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 449/807] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:16 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:17.441975 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-f8060b66-6a8c-4808-9298-83fe925629e4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:17.442788 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-f8060b66-6a8c-4808-9298-83fe925629e4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:17.445231 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:29:17.451822 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f8060b66-6a8c-4808-9298-83fe925629e4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:17.452309 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f8060b66-6a8c-4808-9298-83fe925629e4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:17.452736 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f8060b66-6a8c-4808-9298-83fe925629e4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:17.453435 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f8060b66-6a8c-4808-9298-83fe925629e4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:17.453890 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f8060b66-6a8c-4808-9298-83fe925629e4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:17.454340 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f8060b66-6a8c-4808-9298-83fe925629e4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:17.572900 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-6ed2feb0-75b7-4d9d-91ff-0eb1bec1f80b req-34147f51-fbc3-4bea-8d25-d16a01e9f752 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ece03bf-7582-46b8-8966-0f46577abe14", "name": "network-vif-deleted", "tag": "bfec785e-5f96-4772-937f-5c90aabd9fb8"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:29:17.585734 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-6ed2feb0-75b7-4d9d-91ff-0eb1bec1f80b req-34147f51-fbc3-4bea-8d25-d16a01e9f752 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:17.586787 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-6ed2feb0-75b7-4d9d-91ff-0eb1bec1f80b req-34147f51-fbc3-4bea-8d25-d16a01e9f752 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:17.587476 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-6ed2feb0-75b7-4d9d-91ff-0eb1bec1f80b req-34147f51-fbc3-4bea-8d25-d16a01e9f752 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:17.602599 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-6ed2feb0-75b7-4d9d-91ff-0eb1bec1f80b req-34147f51-fbc3-4bea-8d25-d16a01e9f752 service nova] Creating event network-vif-deleted:bfec785e-5f96-4772-937f-5c90aabd9fb8 for instance 0ece03bf-7582-46b8-8966-0f46577abe14 on hv-cinder-85862 Sep 21 16:29:17.608024 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-6ed2feb0-75b7-4d9d-91ff-0eb1bec1f80b req-34147f51-fbc3-4bea-8d25-d16a01e9f752 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039752 Sep 21 16:29:17.608820 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 450/808] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:29:17.615763 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-86db1fa6-f161-407c-ad0c-af19154bf96f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:17.616487 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-86db1fa6-f161-407c-ad0c-af19154bf96f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 591bdacc-1358-430f-961a-f648f5cf8e19] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:17.623483 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-86db1fa6-f161-407c-ad0c-af19154bf96f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:17.623986 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-86db1fa6-f161-407c-ad0c-af19154bf96f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:17.624434 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-86db1fa6-f161-407c-ad0c-af19154bf96f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:17.625367 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-86db1fa6-f161-407c-ad0c-af19154bf96f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:17.626263 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-86db1fa6-f161-407c-ad0c-af19154bf96f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:17.626891 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-86db1fa6-f161-407c-ad0c-af19154bf96f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:17.682348 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-f8060b66-6a8c-4808-9298-83fe925629e4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:17.692707 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-f8060b66-6a8c-4808-9298-83fe925629e4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:17.693957 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-f8060b66-6a8c-4808-9298-83fe925629e4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:17.695172 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-f8060b66-6a8c-4808-9298-83fe925629e4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1722 microversion: 2.20 time: 0.257745 Sep 21 16:29:17.696227 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 359/809] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:29:17 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1722 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:29:17.784542 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-86db1fa6-f161-407c-ad0c-af19154bf96f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:17.792304 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-86db1fa6-f161-407c-ad0c-af19154bf96f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19" status: 200 len: 1365 microversion: 2.1 time: 0.182084 Sep 21 16:29:17.793036 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 451/810] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:17 2022] GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19 => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:18.030367 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-f626263b-5512-4b43-932e-a6edd0a339dc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:18.031010 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-f626263b-5512-4b43-932e-a6edd0a339dc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:18.037824 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f626263b-5512-4b43-932e-a6edd0a339dc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:18.038334 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f626263b-5512-4b43-932e-a6edd0a339dc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:18.038760 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f626263b-5512-4b43-932e-a6edd0a339dc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:18.039475 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f626263b-5512-4b43-932e-a6edd0a339dc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:18.039923 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f626263b-5512-4b43-932e-a6edd0a339dc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:18.040341 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f626263b-5512-4b43-932e-a6edd0a339dc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:18.070993 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f626263b-5512-4b43-932e-a6edd0a339dc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:18.071402 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f626263b-5512-4b43-932e-a6edd0a339dc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:18.071833 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f626263b-5512-4b43-932e-a6edd0a339dc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:18.072272 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.objects.instance [None req-f626263b-5512-4b43-932e-a6edd0a339dc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lazy-loading 'fault' on Instance uuid 0ece03bf-7582-46b8-8966-0f46577abe14 {{(pid=120531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 16:29:18.114113 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-f626263b-5512-4b43-932e-a6edd0a339dc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2382a6610ae42fa865283ed12dd9982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93e202a295d427a85fdaf0209951bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:18.121733 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-f626263b-5512-4b43-932e-a6edd0a339dc tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 200 len: 1311 microversion: 2.1 time: 0.095202 Sep 21 16:29:18.122327 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 360/811] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:18 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:18.725500 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ecdc9af7-d6de-4178-85a2-7254a745edde tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:18.726665 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ecdc9af7-d6de-4178-85a2-7254a745edde tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:18.739316 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ecdc9af7-d6de-4178-85a2-7254a745edde tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:18.740122 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ecdc9af7-d6de-4178-85a2-7254a745edde tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:18.740927 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ecdc9af7-d6de-4178-85a2-7254a745edde tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:18.742297 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ecdc9af7-d6de-4178-85a2-7254a745edde tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:18.743156 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ecdc9af7-d6de-4178-85a2-7254a745edde tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:18.743931 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ecdc9af7-d6de-4178-85a2-7254a745edde tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:18.816607 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-b4cb4496-d6b5-4bb0-8662-a7bdf7d9e8be tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:18.817284 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-b4cb4496-d6b5-4bb0-8662-a7bdf7d9e8be tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 591bdacc-1358-430f-961a-f648f5cf8e19] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:18.824820 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b4cb4496-d6b5-4bb0-8662-a7bdf7d9e8be tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:18.825521 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b4cb4496-d6b5-4bb0-8662-a7bdf7d9e8be tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:18.826271 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b4cb4496-d6b5-4bb0-8662-a7bdf7d9e8be tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:18.826930 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b4cb4496-d6b5-4bb0-8662-a7bdf7d9e8be tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:18.827529 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b4cb4496-d6b5-4bb0-8662-a7bdf7d9e8be tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:18.828252 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b4cb4496-d6b5-4bb0-8662-a7bdf7d9e8be tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:18.899323 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ecdc9af7-d6de-4178-85a2-7254a745edde tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:18.916788 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ecdc9af7-d6de-4178-85a2-7254a745edde tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:18.917868 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ecdc9af7-d6de-4178-85a2-7254a745edde tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:18.919237 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ecdc9af7-d6de-4178-85a2-7254a745edde tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1722 microversion: 2.20 time: 0.201946 Sep 21 16:29:18.919963 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 452/812] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:29:18 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:29:18.998979 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-b4cb4496-d6b5-4bb0-8662-a7bdf7d9e8be tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:19.007151 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-b4cb4496-d6b5-4bb0-8662-a7bdf7d9e8be tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19" status: 200 len: 1365 microversion: 2.1 time: 0.195776 Sep 21 16:29:19.007730 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 361/813] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:18 2022] GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19 => generated 1365 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:29:19.145241 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-512d45cd-9ff2-4361-824d-58e0dc449ce9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:19.145872 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-512d45cd-9ff2-4361-824d-58e0dc449ce9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] [instance: 0ece03bf-7582-46b8-8966-0f46577abe14] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:19.152162 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-512d45cd-9ff2-4361-824d-58e0dc449ce9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:19.152689 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-512d45cd-9ff2-4361-824d-58e0dc449ce9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:19.153116 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-512d45cd-9ff2-4361-824d-58e0dc449ce9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:19.153807 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-512d45cd-9ff2-4361-824d-58e0dc449ce9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:19.154287 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-512d45cd-9ff2-4361-824d-58e0dc449ce9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:19.154699 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-512d45cd-9ff2-4361-824d-58e0dc449ce9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:19.168877 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.wsgi [None req-512d45cd-9ff2-4361-824d-58e0dc449ce9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] HTTP exception thrown: Instance 0ece03bf-7582-46b8-8966-0f46577abe14 could not be found. Sep 21 16:29:19.170552 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-512d45cd-9ff2-4361-824d-58e0dc449ce9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Request method failure captured: Sep 21 16:29:19.170552 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: request: GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 HTTP/1.1 Sep 21 16:29:19.170552 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept: application/json Sep 21 16:29:19.170552 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept-Encoding: identity Sep 21 16:29:19.170552 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Connection: close Sep 21 16:29:19.170552 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Length: 0 Sep 21 16:29:19.170552 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Type: application/json Sep 21 16:29:19.170552 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Host: 10.222.0.64 Sep 21 16:29:19.170552 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Openstack-System-Scope: None Sep 21 16:29:19.170552 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: User-Agent: python-urllib3/1.26.12 Sep 21 16:29:19.170552 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Auth-Token: gAAAAABjKzpyl2VCA8qOXz_21Lb4_x9U1Xx-KlcjECNulDWe7htEJ0Af4mLHkpXjsPlA1iQ8jPMrxiWhztqQcFxCTlE1P4S3HVT0CeR12yBvkFP50lGbKEP4T7hlDNnQEqfVaKzVcRuzvbEZYlwT4nr23Om4knGB4vuwh-cjuvcsP1wXC1rngVU Sep 21 16:29:19.170552 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Id: None Sep 21 16:29:19.170552 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Name: None Sep 21 16:29:19.170552 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Identity-Status: Confirmed Sep 21 16:29:19.170552 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Is-Admin-Project: True Sep 21 16:29:19.170552 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Id: default Sep 21 16:29:19.170552 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Name: Default Sep 21 16:29:19.170552 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Id: b93e202a295d427a85fdaf0209951bd5 Sep 21 16:29:19.170552 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-717335908 Sep 21 16:29:19.170552 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Role: member,reader Sep 21 16:29:19.170552 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Roles: member,reader Sep 21 16:29:19.172353 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/b93e202a295d427a85fdaf0209951bd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b93e202a295d427a85fdaf0209951bd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_b93e202a295d427a85fdaf0209951bd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b93e202a295d427a85fdaf0209951bd5"}]}] Sep 21 16:29:19.172353 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant: tempest-ServerRescueNegativeTestJSON-717335908 Sep 21 16:29:19.172353 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Id: b93e202a295d427a85fdaf0209951bd5 Sep 21 16:29:19.172353 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-717335908 Sep 21 16:29:19.172353 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User: tempest-ServerRescueNegativeTestJSON-717335908-project Sep 21 16:29:19.172353 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Id: default Sep 21 16:29:19.172353 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Name: Default Sep 21 16:29:19.172353 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Id: d2382a6610ae42fa865283ed12dd9982 Sep 21 16:29:19.172353 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Name: tempest-ServerRescueNegativeTestJSON-717335908-project Sep 21 16:29:19.172353 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: method: > Sep 21 16:29:19.172353 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: exception: Instance 0ece03bf-7582-46b8-8966-0f46577abe14 could not be found. Sep 21 16:29:19.172353 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: action_args: {'id': '0ece03bf-7582-46b8-8966-0f46577abe14'} Sep 21 16:29:19.176826 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:29:19.176826 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:29:19.176826 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 16:29:19.176826 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 16:29:19.176826 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 16:29:19.176826 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 16:29:19.176826 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 16:29:19.176826 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 16:29:19.176826 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 16:29:19.176826 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 16:29:19.176826 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ece03bf-7582-46b8-8966-0f46577abe14 could not be found. Sep 21 16:29:19.176826 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:29:19.176826 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:29:19.176826 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:29:19.176826 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:29:19.176826 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:29:19.176826 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:29:19.176826 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:29:19.176826 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:29:19.176826 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:29:19.178496 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:29:19.178496 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 16:29:19.178496 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 16:29:19.178496 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 16:29:19.178496 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 16:29:19.178496 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 16:29:19.178496 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:29:19.178496 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ece03bf-7582-46b8-8966-0f46577abe14 could not be found. Sep 21 16:29:19.178496 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:29:19.178496 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:29:19.178496 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:29:19.178496 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:29:19.178496 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:29:19.178496 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:29:19.178496 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:29:19.178496 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:29:19.178496 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ece03bf-7582-46b8-8966-0f46577abe14 could not be found. Sep 21 16:29:19.178496 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:29:19.179840 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-512d45cd-9ff2-4361-824d-58e0dc449ce9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] Returning 404 to user: Instance 0ece03bf-7582-46b8-8966-0f46577abe14 could not be found. {{(pid=120532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:29:19.179840 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-512d45cd-9ff2-4361-824d-58e0dc449ce9 tempest-ServerRescueNegativeTestJSON-717335908 tempest-ServerRescueNegativeTestJSON-717335908-project] 10.222.0.64 "GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14" status: 404 len: 111 microversion: 2.1 time: 0.031716 Sep 21 16:29:19.179840 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 453/814] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:19 2022] GET /compute/v2.1/servers/0ece03bf-7582-46b8-8966-0f46577abe14 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 21 16:29:19.944576 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell0:SELECT=4 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:29:19.949738 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-755579b4-a781-4c0e-aca9-dd92dc09375e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:19.950550 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-755579b4-a781-4c0e-aca9-dd92dc09375e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:19.958590 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-755579b4-a781-4c0e-aca9-dd92dc09375e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:19.959248 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-755579b4-a781-4c0e-aca9-dd92dc09375e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:19.959799 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-755579b4-a781-4c0e-aca9-dd92dc09375e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:19.960670 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-755579b4-a781-4c0e-aca9-dd92dc09375e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:19.961250 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-755579b4-a781-4c0e-aca9-dd92dc09375e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:19.961805 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-755579b4-a781-4c0e-aca9-dd92dc09375e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:20.031398 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-f54ea821-5381-4cf4-a607-df657f4fdc86 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:20.032173 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-f54ea821-5381-4cf4-a607-df657f4fdc86 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 591bdacc-1358-430f-961a-f648f5cf8e19] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:20.039735 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f54ea821-5381-4cf4-a607-df657f4fdc86 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:20.040228 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f54ea821-5381-4cf4-a607-df657f4fdc86 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:20.040666 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f54ea821-5381-4cf4-a607-df657f4fdc86 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:20.041404 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f54ea821-5381-4cf4-a607-df657f4fdc86 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:20.041866 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f54ea821-5381-4cf4-a607-df657f4fdc86 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:20.042321 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f54ea821-5381-4cf4-a607-df657f4fdc86 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:20.191009 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-f54ea821-5381-4cf4-a607-df657f4fdc86 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:20.199250 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-f54ea821-5381-4cf4-a607-df657f4fdc86 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19" status: 200 len: 1365 microversion: 2.1 time: 0.172076 Sep 21 16:29:20.200062 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 454/815] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:20 2022] GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:29:20.313284 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-755579b4-a781-4c0e-aca9-dd92dc09375e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:20.320084 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-755579b4-a781-4c0e-aca9-dd92dc09375e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:20.320279 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-755579b4-a781-4c0e-aca9-dd92dc09375e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:20.323757 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-755579b4-a781-4c0e-aca9-dd92dc09375e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1722 microversion: 2.20 time: 0.378810 Sep 21 16:29:20.334740 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 362/816] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:29:19 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1722 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 16:29:21.223641 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-03c1e601-d292-4e41-9c9a-93984d7f1649 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:21.224259 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-03c1e601-d292-4e41-9c9a-93984d7f1649 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 591bdacc-1358-430f-961a-f648f5cf8e19] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:21.231242 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-03c1e601-d292-4e41-9c9a-93984d7f1649 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:21.231661 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-03c1e601-d292-4e41-9c9a-93984d7f1649 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:21.232099 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-03c1e601-d292-4e41-9c9a-93984d7f1649 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:21.232820 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-03c1e601-d292-4e41-9c9a-93984d7f1649 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:21.233277 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-03c1e601-d292-4e41-9c9a-93984d7f1649 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:21.233710 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-03c1e601-d292-4e41-9c9a-93984d7f1649 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:21.349683 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-8215b023-eff6-4f3a-8799-eb238326df86 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:21.350966 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-8215b023-eff6-4f3a-8799-eb238326df86 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:21.358039 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8215b023-eff6-4f3a-8799-eb238326df86 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:21.358808 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8215b023-eff6-4f3a-8799-eb238326df86 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:21.359576 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8215b023-eff6-4f3a-8799-eb238326df86 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:21.360445 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8215b023-eff6-4f3a-8799-eb238326df86 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:21.361050 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8215b023-eff6-4f3a-8799-eb238326df86 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:21.362249 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8215b023-eff6-4f3a-8799-eb238326df86 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:21.389018 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-03c1e601-d292-4e41-9c9a-93984d7f1649 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:21.400693 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-03c1e601-d292-4e41-9c9a-93984d7f1649 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19" status: 200 len: 1365 microversion: 2.1 time: 0.181545 Sep 21 16:29:21.401294 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 455/817] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:21 2022] GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19 => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:21.591490 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-8215b023-eff6-4f3a-8799-eb238326df86 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:21.601502 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-8215b023-eff6-4f3a-8799-eb238326df86 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:21.603727 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-8215b023-eff6-4f3a-8799-eb238326df86 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:21.605609 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-8215b023-eff6-4f3a-8799-eb238326df86 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1722 microversion: 2.20 time: 0.261879 Sep 21 16:29:21.606370 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 363/818] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:29:21 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:29:22.425073 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c7d09439-64d2-46a9-897d-c22e063f330c tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:22.429529 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-c7d09439-64d2-46a9-897d-c22e063f330c tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 591bdacc-1358-430f-961a-f648f5cf8e19] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:22.437863 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell0:SELECT=2 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:29:22.438633 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell0:SELECT=8 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:29:22.441179 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c7d09439-64d2-46a9-897d-c22e063f330c tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:22.441672 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c7d09439-64d2-46a9-897d-c22e063f330c tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:22.443150 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c7d09439-64d2-46a9-897d-c22e063f330c tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:22.444382 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c7d09439-64d2-46a9-897d-c22e063f330c tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:22.445186 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c7d09439-64d2-46a9-897d-c22e063f330c tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:22.445944 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c7d09439-64d2-46a9-897d-c22e063f330c tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:22.739819 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-c7d09439-64d2-46a9-897d-c22e063f330c tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:22.763946 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-c7d09439-64d2-46a9-897d-c22e063f330c tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19" status: 200 len: 1365 microversion: 2.1 time: 0.343285 Sep 21 16:29:22.764881 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 456/819] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:22 2022] GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19 => generated 1365 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:22.782826 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-d5537205-a419-47bb-81c4-257ca918d1ad tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:22.784166 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-d5537205-a419-47bb-81c4-257ca918d1ad tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:22.788511 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-dd6b1be0-081e-4ae1-a5b1-53f3e794b107 req-82a3fbb5-a60e-48df-8acc-f5d19a08c9e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "591bdacc-1358-430f-961a-f648f5cf8e19", "name": "network-vif-plugged", "status": "completed", "tag": "1caf6ff4-eb49-4542-a687-9ca98562df23"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:29:22.793167 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d5537205-a419-47bb-81c4-257ca918d1ad tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:22.793951 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d5537205-a419-47bb-81c4-257ca918d1ad tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:22.794760 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d5537205-a419-47bb-81c4-257ca918d1ad tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:22.795966 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d5537205-a419-47bb-81c4-257ca918d1ad tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:22.796663 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d5537205-a419-47bb-81c4-257ca918d1ad tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:22.797242 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d5537205-a419-47bb-81c4-257ca918d1ad tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:22.825156 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-dd6b1be0-081e-4ae1-a5b1-53f3e794b107 req-82a3fbb5-a60e-48df-8acc-f5d19a08c9e4 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:22.825629 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-dd6b1be0-081e-4ae1-a5b1-53f3e794b107 req-82a3fbb5-a60e-48df-8acc-f5d19a08c9e4 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:22.832902 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-dd6b1be0-081e-4ae1-a5b1-53f3e794b107 req-82a3fbb5-a60e-48df-8acc-f5d19a08c9e4 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:22.866015 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-dd6b1be0-081e-4ae1-a5b1-53f3e794b107 req-82a3fbb5-a60e-48df-8acc-f5d19a08c9e4 service nova] Creating event network-vif-plugged:1caf6ff4-eb49-4542-a687-9ca98562df23 for instance 591bdacc-1358-430f-961a-f648f5cf8e19 on hv-cinder-85862 Sep 21 16:29:22.884263 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-dd6b1be0-081e-4ae1-a5b1-53f3e794b107 req-82a3fbb5-a60e-48df-8acc-f5d19a08c9e4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.300817 Sep 21 16:29:22.885053 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 364/820] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:29:23.100280 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d5537205-a419-47bb-81c4-257ca918d1ad tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:23.113038 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d5537205-a419-47bb-81c4-257ca918d1ad tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:23.115795 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d5537205-a419-47bb-81c4-257ca918d1ad tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:23.118281 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-d5537205-a419-47bb-81c4-257ca918d1ad tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1722 microversion: 2.20 time: 0.352273 Sep 21 16:29:23.119012 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 457/821] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:29:22 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1722 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:29:23.312891 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-398a0720-19fc-421e-be29-8a5977e47ab8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:23.315140 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-398a0720-19fc-421e-be29-8a5977e47ab8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:23.321248 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-398a0720-19fc-421e-be29-8a5977e47ab8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:23.321741 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-398a0720-19fc-421e-be29-8a5977e47ab8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:23.322320 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-398a0720-19fc-421e-be29-8a5977e47ab8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:23.322912 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-398a0720-19fc-421e-be29-8a5977e47ab8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:23.323364 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-398a0720-19fc-421e-be29-8a5977e47ab8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:23.323786 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-398a0720-19fc-421e-be29-8a5977e47ab8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:23.353867 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-398a0720-19fc-421e-be29-8a5977e47ab8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045430 Sep 21 16:29:23.354693 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 365/822] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Sep 21 16:29:23 2022] GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:29:23.366282 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-f35b54ec-5a18-46c7-8f58-ad4cb44bfcc6 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:23.366773 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-f35b54ec-5a18-46c7-8f58-ad4cb44bfcc6 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:23.373004 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f35b54ec-5a18-46c7-8f58-ad4cb44bfcc6 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:23.373484 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f35b54ec-5a18-46c7-8f58-ad4cb44bfcc6 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:23.373917 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f35b54ec-5a18-46c7-8f58-ad4cb44bfcc6 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:23.374668 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f35b54ec-5a18-46c7-8f58-ad4cb44bfcc6 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:23.375153 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f35b54ec-5a18-46c7-8f58-ad4cb44bfcc6 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:23.375889 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f35b54ec-5a18-46c7-8f58-ad4cb44bfcc6 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:23.405611 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-f35b54ec-5a18-46c7-8f58-ad4cb44bfcc6 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079/os-volume_attachments/dbb50fa1-404e-48e2-b233-42b5ff78524e" status: 200 len: 194 microversion: 2.1 time: 0.044276 Sep 21 16:29:23.406244 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 458/823] 10.222.0.64 () {58 vars in 1413 bytes} [Wed Sep 21 16:29:23 2022] GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079/os-volume_attachments/dbb50fa1-404e-48e2-b233-42b5ff78524e => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:29:23.788371 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d0c7ac58-2769-48c8-b170-0a2d04427e0f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:23.788970 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d0c7ac58-2769-48c8-b170-0a2d04427e0f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 591bdacc-1358-430f-961a-f648f5cf8e19] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:23.795280 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d0c7ac58-2769-48c8-b170-0a2d04427e0f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:23.795767 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d0c7ac58-2769-48c8-b170-0a2d04427e0f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:23.796207 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d0c7ac58-2769-48c8-b170-0a2d04427e0f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:23.796904 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d0c7ac58-2769-48c8-b170-0a2d04427e0f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:23.797358 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d0c7ac58-2769-48c8-b170-0a2d04427e0f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:23.797832 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d0c7ac58-2769-48c8-b170-0a2d04427e0f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:23.938766 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d0c7ac58-2769-48c8-b170-0a2d04427e0f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:23.948724 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d0c7ac58-2769-48c8-b170-0a2d04427e0f tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19" status: 200 len: 1365 microversion: 2.1 time: 0.164139 Sep 21 16:29:23.949548 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 366/824] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:23 2022] GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:24.149781 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-e6ce0524-a0c7-44ae-866c-6998cf3fa9e3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:24.150557 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-e6ce0524-a0c7-44ae-866c-6998cf3fa9e3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:24.156916 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e6ce0524-a0c7-44ae-866c-6998cf3fa9e3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:24.157551 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e6ce0524-a0c7-44ae-866c-6998cf3fa9e3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:24.158720 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e6ce0524-a0c7-44ae-866c-6998cf3fa9e3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:24.159410 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e6ce0524-a0c7-44ae-866c-6998cf3fa9e3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:24.159959 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e6ce0524-a0c7-44ae-866c-6998cf3fa9e3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:24.160365 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e6ce0524-a0c7-44ae-866c-6998cf3fa9e3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:24.332106 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-e6ce0524-a0c7-44ae-866c-6998cf3fa9e3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:24.341005 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-e6ce0524-a0c7-44ae-866c-6998cf3fa9e3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:24.342554 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-e6ce0524-a0c7-44ae-866c-6998cf3fa9e3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:24.343988 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-e6ce0524-a0c7-44ae-866c-6998cf3fa9e3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1722 microversion: 2.20 time: 0.201213 Sep 21 16:29:24.345136 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 459/825] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:29:24 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 16:29:24.812219 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-1a252bb8-6d45-4f23-80c3-92bd66a9c712 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a48cc444-337c-4b67-b6c0-bf8974af6c9a"}} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:29:24.814800 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-1a252bb8-6d45-4f23-80c3-92bd66a9c712 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:24.822405 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1a252bb8-6d45-4f23-80c3-92bd66a9c712 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:24.822959 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1a252bb8-6d45-4f23-80c3-92bd66a9c712 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:24.823424 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1a252bb8-6d45-4f23-80c3-92bd66a9c712 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:24.824318 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1a252bb8-6d45-4f23-80c3-92bd66a9c712 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:24.824842 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1a252bb8-6d45-4f23-80c3-92bd66a9c712 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:24.825319 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1a252bb8-6d45-4f23-80c3-92bd66a9c712 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:24.989538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-032ada8d-69e0-4e79-8b67-679931c485e7 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:24.991545 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-032ada8d-69e0-4e79-8b67-679931c485e7 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 591bdacc-1358-430f-961a-f648f5cf8e19] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:25.004839 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-032ada8d-69e0-4e79-8b67-679931c485e7 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:25.005828 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-032ada8d-69e0-4e79-8b67-679931c485e7 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:25.006635 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-032ada8d-69e0-4e79-8b67-679931c485e7 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:25.008879 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-032ada8d-69e0-4e79-8b67-679931c485e7 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:25.009752 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-032ada8d-69e0-4e79-8b67-679931c485e7 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:25.010613 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-032ada8d-69e0-4e79-8b67-679931c485e7 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:25.182178 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-1a252bb8-6d45-4f23-80c3-92bd66a9c712 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "POST /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.375388 Sep 21 16:29:25.182821 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 367/826] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Sep 21 16:29:24 2022] POST /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079/os-volume_attachments => generated 194 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:29:25.282717 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-032ada8d-69e0-4e79-8b67-679931c485e7 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:25.295305 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-032ada8d-69e0-4e79-8b67-679931c485e7 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19" status: 200 len: 1555 microversion: 2.1 time: 0.324123 Sep 21 16:29:25.297427 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 460/827] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:24 2022] GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19 => generated 1555 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:25.327985 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-64daf86b-9f46-4795-929f-0aba810c6d64 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:25.328773 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-64daf86b-9f46-4795-929f-0aba810c6d64 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 591bdacc-1358-430f-961a-f648f5cf8e19] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:25.336158 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-64daf86b-9f46-4795-929f-0aba810c6d64 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:25.336624 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-64daf86b-9f46-4795-929f-0aba810c6d64 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:25.337098 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-64daf86b-9f46-4795-929f-0aba810c6d64 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:25.337853 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-64daf86b-9f46-4795-929f-0aba810c6d64 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:25.338414 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-64daf86b-9f46-4795-929f-0aba810c6d64 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:25.338837 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-64daf86b-9f46-4795-929f-0aba810c6d64 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:25.371483 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-5d30ceaa-ca14-4d2e-a546-68a30084eb50 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:25.372428 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-5d30ceaa-ca14-4d2e-a546-68a30084eb50 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:25.386952 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5d30ceaa-ca14-4d2e-a546-68a30084eb50 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:25.387447 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5d30ceaa-ca14-4d2e-a546-68a30084eb50 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:25.388139 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5d30ceaa-ca14-4d2e-a546-68a30084eb50 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:25.389023 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5d30ceaa-ca14-4d2e-a546-68a30084eb50 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:25.390476 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5d30ceaa-ca14-4d2e-a546-68a30084eb50 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:25.391080 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5d30ceaa-ca14-4d2e-a546-68a30084eb50 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:25.446388 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-64daf86b-9f46-4795-929f-0aba810c6d64 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.126634 Sep 21 16:29:25.447559 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 368/828] 10.222.0.64 () {58 vars in 1275 bytes} [Wed Sep 21 16:29:25 2022] GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19/os-interface => generated 285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:29:25.552942 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5d30ceaa-ca14-4d2e-a546-68a30084eb50 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:25.562973 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5d30ceaa-ca14-4d2e-a546-68a30084eb50 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:25.565263 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5d30ceaa-ca14-4d2e-a546-68a30084eb50 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:25.566621 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-5d30ceaa-ca14-4d2e-a546-68a30084eb50 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1722 microversion: 2.20 time: 0.199863 Sep 21 16:29:25.586975 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 461/829] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:29:25 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:29:26.595137 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-ab39bece-01b1-498a-8681-090b26bfc5ee tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:26.595880 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-ab39bece-01b1-498a-8681-090b26bfc5ee tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:26.602496 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ab39bece-01b1-498a-8681-090b26bfc5ee tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:26.602982 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ab39bece-01b1-498a-8681-090b26bfc5ee tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:26.603419 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ab39bece-01b1-498a-8681-090b26bfc5ee tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:26.604130 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ab39bece-01b1-498a-8681-090b26bfc5ee tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:26.604584 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ab39bece-01b1-498a-8681-090b26bfc5ee tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:26.605087 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ab39bece-01b1-498a-8681-090b26bfc5ee tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:27.015290 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-ab39bece-01b1-498a-8681-090b26bfc5ee tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:27.027028 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-ab39bece-01b1-498a-8681-090b26bfc5ee tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:27.028883 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-ab39bece-01b1-498a-8681-090b26bfc5ee tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:27.029989 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-ab39bece-01b1-498a-8681-090b26bfc5ee tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1722 microversion: 2.20 time: 0.439310 Sep 21 16:29:27.042192 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 369/830] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:29:26 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1722 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:29:27.128504 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-36c721b0-3fbe-474c-95ac-6d5c41d4bfc3 req-57e40240-3965-4d62-bec1-f3d6f171f843 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "591bdacc-1358-430f-961a-f648f5cf8e19", "tag": "1caf6ff4-eb49-4542-a687-9ca98562df23"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:29:27.139449 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-36c721b0-3fbe-474c-95ac-6d5c41d4bfc3 req-57e40240-3965-4d62-bec1-f3d6f171f843 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:27.140194 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-36c721b0-3fbe-474c-95ac-6d5c41d4bfc3 req-57e40240-3965-4d62-bec1-f3d6f171f843 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:27.140673 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-36c721b0-3fbe-474c-95ac-6d5c41d4bfc3 req-57e40240-3965-4d62-bec1-f3d6f171f843 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:27.164421 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-36c721b0-3fbe-474c-95ac-6d5c41d4bfc3 req-57e40240-3965-4d62-bec1-f3d6f171f843 service nova] Creating event network-changed:1caf6ff4-eb49-4542-a687-9ca98562df23 for instance 591bdacc-1358-430f-961a-f648f5cf8e19 on hv-cinder-85862 Sep 21 16:29:27.172664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-36c721b0-3fbe-474c-95ac-6d5c41d4bfc3 req-57e40240-3965-4d62-bec1-f3d6f171f843 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047100 Sep 21 16:29:27.178500 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 462/831] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:29:28.060783 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-8d5ab918-3959-430f-9cbb-8e826acfe8d4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:28.061343 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-8d5ab918-3959-430f-9cbb-8e826acfe8d4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:28.067973 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8d5ab918-3959-430f-9cbb-8e826acfe8d4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:28.068461 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8d5ab918-3959-430f-9cbb-8e826acfe8d4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:28.068891 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8d5ab918-3959-430f-9cbb-8e826acfe8d4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:28.069598 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8d5ab918-3959-430f-9cbb-8e826acfe8d4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:28.070262 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8d5ab918-3959-430f-9cbb-8e826acfe8d4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:28.070843 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8d5ab918-3959-430f-9cbb-8e826acfe8d4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:28.240116 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-8d5ab918-3959-430f-9cbb-8e826acfe8d4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:28.250899 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-8d5ab918-3959-430f-9cbb-8e826acfe8d4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:28.253136 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-8d5ab918-3959-430f-9cbb-8e826acfe8d4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:28.254861 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-8d5ab918-3959-430f-9cbb-8e826acfe8d4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1722 microversion: 2.20 time: 0.197602 Sep 21 16:29:28.256385 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 370/832] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:29:28 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:29:29.282071 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-d7dfdb2f-ef8c-47b4-a8e9-527bde0e8151 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:29.283300 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-d7dfdb2f-ef8c-47b4-a8e9-527bde0e8151 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:29.289399 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d7dfdb2f-ef8c-47b4-a8e9-527bde0e8151 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:29.289882 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d7dfdb2f-ef8c-47b4-a8e9-527bde0e8151 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:29.290345 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d7dfdb2f-ef8c-47b4-a8e9-527bde0e8151 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:29.291044 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d7dfdb2f-ef8c-47b4-a8e9-527bde0e8151 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:29.291506 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d7dfdb2f-ef8c-47b4-a8e9-527bde0e8151 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:29.291931 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d7dfdb2f-ef8c-47b4-a8e9-527bde0e8151 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:29.440884 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d7dfdb2f-ef8c-47b4-a8e9-527bde0e8151 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:29.449506 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d7dfdb2f-ef8c-47b4-a8e9-527bde0e8151 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:29.450917 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d7dfdb2f-ef8c-47b4-a8e9-527bde0e8151 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:29.452110 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-d7dfdb2f-ef8c-47b4-a8e9-527bde0e8151 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1722 microversion: 2.20 time: 0.174921 Sep 21 16:29:29.453353 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 463/833] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:29:29 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:29:30.478064 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-056740ef-0a93-4e0d-af07-3e52535b13f4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:30.478691 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-056740ef-0a93-4e0d-af07-3e52535b13f4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:30.486867 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-056740ef-0a93-4e0d-af07-3e52535b13f4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:30.487360 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-056740ef-0a93-4e0d-af07-3e52535b13f4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:30.487988 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-056740ef-0a93-4e0d-af07-3e52535b13f4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:30.488738 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-056740ef-0a93-4e0d-af07-3e52535b13f4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:30.489194 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-056740ef-0a93-4e0d-af07-3e52535b13f4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:30.489619 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-056740ef-0a93-4e0d-af07-3e52535b13f4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:30.673884 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-056740ef-0a93-4e0d-af07-3e52535b13f4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:30.682517 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-056740ef-0a93-4e0d-af07-3e52535b13f4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:30.684004 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-056740ef-0a93-4e0d-af07-3e52535b13f4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:30.685182 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-056740ef-0a93-4e0d-af07-3e52535b13f4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1722 microversion: 2.20 time: 0.211158 Sep 21 16:29:30.689487 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 371/834] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:29:30 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:29:31.711765 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-32e6d962-3506-467b-96cb-9871d2ab55cd tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:31.712509 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-32e6d962-3506-467b-96cb-9871d2ab55cd tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:31.718874 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-32e6d962-3506-467b-96cb-9871d2ab55cd tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:31.719446 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-32e6d962-3506-467b-96cb-9871d2ab55cd tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:31.720588 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-32e6d962-3506-467b-96cb-9871d2ab55cd tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:31.721508 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-32e6d962-3506-467b-96cb-9871d2ab55cd tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:31.722115 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-32e6d962-3506-467b-96cb-9871d2ab55cd tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:31.722638 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-32e6d962-3506-467b-96cb-9871d2ab55cd tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:31.727596 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:29:31.892807 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-32e6d962-3506-467b-96cb-9871d2ab55cd tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:31.901875 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-32e6d962-3506-467b-96cb-9871d2ab55cd tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:31.903538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-32e6d962-3506-467b-96cb-9871d2ab55cd tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:31.904816 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-32e6d962-3506-467b-96cb-9871d2ab55cd tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1722 microversion: 2.20 time: 0.197329 Sep 21 16:29:31.905857 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 464/835] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:29:31 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:29:32.831839 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-0b048840-4c45-4b6a-b745-37fc01070fdb tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:32.834027 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-0b048840-4c45-4b6a-b745-37fc01070fdb tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:32.840795 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0b048840-4c45-4b6a-b745-37fc01070fdb tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:32.841279 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0b048840-4c45-4b6a-b745-37fc01070fdb tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:32.841708 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0b048840-4c45-4b6a-b745-37fc01070fdb tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:32.842464 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0b048840-4c45-4b6a-b745-37fc01070fdb tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:32.842915 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0b048840-4c45-4b6a-b745-37fc01070fdb tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:32.843333 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0b048840-4c45-4b6a-b745-37fc01070fdb tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:32.874198 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:29:32.881009 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-0b048840-4c45-4b6a-b745-37fc01070fdb tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.054063 Sep 21 16:29:32.881594 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 372/836] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Sep 21 16:29:32 2022] GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:29:32.930771 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-7d96a02e-58a1-420b-a411-edd0338e75c6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:32.931462 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-7d96a02e-58a1-420b-a411-edd0338e75c6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:32.938126 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7d96a02e-58a1-420b-a411-edd0338e75c6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:32.938704 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7d96a02e-58a1-420b-a411-edd0338e75c6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:32.939131 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7d96a02e-58a1-420b-a411-edd0338e75c6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:32.939846 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7d96a02e-58a1-420b-a411-edd0338e75c6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:32.940304 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7d96a02e-58a1-420b-a411-edd0338e75c6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:32.940733 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7d96a02e-58a1-420b-a411-edd0338e75c6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:33.036608 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-6e48331a-5fbf-4ace-845e-b52b1cbb0871 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:33.037407 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-6e48331a-5fbf-4ace-845e-b52b1cbb0871 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:33.048629 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6e48331a-5fbf-4ace-845e-b52b1cbb0871 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:33.049911 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6e48331a-5fbf-4ace-845e-b52b1cbb0871 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:33.050989 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6e48331a-5fbf-4ace-845e-b52b1cbb0871 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:33.052432 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6e48331a-5fbf-4ace-845e-b52b1cbb0871 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:33.053410 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6e48331a-5fbf-4ace-845e-b52b1cbb0871 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:33.054556 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6e48331a-5fbf-4ace-845e-b52b1cbb0871 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:33.101184 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-6e48331a-5fbf-4ace-845e-b52b1cbb0871 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079/os-volume_attachments/dbb50fa1-404e-48e2-b233-42b5ff78524e" status: 200 len: 194 microversion: 2.1 time: 0.073109 Sep 21 16:29:33.101906 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 373/837] 10.222.0.64 () {58 vars in 1413 bytes} [Wed Sep 21 16:29:33 2022] GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079/os-volume_attachments/dbb50fa1-404e-48e2-b233-42b5ff78524e => generated 194 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:29:33.114348 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-a7836d6a-5abd-478d-a00e-41e8daf85465 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:33.114854 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-a7836d6a-5abd-478d-a00e-41e8daf85465 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:33.121762 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a7836d6a-5abd-478d-a00e-41e8daf85465 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:33.122293 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a7836d6a-5abd-478d-a00e-41e8daf85465 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:33.122733 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a7836d6a-5abd-478d-a00e-41e8daf85465 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:33.125199 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a7836d6a-5abd-478d-a00e-41e8daf85465 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:33.125685 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a7836d6a-5abd-478d-a00e-41e8daf85465 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:33.126148 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a7836d6a-5abd-478d-a00e-41e8daf85465 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:33.160815 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-7d96a02e-58a1-420b-a411-edd0338e75c6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:33.179844 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-7d96a02e-58a1-420b-a411-edd0338e75c6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:33.181376 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-7d96a02e-58a1-420b-a411-edd0338e75c6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:33.183042 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-7d96a02e-58a1-420b-a411-edd0338e75c6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1743 microversion: 2.20 time: 0.256193 Sep 21 16:29:33.183873 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 465/838] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:29:32 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1743 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 16:29:33.230331 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.objects.instance [None req-a7836d6a-5abd-478d-a00e-41e8daf85465 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lazy-loading 'services' on Instance uuid 68300698-35cc-4b4c-8046-7d1ce02c0079 {{(pid=120531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 16:29:33.308879 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-a7836d6a-5abd-478d-a00e-41e8daf85465 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "DELETE /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079/os-volume_attachments/dbb50fa1-404e-48e2-b233-42b5ff78524e" status: 202 len: 0 microversion: 2.1 time: 0.199795 Sep 21 16:29:33.310930 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 374/839] 10.222.0.64 () {58 vars in 1416 bytes} [Wed Sep 21 16:29:33 2022] DELETE /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079/os-volume_attachments/dbb50fa1-404e-48e2-b233-42b5ff78524e => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 21 16:29:34.210698 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-26d1b6d4-23f3-4bae-86b2-fe823b57b3ee tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:34.211324 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-26d1b6d4-23f3-4bae-86b2-fe823b57b3ee tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:34.218436 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-26d1b6d4-23f3-4bae-86b2-fe823b57b3ee tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:34.218933 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-26d1b6d4-23f3-4bae-86b2-fe823b57b3ee tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:34.219371 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-26d1b6d4-23f3-4bae-86b2-fe823b57b3ee tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:34.220672 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-26d1b6d4-23f3-4bae-86b2-fe823b57b3ee tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:34.221133 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-26d1b6d4-23f3-4bae-86b2-fe823b57b3ee tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:34.221560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-26d1b6d4-23f3-4bae-86b2-fe823b57b3ee tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:34.375480 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-26d1b6d4-23f3-4bae-86b2-fe823b57b3ee tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:34.384682 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-26d1b6d4-23f3-4bae-86b2-fe823b57b3ee tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:34.386227 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-26d1b6d4-23f3-4bae-86b2-fe823b57b3ee tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:34.387439 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-26d1b6d4-23f3-4bae-86b2-fe823b57b3ee tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1743 microversion: 2.20 time: 0.180794 Sep 21 16:29:34.388014 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 466/840] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:29:34 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1743 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:29:35.418460 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-bafdefe0-8133-45ce-9b38-8ec2c9d606b2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:35.419167 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-bafdefe0-8133-45ce-9b38-8ec2c9d606b2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:35.426425 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bafdefe0-8133-45ce-9b38-8ec2c9d606b2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:35.426921 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bafdefe0-8133-45ce-9b38-8ec2c9d606b2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:35.427387 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bafdefe0-8133-45ce-9b38-8ec2c9d606b2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:35.428086 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bafdefe0-8133-45ce-9b38-8ec2c9d606b2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:35.428546 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bafdefe0-8133-45ce-9b38-8ec2c9d606b2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:35.428970 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bafdefe0-8133-45ce-9b38-8ec2c9d606b2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:35.581696 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-bafdefe0-8133-45ce-9b38-8ec2c9d606b2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:35.590150 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-bafdefe0-8133-45ce-9b38-8ec2c9d606b2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:35.591598 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-bafdefe0-8133-45ce-9b38-8ec2c9d606b2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:35.592773 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-bafdefe0-8133-45ce-9b38-8ec2c9d606b2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1743 microversion: 2.20 time: 0.179261 Sep 21 16:29:35.593334 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 375/841] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:29:35 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1743 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:29:36.617636 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-0a9742ab-2cb5-45dc-944f-25487ae29447 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:36.618390 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-0a9742ab-2cb5-45dc-944f-25487ae29447 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:36.625024 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0a9742ab-2cb5-45dc-944f-25487ae29447 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:36.625611 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0a9742ab-2cb5-45dc-944f-25487ae29447 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:36.626038 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0a9742ab-2cb5-45dc-944f-25487ae29447 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:36.626770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0a9742ab-2cb5-45dc-944f-25487ae29447 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:36.627214 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0a9742ab-2cb5-45dc-944f-25487ae29447 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:36.627636 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0a9742ab-2cb5-45dc-944f-25487ae29447 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:36.768123 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-0a9742ab-2cb5-45dc-944f-25487ae29447 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:36.777977 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-0a9742ab-2cb5-45dc-944f-25487ae29447 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:36.779513 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-0a9742ab-2cb5-45dc-944f-25487ae29447 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:36.780945 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-0a9742ab-2cb5-45dc-944f-25487ae29447 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1743 microversion: 2.20 time: 0.167243 Sep 21 16:29:36.783003 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 467/842] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:29:36 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1743 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:29:36.858746 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-b01b1ca8-fee5-43f3-9a1a-92851890fbb4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:36.859899 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-b01b1ca8-fee5-43f3-9a1a-92851890fbb4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 19567338-1f72-414d-b6d7-7ab9d4fe94bc] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:36.867046 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b01b1ca8-fee5-43f3-9a1a-92851890fbb4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:36.867539 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b01b1ca8-fee5-43f3-9a1a-92851890fbb4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:36.867976 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b01b1ca8-fee5-43f3-9a1a-92851890fbb4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:36.868666 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b01b1ca8-fee5-43f3-9a1a-92851890fbb4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:36.869121 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b01b1ca8-fee5-43f3-9a1a-92851890fbb4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:36.869543 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b01b1ca8-fee5-43f3-9a1a-92851890fbb4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:36.896913 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-b01b1ca8-fee5-43f3-9a1a-92851890fbb4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 19567338-1f72-414d-b6d7-7ab9d4fe94bc] Going to try to terminate instance {{(pid=120531) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 16:29:36.997631 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-b01b1ca8-fee5-43f3-9a1a-92851890fbb4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "DELETE /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc" status: 204 len: 0 microversion: 2.1 time: 0.142287 Sep 21 16:29:36.998744 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 376/843] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Sep 21 16:29:36 2022] DELETE /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 21 16:29:37.010800 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-abc311ad-88bf-4607-9b33-4cabd75a8af9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:37.011527 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-abc311ad-88bf-4607-9b33-4cabd75a8af9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 19567338-1f72-414d-b6d7-7ab9d4fe94bc] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:37.019751 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-abc311ad-88bf-4607-9b33-4cabd75a8af9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:37.020275 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-abc311ad-88bf-4607-9b33-4cabd75a8af9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:37.020794 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-abc311ad-88bf-4607-9b33-4cabd75a8af9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:37.021520 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-abc311ad-88bf-4607-9b33-4cabd75a8af9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:37.022029 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-abc311ad-88bf-4607-9b33-4cabd75a8af9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:37.022449 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-abc311ad-88bf-4607-9b33-4cabd75a8af9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:37.181129 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-abc311ad-88bf-4607-9b33-4cabd75a8af9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:37.189766 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-abc311ad-88bf-4607-9b33-4cabd75a8af9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc" status: 200 len: 1578 microversion: 2.1 time: 0.183538 Sep 21 16:29:37.190370 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 468/844] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:37 2022] GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc => generated 1578 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:37.636465 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-f38bb7cb-1d8c-4eff-9cbe-f35f2a2faf1a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:37.637158 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-f38bb7cb-1d8c-4eff-9cbe-f35f2a2faf1a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:37.643278 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f38bb7cb-1d8c-4eff-9cbe-f35f2a2faf1a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:37.644023 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f38bb7cb-1d8c-4eff-9cbe-f35f2a2faf1a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:37.644455 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f38bb7cb-1d8c-4eff-9cbe-f35f2a2faf1a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:37.645184 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f38bb7cb-1d8c-4eff-9cbe-f35f2a2faf1a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:37.645666 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f38bb7cb-1d8c-4eff-9cbe-f35f2a2faf1a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:37.646106 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f38bb7cb-1d8c-4eff-9cbe-f35f2a2faf1a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:37.679466 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-f38bb7cb-1d8c-4eff-9cbe-f35f2a2faf1a tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079/os-volume_attachments/a48cc444-337c-4b67-b6c0-bf8974af6c9a" status: 200 len: 194 microversion: 2.1 time: 0.048081 Sep 21 16:29:37.680127 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 377/845] 10.222.0.64 () {58 vars in 1413 bytes} [Wed Sep 21 16:29:37 2022] GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079/os-volume_attachments/a48cc444-337c-4b67-b6c0-bf8974af6c9a => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:29:37.694091 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ceec6549-049e-48e7-97e7-26752a93d833 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:37.695026 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ceec6549-049e-48e7-97e7-26752a93d833 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:37.701346 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ceec6549-049e-48e7-97e7-26752a93d833 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:37.701834 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ceec6549-049e-48e7-97e7-26752a93d833 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:37.702309 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ceec6549-049e-48e7-97e7-26752a93d833 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:37.703023 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ceec6549-049e-48e7-97e7-26752a93d833 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:37.703479 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ceec6549-049e-48e7-97e7-26752a93d833 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:37.704451 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ceec6549-049e-48e7-97e7-26752a93d833 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:37.802215 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.objects.instance [None req-ceec6549-049e-48e7-97e7-26752a93d833 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lazy-loading 'services' on Instance uuid 68300698-35cc-4b4c-8046-7d1ce02c0079 {{(pid=120532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 16:29:37.817393 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-30def110-4d7d-46e4-8788-d590526fb998 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:37.818668 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-30def110-4d7d-46e4-8788-d590526fb998 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:37.829648 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-30def110-4d7d-46e4-8788-d590526fb998 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:37.830562 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-30def110-4d7d-46e4-8788-d590526fb998 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:37.831408 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-30def110-4d7d-46e4-8788-d590526fb998 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:37.832621 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-30def110-4d7d-46e4-8788-d590526fb998 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:37.833705 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-30def110-4d7d-46e4-8788-d590526fb998 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:37.834534 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-30def110-4d7d-46e4-8788-d590526fb998 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:37.922088 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ceec6549-049e-48e7-97e7-26752a93d833 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "DELETE /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079/os-volume_attachments/a48cc444-337c-4b67-b6c0-bf8974af6c9a" status: 202 len: 0 microversion: 2.1 time: 0.232646 Sep 21 16:29:37.922874 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 469/846] 10.222.0.64 () {58 vars in 1416 bytes} [Wed Sep 21 16:29:37 2022] DELETE /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079/os-volume_attachments/a48cc444-337c-4b67-b6c0-bf8974af6c9a => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 16:29:37.986153 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-30def110-4d7d-46e4-8788-d590526fb998 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:37.994707 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-30def110-4d7d-46e4-8788-d590526fb998 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:37.996250 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-30def110-4d7d-46e4-8788-d590526fb998 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:37.997461 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-30def110-4d7d-46e4-8788-d590526fb998 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1738 microversion: 2.20 time: 0.187826 Sep 21 16:29:37.998089 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 378/847] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:29:37 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:29:38.214113 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-9d6d8264-bce1-40e8-b275-a4c4142b39c7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:38.214805 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-9d6d8264-bce1-40e8-b275-a4c4142b39c7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 19567338-1f72-414d-b6d7-7ab9d4fe94bc] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:38.221641 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9d6d8264-bce1-40e8-b275-a4c4142b39c7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:38.222145 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9d6d8264-bce1-40e8-b275-a4c4142b39c7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:38.222579 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9d6d8264-bce1-40e8-b275-a4c4142b39c7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:38.223268 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9d6d8264-bce1-40e8-b275-a4c4142b39c7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:38.223714 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9d6d8264-bce1-40e8-b275-a4c4142b39c7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:38.224131 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9d6d8264-bce1-40e8-b275-a4c4142b39c7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:38.355499 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-9d6d8264-bce1-40e8-b275-a4c4142b39c7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:38.363306 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-9d6d8264-bce1-40e8-b275-a4c4142b39c7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc" status: 200 len: 1578 microversion: 2.1 time: 0.153486 Sep 21 16:29:38.363877 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 470/848] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:38 2022] GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:39.023770 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-fa975758-d16a-4df5-9f93-b77a3b5a1dc7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:39.024373 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-fa975758-d16a-4df5-9f93-b77a3b5a1dc7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:39.031230 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fa975758-d16a-4df5-9f93-b77a3b5a1dc7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:39.031630 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fa975758-d16a-4df5-9f93-b77a3b5a1dc7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:39.032109 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fa975758-d16a-4df5-9f93-b77a3b5a1dc7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:39.032814 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fa975758-d16a-4df5-9f93-b77a3b5a1dc7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:39.033262 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fa975758-d16a-4df5-9f93-b77a3b5a1dc7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:39.033692 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fa975758-d16a-4df5-9f93-b77a3b5a1dc7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:39.168862 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-fa975758-d16a-4df5-9f93-b77a3b5a1dc7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:39.177392 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-fa975758-d16a-4df5-9f93-b77a3b5a1dc7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:39.178866 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-fa975758-d16a-4df5-9f93-b77a3b5a1dc7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:39.180010 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-fa975758-d16a-4df5-9f93-b77a3b5a1dc7 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1738 microversion: 2.20 time: 0.160073 Sep 21 16:29:39.180563 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 379/849] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:29:39 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:29:39.386880 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-8bca700a-1e25-44b5-b28e-df29365d6365 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:39.387433 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-8bca700a-1e25-44b5-b28e-df29365d6365 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 19567338-1f72-414d-b6d7-7ab9d4fe94bc] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:39.394482 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8bca700a-1e25-44b5-b28e-df29365d6365 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:39.394966 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8bca700a-1e25-44b5-b28e-df29365d6365 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:39.395397 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8bca700a-1e25-44b5-b28e-df29365d6365 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:39.396096 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8bca700a-1e25-44b5-b28e-df29365d6365 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:39.396550 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8bca700a-1e25-44b5-b28e-df29365d6365 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:39.396973 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8bca700a-1e25-44b5-b28e-df29365d6365 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:39.528894 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-8bca700a-1e25-44b5-b28e-df29365d6365 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:39.537099 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-8bca700a-1e25-44b5-b28e-df29365d6365 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc" status: 200 len: 1578 microversion: 2.1 time: 0.154248 Sep 21 16:29:39.537668 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 471/850] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:39 2022] GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:39.858567 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-16d6d701-95a4-42ad-974f-7163b1e10496 req-50c08aa7-edd4-4355-afca-e6ef967926b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce59fd53-2d4c-477e-8326-672737e561f5", "name": "network-vif-plugged", "status": "completed", "tag": "5abd346c-df9c-4cb2-b976-8f9adc822383"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:29:39.869136 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-16d6d701-95a4-42ad-974f-7163b1e10496 req-50c08aa7-edd4-4355-afca-e6ef967926b7 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:39.869637 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-16d6d701-95a4-42ad-974f-7163b1e10496 req-50c08aa7-edd4-4355-afca-e6ef967926b7 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:39.870082 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-16d6d701-95a4-42ad-974f-7163b1e10496 req-50c08aa7-edd4-4355-afca-e6ef967926b7 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:39.883189 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-16d6d701-95a4-42ad-974f-7163b1e10496 req-50c08aa7-edd4-4355-afca-e6ef967926b7 service nova] Creating event network-vif-plugged:5abd346c-df9c-4cb2-b976-8f9adc822383 for instance ce59fd53-2d4c-477e-8326-672737e561f5 on hv-cinder-85862 Sep 21 16:29:39.888228 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-16d6d701-95a4-42ad-974f-7163b1e10496 req-50c08aa7-edd4-4355-afca-e6ef967926b7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033202 Sep 21 16:29:39.888788 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 380/851] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:29:40.208581 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-a037d676-586e-4ebb-a72e-68631e085e61 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:40.209205 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-a037d676-586e-4ebb-a72e-68631e085e61 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:40.215306 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a037d676-586e-4ebb-a72e-68631e085e61 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:40.215797 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a037d676-586e-4ebb-a72e-68631e085e61 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:40.216235 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a037d676-586e-4ebb-a72e-68631e085e61 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:40.216943 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a037d676-586e-4ebb-a72e-68631e085e61 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:40.217405 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a037d676-586e-4ebb-a72e-68631e085e61 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:40.217830 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a037d676-586e-4ebb-a72e-68631e085e61 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:40.366409 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a037d676-586e-4ebb-a72e-68631e085e61 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:40.374747 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a037d676-586e-4ebb-a72e-68631e085e61 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:40.376808 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a037d676-586e-4ebb-a72e-68631e085e61 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:40.378024 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-a037d676-586e-4ebb-a72e-68631e085e61 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1738 microversion: 2.20 time: 0.176445 Sep 21 16:29:40.378611 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 472/852] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:29:40 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:29:40.562155 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-66277e69-9472-4f9e-a916-68d7668522d3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:40.562783 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-66277e69-9472-4f9e-a916-68d7668522d3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 19567338-1f72-414d-b6d7-7ab9d4fe94bc] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:40.569515 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-66277e69-9472-4f9e-a916-68d7668522d3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:40.569994 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-66277e69-9472-4f9e-a916-68d7668522d3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:40.570454 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-66277e69-9472-4f9e-a916-68d7668522d3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:40.571145 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-66277e69-9472-4f9e-a916-68d7668522d3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:40.571598 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-66277e69-9472-4f9e-a916-68d7668522d3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:40.572014 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-66277e69-9472-4f9e-a916-68d7668522d3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:40.722933 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-66277e69-9472-4f9e-a916-68d7668522d3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:40.739707 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-66277e69-9472-4f9e-a916-68d7668522d3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc" status: 200 len: 1578 microversion: 2.1 time: 0.182369 Sep 21 16:29:40.740298 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 381/853] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:40 2022] GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc => generated 1578 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:41.410159 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-4e9fbc5e-0aaa-4d8c-abc0-5060cb3795d6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:41.410960 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-4e9fbc5e-0aaa-4d8c-abc0-5060cb3795d6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:41.418833 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4e9fbc5e-0aaa-4d8c-abc0-5060cb3795d6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:41.420105 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4e9fbc5e-0aaa-4d8c-abc0-5060cb3795d6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:41.420557 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4e9fbc5e-0aaa-4d8c-abc0-5060cb3795d6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:41.433540 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4e9fbc5e-0aaa-4d8c-abc0-5060cb3795d6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:41.434882 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4e9fbc5e-0aaa-4d8c-abc0-5060cb3795d6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:41.434882 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4e9fbc5e-0aaa-4d8c-abc0-5060cb3795d6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:41.640339 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-4e9fbc5e-0aaa-4d8c-abc0-5060cb3795d6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:41.653280 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-4e9fbc5e-0aaa-4d8c-abc0-5060cb3795d6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:41.655354 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-4e9fbc5e-0aaa-4d8c-abc0-5060cb3795d6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:41.658128 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-4e9fbc5e-0aaa-4d8c-abc0-5060cb3795d6 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1738 microversion: 2.20 time: 0.257192 Sep 21 16:29:41.659306 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 473/854] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:29:41 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1738 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:29:41.763953 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-973c7116-3870-46d6-bff0-519a3c423086 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:41.765284 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-973c7116-3870-46d6-bff0-519a3c423086 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 19567338-1f72-414d-b6d7-7ab9d4fe94bc] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:41.776237 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-973c7116-3870-46d6-bff0-519a3c423086 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:41.777267 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-973c7116-3870-46d6-bff0-519a3c423086 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:41.778168 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-973c7116-3870-46d6-bff0-519a3c423086 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:41.779772 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-973c7116-3870-46d6-bff0-519a3c423086 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:41.781156 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-973c7116-3870-46d6-bff0-519a3c423086 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:41.782335 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-973c7116-3870-46d6-bff0-519a3c423086 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:42.175388 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-973c7116-3870-46d6-bff0-519a3c423086 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:42.194810 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-973c7116-3870-46d6-bff0-519a3c423086 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc" status: 200 len: 1578 microversion: 2.1 time: 0.435095 Sep 21 16:29:42.197965 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 382/855] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:41 2022] GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc => generated 1578 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:42.382109 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-aec04415-7a74-4de3-bc74-c2da95b4bfc5 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:42.384735 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-aec04415-7a74-4de3-bc74-c2da95b4bfc5 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:42.400177 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-aec04415-7a74-4de3-bc74-c2da95b4bfc5 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:42.402567 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-aec04415-7a74-4de3-bc74-c2da95b4bfc5 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:42.404008 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-aec04415-7a74-4de3-bc74-c2da95b4bfc5 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:42.404906 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-aec04415-7a74-4de3-bc74-c2da95b4bfc5 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:42.405351 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-aec04415-7a74-4de3-bc74-c2da95b4bfc5 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:42.405817 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-aec04415-7a74-4de3-bc74-c2da95b4bfc5 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:42.472376 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-aec04415-7a74-4de3-bc74-c2da95b4bfc5 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.094407 Sep 21 16:29:42.479875 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 474/856] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Sep 21 16:29:42 2022] GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079/os-volume_attachments => generated 25 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 21 16:29:42.673654 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-f7121c4e-14fa-4370-becb-3159a9e8f7ca tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:42.676846 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-f7121c4e-14fa-4370-becb-3159a9e8f7ca tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:42.684261 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-20c5059d-6f65-41c7-adb5-22f2c5dd1e54 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:42.685339 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-20c5059d-6f65-41c7-adb5-22f2c5dd1e54 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:42.691428 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f7121c4e-14fa-4370-becb-3159a9e8f7ca tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:42.692175 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f7121c4e-14fa-4370-becb-3159a9e8f7ca tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:42.692710 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f7121c4e-14fa-4370-becb-3159a9e8f7ca tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:42.693557 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f7121c4e-14fa-4370-becb-3159a9e8f7ca tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:42.693927 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-20c5059d-6f65-41c7-adb5-22f2c5dd1e54 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:42.694075 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f7121c4e-14fa-4370-becb-3159a9e8f7ca tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:42.694465 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f7121c4e-14fa-4370-becb-3159a9e8f7ca tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:42.695516 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-20c5059d-6f65-41c7-adb5-22f2c5dd1e54 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:42.696216 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-20c5059d-6f65-41c7-adb5-22f2c5dd1e54 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:42.697214 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-20c5059d-6f65-41c7-adb5-22f2c5dd1e54 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:42.697917 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-20c5059d-6f65-41c7-adb5-22f2c5dd1e54 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:42.698606 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-20c5059d-6f65-41c7-adb5-22f2c5dd1e54 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:42.731517 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-f7121c4e-14fa-4370-becb-3159a9e8f7ca tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061816 Sep 21 16:29:42.737044 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 383/857] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Sep 21 16:29:42 2022] GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 21 16:29:42.863694 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-297d31d1-1687-4f9a-8503-d4c153678c22 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:42.867503 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-297d31d1-1687-4f9a-8503-d4c153678c22 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:42.897024 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-297d31d1-1687-4f9a-8503-d4c153678c22 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:42.897796 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-297d31d1-1687-4f9a-8503-d4c153678c22 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:42.898450 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-297d31d1-1687-4f9a-8503-d4c153678c22 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:42.899371 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-297d31d1-1687-4f9a-8503-d4c153678c22 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:42.901501 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-297d31d1-1687-4f9a-8503-d4c153678c22 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:42.902215 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-297d31d1-1687-4f9a-8503-d4c153678c22 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:42.944613 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-297d31d1-1687-4f9a-8503-d4c153678c22 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] Going to try to terminate instance {{(pid=120531) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 16:29:43.028654 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-20c5059d-6f65-41c7-adb5-22f2c5dd1e54 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:43.046286 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-20c5059d-6f65-41c7-adb5-22f2c5dd1e54 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:43.052182 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-20c5059d-6f65-41c7-adb5-22f2c5dd1e54 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:43.056974 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-20c5059d-6f65-41c7-adb5-22f2c5dd1e54 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1738 microversion: 2.20 time: 0.376850 Sep 21 16:29:43.058190 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 475/858] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:29:42 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1738 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 16:29:43.064004 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-196d1da5-4f61-4281-8067-701026b8e81e req-b37701e3-4e4b-42de-b959-aee45a919f0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19567338-1f72-414d-b6d7-7ab9d4fe94bc", "name": "network-vif-deleted", "tag": "8c077bf0-61d4-4c24-843e-0a70de3959d3"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:29:43.087861 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-196d1da5-4f61-4281-8067-701026b8e81e req-b37701e3-4e4b-42de-b959-aee45a919f0e service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:43.092731 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-196d1da5-4f61-4281-8067-701026b8e81e req-b37701e3-4e4b-42de-b959-aee45a919f0e service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:43.096664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-196d1da5-4f61-4281-8067-701026b8e81e req-b37701e3-4e4b-42de-b959-aee45a919f0e service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:43.119800 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-196d1da5-4f61-4281-8067-701026b8e81e req-b37701e3-4e4b-42de-b959-aee45a919f0e service nova] Creating event network-vif-deleted:8c077bf0-61d4-4c24-843e-0a70de3959d3 for instance 19567338-1f72-414d-b6d7-7ab9d4fe94bc on hv-cinder-85862 Sep 21 16:29:43.140279 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-297d31d1-1687-4f9a-8503-d4c153678c22 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "DELETE /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079" status: 204 len: 0 microversion: 2.1 time: 0.280850 Sep 21 16:29:43.142279 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 384/859] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Sep 21 16:29:42 2022] DELETE /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 21 16:29:43.149904 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-196d1da5-4f61-4281-8067-701026b8e81e req-b37701e3-4e4b-42de-b959-aee45a919f0e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081802 Sep 21 16:29:43.152733 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 476/860] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:29:43.156403 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-007335ac-e15c-4d4f-ba37-76500f03af82 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:43.158809 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-007335ac-e15c-4d4f-ba37-76500f03af82 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:43.172332 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-007335ac-e15c-4d4f-ba37-76500f03af82 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:43.173644 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-007335ac-e15c-4d4f-ba37-76500f03af82 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:43.174335 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-007335ac-e15c-4d4f-ba37-76500f03af82 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:43.175264 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-007335ac-e15c-4d4f-ba37-76500f03af82 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:43.176588 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-007335ac-e15c-4d4f-ba37-76500f03af82 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:43.177253 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-007335ac-e15c-4d4f-ba37-76500f03af82 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:43.220342 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ccc24fe7-902c-44a7-85d1-66c4c4802465 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:43.221260 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ccc24fe7-902c-44a7-85d1-66c4c4802465 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 19567338-1f72-414d-b6d7-7ab9d4fe94bc] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:43.223493 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_api:SELECT=75 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:29:43.235421 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ccc24fe7-902c-44a7-85d1-66c4c4802465 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:43.236296 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ccc24fe7-902c-44a7-85d1-66c4c4802465 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:43.237255 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ccc24fe7-902c-44a7-85d1-66c4c4802465 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:43.238261 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ccc24fe7-902c-44a7-85d1-66c4c4802465 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:43.242198 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ccc24fe7-902c-44a7-85d1-66c4c4802465 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:43.243176 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ccc24fe7-902c-44a7-85d1-66c4c4802465 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:43.335631 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ccc24fe7-902c-44a7-85d1-66c4c4802465 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:43.344566 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ccc24fe7-902c-44a7-85d1-66c4c4802465 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc" status: 200 len: 1226 microversion: 2.1 time: 0.129184 Sep 21 16:29:43.345169 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 477/861] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:43 2022] GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc => generated 1226 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:29:43.384480 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-007335ac-e15c-4d4f-ba37-76500f03af82 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:43.392812 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-007335ac-e15c-4d4f-ba37-76500f03af82 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079" status: 200 len: 1673 microversion: 2.1 time: 0.243023 Sep 21 16:29:43.395112 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 385/862] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:43 2022] GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079 => generated 1673 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:29:44.086522 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-020e3767-8376-46d3-9c02-591135e7a599 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:44.098080 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-020e3767-8376-46d3-9c02-591135e7a599 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:44.107715 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-020e3767-8376-46d3-9c02-591135e7a599 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:44.108960 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-020e3767-8376-46d3-9c02-591135e7a599 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:44.109684 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-020e3767-8376-46d3-9c02-591135e7a599 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:44.110689 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-020e3767-8376-46d3-9c02-591135e7a599 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:44.111350 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-020e3767-8376-46d3-9c02-591135e7a599 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:44.112170 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-020e3767-8376-46d3-9c02-591135e7a599 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:44.291166 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-020e3767-8376-46d3-9c02-591135e7a599 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:44.304544 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-020e3767-8376-46d3-9c02-591135e7a599 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:44.305990 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-020e3767-8376-46d3-9c02-591135e7a599 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:44.307240 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-020e3767-8376-46d3-9c02-591135e7a599 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1738 microversion: 2.20 time: 0.224959 Sep 21 16:29:44.307815 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 478/863] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:29:44 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1738 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:29:44.368995 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-1897ccaa-2f12-442b-8746-833e103fd27e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:44.369891 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-1897ccaa-2f12-442b-8746-833e103fd27e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 19567338-1f72-414d-b6d7-7ab9d4fe94bc] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:44.388222 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1897ccaa-2f12-442b-8746-833e103fd27e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:44.388965 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1897ccaa-2f12-442b-8746-833e103fd27e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:44.389507 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1897ccaa-2f12-442b-8746-833e103fd27e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:44.390385 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1897ccaa-2f12-442b-8746-833e103fd27e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:44.392146 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1897ccaa-2f12-442b-8746-833e103fd27e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:44.392907 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1897ccaa-2f12-442b-8746-833e103fd27e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:44.399198 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:29:44.440217 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-2c74e76c-f14c-4fa3-ab3e-c11549de0043 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:44.442117 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-2c74e76c-f14c-4fa3-ab3e-c11549de0043 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:44.469360 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2c74e76c-f14c-4fa3-ab3e-c11549de0043 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:44.469962 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2c74e76c-f14c-4fa3-ab3e-c11549de0043 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:44.470518 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2c74e76c-f14c-4fa3-ab3e-c11549de0043 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:44.471328 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2c74e76c-f14c-4fa3-ab3e-c11549de0043 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:44.476205 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2c74e76c-f14c-4fa3-ab3e-c11549de0043 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:44.476757 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2c74e76c-f14c-4fa3-ab3e-c11549de0043 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:44.539142 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-1897ccaa-2f12-442b-8746-833e103fd27e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:44.560399 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-1897ccaa-2f12-442b-8746-833e103fd27e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc" status: 200 len: 1226 microversion: 2.1 time: 0.195328 Sep 21 16:29:44.561576 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 386/864] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:44 2022] GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc => generated 1226 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:44.659554 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-2c74e76c-f14c-4fa3-ab3e-c11549de0043 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:44.669441 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-2c74e76c-f14c-4fa3-ab3e-c11549de0043 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079" status: 200 len: 1673 microversion: 2.1 time: 0.236153 Sep 21 16:29:44.674474 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 479/865] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:44 2022] GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079 => generated 1673 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:29:45.336698 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-7a330a6e-2214-4f26-992d-ca5936fe0a54 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:45.337305 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-7a330a6e-2214-4f26-992d-ca5936fe0a54 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:45.344039 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7a330a6e-2214-4f26-992d-ca5936fe0a54 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:45.344526 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7a330a6e-2214-4f26-992d-ca5936fe0a54 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:45.344949 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7a330a6e-2214-4f26-992d-ca5936fe0a54 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:45.345656 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7a330a6e-2214-4f26-992d-ca5936fe0a54 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:45.346125 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7a330a6e-2214-4f26-992d-ca5936fe0a54 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:45.346558 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7a330a6e-2214-4f26-992d-ca5936fe0a54 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:45.542145 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-7a330a6e-2214-4f26-992d-ca5936fe0a54 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:45.555057 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-7a330a6e-2214-4f26-992d-ca5936fe0a54 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:45.559144 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-7a330a6e-2214-4f26-992d-ca5936fe0a54 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:45.561327 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-7a330a6e-2214-4f26-992d-ca5936fe0a54 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1738 microversion: 2.20 time: 0.228168 Sep 21 16:29:45.562545 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 387/866] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:29:45 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1738 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:29:45.588551 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ef992713-4685-4ef1-b444-2c2a45d7f3ab tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:45.590413 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ef992713-4685-4ef1-b444-2c2a45d7f3ab tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 19567338-1f72-414d-b6d7-7ab9d4fe94bc] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:45.602890 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ef992713-4685-4ef1-b444-2c2a45d7f3ab tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:45.603790 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ef992713-4685-4ef1-b444-2c2a45d7f3ab tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:45.604578 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ef992713-4685-4ef1-b444-2c2a45d7f3ab tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:45.605618 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ef992713-4685-4ef1-b444-2c2a45d7f3ab tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:45.606320 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ef992713-4685-4ef1-b444-2c2a45d7f3ab tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:45.607055 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ef992713-4685-4ef1-b444-2c2a45d7f3ab tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:45.701069 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-787e9892-dd88-4279-980f-cf10a1c25508 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:45.701771 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-787e9892-dd88-4279-980f-cf10a1c25508 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:45.709333 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ef992713-4685-4ef1-b444-2c2a45d7f3ab tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:45.709602 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-787e9892-dd88-4279-980f-cf10a1c25508 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:45.710359 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-787e9892-dd88-4279-980f-cf10a1c25508 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:45.710787 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-787e9892-dd88-4279-980f-cf10a1c25508 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:45.711888 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-787e9892-dd88-4279-980f-cf10a1c25508 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:45.712351 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-787e9892-dd88-4279-980f-cf10a1c25508 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:45.712869 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:29:45.713403 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-787e9892-dd88-4279-980f-cf10a1c25508 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:45.719641 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ef992713-4685-4ef1-b444-2c2a45d7f3ab tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc" status: 200 len: 1226 microversion: 2.1 time: 0.136595 Sep 21 16:29:45.719641 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 480/867] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:45 2022] GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc => generated 1226 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:29:45.875951 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-787e9892-dd88-4279-980f-cf10a1c25508 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:45.885180 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-787e9892-dd88-4279-980f-cf10a1c25508 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079" status: 200 len: 1673 microversion: 2.1 time: 0.189504 Sep 21 16:29:45.886227 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 388/868] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:45 2022] GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079 => generated 1673 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:46.602004 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-d8e0ae3f-f20e-490d-a214-9010eeb3b2d4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:46.603754 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-d8e0ae3f-f20e-490d-a214-9010eeb3b2d4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:46.624872 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d8e0ae3f-f20e-490d-a214-9010eeb3b2d4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:46.625852 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d8e0ae3f-f20e-490d-a214-9010eeb3b2d4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:46.626568 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d8e0ae3f-f20e-490d-a214-9010eeb3b2d4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:46.627746 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d8e0ae3f-f20e-490d-a214-9010eeb3b2d4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:46.628439 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d8e0ae3f-f20e-490d-a214-9010eeb3b2d4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:46.629364 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d8e0ae3f-f20e-490d-a214-9010eeb3b2d4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:46.743713 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-beb2005b-6bf7-4c36-a584-53a13d918517 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:46.744328 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-beb2005b-6bf7-4c36-a584-53a13d918517 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 19567338-1f72-414d-b6d7-7ab9d4fe94bc] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:46.752704 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-beb2005b-6bf7-4c36-a584-53a13d918517 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:46.754287 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-beb2005b-6bf7-4c36-a584-53a13d918517 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:46.755399 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-beb2005b-6bf7-4c36-a584-53a13d918517 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:46.757096 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-beb2005b-6bf7-4c36-a584-53a13d918517 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:46.758593 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-beb2005b-6bf7-4c36-a584-53a13d918517 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:46.759611 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-beb2005b-6bf7-4c36-a584-53a13d918517 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:46.832898 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d8e0ae3f-f20e-490d-a214-9010eeb3b2d4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:46.861251 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d8e0ae3f-f20e-490d-a214-9010eeb3b2d4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:46.861251 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d8e0ae3f-f20e-490d-a214-9010eeb3b2d4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:46.865739 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-d8e0ae3f-f20e-490d-a214-9010eeb3b2d4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1738 microversion: 2.20 time: 0.265112 Sep 21 16:29:46.878685 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-beb2005b-6bf7-4c36-a584-53a13d918517 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:46.881861 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 481/869] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:29:46 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1738 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:29:46.896914 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-beb2005b-6bf7-4c36-a584-53a13d918517 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc" status: 200 len: 1226 microversion: 2.1 time: 0.157858 Sep 21 16:29:46.897811 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 389/870] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:46 2022] GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc => generated 1226 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:29:46.916251 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-246be043-a6ff-4b73-8ee0-3598f73e1d00 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:46.917509 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-246be043-a6ff-4b73-8ee0-3598f73e1d00 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:46.926085 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-246be043-a6ff-4b73-8ee0-3598f73e1d00 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:46.926847 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-246be043-a6ff-4b73-8ee0-3598f73e1d00 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:46.927543 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-246be043-a6ff-4b73-8ee0-3598f73e1d00 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:46.928270 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-246be043-a6ff-4b73-8ee0-3598f73e1d00 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:46.928769 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-246be043-a6ff-4b73-8ee0-3598f73e1d00 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:46.929407 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-246be043-a6ff-4b73-8ee0-3598f73e1d00 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:47.144111 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-246be043-a6ff-4b73-8ee0-3598f73e1d00 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:47.160973 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-246be043-a6ff-4b73-8ee0-3598f73e1d00 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079" status: 200 len: 1673 microversion: 2.1 time: 0.249319 Sep 21 16:29:47.162347 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 482/871] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:46 2022] GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079 => generated 1673 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:47.905139 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-09b2c9b2-bbde-40ec-a8b3-345257e25c20 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:47.907302 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-09b2c9b2-bbde-40ec-a8b3-345257e25c20 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:47.936033 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:29:47.939211 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-19392a44-0434-4384-a03a-48611a473ee9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:47.942275 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-19392a44-0434-4384-a03a-48611a473ee9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 19567338-1f72-414d-b6d7-7ab9d4fe94bc] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:47.943113 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-09b2c9b2-bbde-40ec-a8b3-345257e25c20 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:47.946666 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-09b2c9b2-bbde-40ec-a8b3-345257e25c20 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:47.947280 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-09b2c9b2-bbde-40ec-a8b3-345257e25c20 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:47.949758 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-09b2c9b2-bbde-40ec-a8b3-345257e25c20 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:47.950420 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-09b2c9b2-bbde-40ec-a8b3-345257e25c20 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:47.954576 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-09b2c9b2-bbde-40ec-a8b3-345257e25c20 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:47.958247 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-19392a44-0434-4384-a03a-48611a473ee9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:47.959800 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-19392a44-0434-4384-a03a-48611a473ee9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:47.960558 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-19392a44-0434-4384-a03a-48611a473ee9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:47.962132 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-19392a44-0434-4384-a03a-48611a473ee9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:47.962978 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-19392a44-0434-4384-a03a-48611a473ee9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:47.963707 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-19392a44-0434-4384-a03a-48611a473ee9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:47.997220 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.wsgi [None req-19392a44-0434-4384-a03a-48611a473ee9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] HTTP exception thrown: Instance 19567338-1f72-414d-b6d7-7ab9d4fe94bc could not be found. Sep 21 16:29:48.001831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-19392a44-0434-4384-a03a-48611a473ee9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Request method failure captured: Sep 21 16:29:48.001831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: request: GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc HTTP/1.1 Sep 21 16:29:48.001831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept: application/json Sep 21 16:29:48.001831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept-Encoding: identity Sep 21 16:29:48.001831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Connection: close Sep 21 16:29:48.001831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Length: 0 Sep 21 16:29:48.001831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Type: application/json Sep 21 16:29:48.001831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Host: 10.222.0.64 Sep 21 16:29:48.001831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Openstack-System-Scope: None Sep 21 16:29:48.001831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: User-Agent: python-urllib3/1.26.12 Sep 21 16:29:48.001831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Auth-Token: gAAAAABjKzswReFXUCd2I6gYmAtuJKe-A30QC38r39VuIRSGH95-VeJj-q9GnTRzSMMpi3tNsql0eq27wTbWXqMmSi1d60OfmexRFQJb0BK3uINxIMTGd_q9vbKD8_vryruFXNT9Kt1ZGfc9HDH-jN_m0KZ0qmIqF-JBWnzYSq7JN2QsTqjQ3cM Sep 21 16:29:48.001831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Id: None Sep 21 16:29:48.001831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Name: None Sep 21 16:29:48.001831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Identity-Status: Confirmed Sep 21 16:29:48.001831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Is-Admin-Project: True Sep 21 16:29:48.001831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Id: default Sep 21 16:29:48.001831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Name: Default Sep 21 16:29:48.001831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Id: d529e1f3de6944f881c7fc572b1dc78e Sep 21 16:29:48.001831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Name: tempest-TestVolumeBootPattern-1127138919 Sep 21 16:29:48.001831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Role: member,reader Sep 21 16:29:48.001831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Roles: member,reader Sep 21 16:29:48.004620 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/d529e1f3de6944f881c7fc572b1dc78e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d529e1f3de6944f881c7fc572b1dc78e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_d529e1f3de6944f881c7fc572b1dc78e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d529e1f3de6944f881c7fc572b1dc78e"}]}] Sep 21 16:29:48.004620 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant: tempest-TestVolumeBootPattern-1127138919 Sep 21 16:29:48.004620 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Id: d529e1f3de6944f881c7fc572b1dc78e Sep 21 16:29:48.004620 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Name: tempest-TestVolumeBootPattern-1127138919 Sep 21 16:29:48.004620 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User: tempest-TestVolumeBootPattern-1127138919-project Sep 21 16:29:48.004620 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Id: default Sep 21 16:29:48.004620 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Name: Default Sep 21 16:29:48.004620 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Id: f619261c21204ea3b5ba624177eb8747 Sep 21 16:29:48.004620 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Name: tempest-TestVolumeBootPattern-1127138919-project Sep 21 16:29:48.004620 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: method: > Sep 21 16:29:48.004620 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: exception: Instance 19567338-1f72-414d-b6d7-7ab9d4fe94bc could not be found. Sep 21 16:29:48.004620 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: action_args: {'id': '19567338-1f72-414d-b6d7-7ab9d4fe94bc'} Sep 21 16:29:48.006247 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:29:48.006247 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:29:48.006247 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 16:29:48.006247 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 16:29:48.006247 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 16:29:48.006247 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 16:29:48.006247 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 16:29:48.006247 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 16:29:48.006247 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 16:29:48.006247 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 16:29:48.006247 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19567338-1f72-414d-b6d7-7ab9d4fe94bc could not be found. Sep 21 16:29:48.006247 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:29:48.006247 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:29:48.006247 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:29:48.006247 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:29:48.006247 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:29:48.006247 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:29:48.006247 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:29:48.006247 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:29:48.006247 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:29:48.009126 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:29:48.009126 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 16:29:48.009126 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 16:29:48.009126 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 16:29:48.009126 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 16:29:48.009126 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 16:29:48.009126 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:29:48.009126 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19567338-1f72-414d-b6d7-7ab9d4fe94bc could not be found. Sep 21 16:29:48.009126 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:29:48.009126 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:29:48.009126 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:29:48.009126 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:29:48.009126 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:29:48.009126 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:29:48.009126 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:29:48.009126 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:29:48.009126 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19567338-1f72-414d-b6d7-7ab9d4fe94bc could not be found. Sep 21 16:29:48.009126 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:29:48.012613 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-19392a44-0434-4384-a03a-48611a473ee9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Returning 404 to user: Instance 19567338-1f72-414d-b6d7-7ab9d4fe94bc could not be found. {{(pid=120532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:29:48.012613 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-19392a44-0434-4384-a03a-48611a473ee9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc" status: 404 len: 111 microversion: 2.1 time: 0.085600 Sep 21 16:29:48.019377 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 483/872] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:47 2022] GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 16:29:48.185921 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-4b43ecb5-f6f6-40f1-a79f-bf70fbb84a41 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-104803809", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1166440784", "security_groups": [{"name": "tempest-secgroup-smoke-523103579"}], "block_device_mapping_v2": [{"uuid": "5d19ce10-af24-480a-9148-bc29a992f83e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0481ac20-ccdd-4b47-94c7-01261137c9c9"}]}} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:29:48.275290 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-09b2c9b2-bbde-40ec-a8b3-345257e25c20 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:48.288402 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-09b2c9b2-bbde-40ec-a8b3-345257e25c20 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:48.290394 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-09b2c9b2-bbde-40ec-a8b3-345257e25c20 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:48.291855 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-09b2c9b2-bbde-40ec-a8b3-345257e25c20 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1738 microversion: 2.20 time: 0.392841 Sep 21 16:29:48.292909 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 390/873] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:29:47 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1738 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:29:48.297809 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d3ffe6fd-e9ed-4b55-8853-18126af6daa2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:48.298678 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d3ffe6fd-e9ed-4b55-8853-18126af6daa2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:48.305841 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d3ffe6fd-e9ed-4b55-8853-18126af6daa2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:48.306644 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d3ffe6fd-e9ed-4b55-8853-18126af6daa2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:48.307277 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d3ffe6fd-e9ed-4b55-8853-18126af6daa2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:48.308151 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d3ffe6fd-e9ed-4b55-8853-18126af6daa2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:48.308927 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d3ffe6fd-e9ed-4b55-8853-18126af6daa2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:48.309552 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d3ffe6fd-e9ed-4b55-8853-18126af6daa2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:48.389639 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.network.neutron [None req-4b43ecb5-f6f6-40f1-a79f-bf70fbb84a41 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] validate_networks() for [('0481ac20-ccdd-4b47-94c7-01261137c9c9', None, None, None, None, None)] {{(pid=120532) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 16:29:48.686322 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d3ffe6fd-e9ed-4b55-8853-18126af6daa2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:48.699550 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d3ffe6fd-e9ed-4b55-8853-18126af6daa2 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079" status: 200 len: 1673 microversion: 2.1 time: 0.405288 Sep 21 16:29:48.755202 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 391/874] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:48 2022] GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079 => generated 1673 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:48.916790 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-4b43ecb5-f6f6-40f1-a79f-bf70fbb84a41 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Flavor limits 0:0:0 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 16:29:48.917361 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-4b43ecb5-f6f6-40f1-a79f-bf70fbb84a41 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Image limits 0:0:0 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 16:29:48.917846 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-4b43ecb5-f6f6-40f1-a79f-bf70fbb84a41 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Flavor pref 0:0:0 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 16:29:48.918281 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-4b43ecb5-f6f6-40f1-a79f-bf70fbb84a41 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Image pref 0:0:0 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 16:29:48.918876 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-4b43ecb5-f6f6-40f1-a79f-bf70fbb84a41 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 16:29:48.931888 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4b43ecb5-f6f6-40f1-a79f-bf70fbb84a41 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:48.932647 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4b43ecb5-f6f6-40f1-a79f-bf70fbb84a41 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:48.933259 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4b43ecb5-f6f6-40f1-a79f-bf70fbb84a41 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:48.934233 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4b43ecb5-f6f6-40f1-a79f-bf70fbb84a41 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:48.934847 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4b43ecb5-f6f6-40f1-a79f-bf70fbb84a41 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:48.935434 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4b43ecb5-f6f6-40f1-a79f-bf70fbb84a41 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:48.956171 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.quota [None req-4b43ecb5-f6f6-40f1-a79f-bf70fbb84a41 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Getting quotas for project d529e1f3de6944f881c7fc572b1dc78e. Resources: {'cores', 'ram', 'instances'} {{(pid=120532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 16:29:48.962318 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.quota [None req-4b43ecb5-f6f6-40f1-a79f-bf70fbb84a41 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Getting quotas for user f619261c21204ea3b5ba624177eb8747 and project d529e1f3de6944f881c7fc572b1dc78e. Resources: {'cores', 'ram', 'instances'} {{(pid=120532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 16:29:49.046539 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-4b43ecb5-f6f6-40f1-a79f-bf70fbb84a41 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Going to run 1 instances... {{(pid=120532) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 16:29:49.050995 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-4b43ecb5-f6f6-40f1-a79f-bf70fbb84a41 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5d19ce10-af24-480a-9148-bc29a992f83e',volume_size=None,volume_type=None)] {{(pid=120532) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 16:29:49.305223 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-4b43ecb5-f6f6-40f1-a79f-bf70fbb84a41 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.124889 Sep 21 16:29:49.310809 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 484/875] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Sep 21 16:29:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 1131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 21 16:29:49.317232 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-dac1e907-49f1-40b6-b3e6-7b5db5e620d3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:49.318497 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-dac1e907-49f1-40b6-b3e6-7b5db5e620d3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:49.328347 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-5d8b8bc0-8627-432f-80b8-a83ea9949c3c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:49.329198 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-5d8b8bc0-8627-432f-80b8-a83ea9949c3c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:49.348469 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5d8b8bc0-8627-432f-80b8-a83ea9949c3c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:49.351981 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5d8b8bc0-8627-432f-80b8-a83ea9949c3c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:49.355654 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5d8b8bc0-8627-432f-80b8-a83ea9949c3c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:49.362635 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5d8b8bc0-8627-432f-80b8-a83ea9949c3c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:49.363243 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5d8b8bc0-8627-432f-80b8-a83ea9949c3c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:49.363694 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5d8b8bc0-8627-432f-80b8-a83ea9949c3c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:49.512161 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-dac1e907-49f1-40b6-b3e6-7b5db5e620d3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:49.522679 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-dac1e907-49f1-40b6-b3e6-7b5db5e620d3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1094 microversion: 2.1 time: 0.209164 Sep 21 16:29:49.527201 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 392/876] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:49 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1094 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:49.594285 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-132efb0b-958e-4fb6-b964-00b5cb4367a2 req-3fc29742-d309-404c-bcee-b30f1a1b7758 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68300698-35cc-4b4c-8046-7d1ce02c0079", "name": "network-vif-deleted", "tag": "0fb5904a-0991-4b4f-b361-c14b24d2bc04"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:29:49.618626 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-132efb0b-958e-4fb6-b964-00b5cb4367a2 req-3fc29742-d309-404c-bcee-b30f1a1b7758 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:49.621271 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-132efb0b-958e-4fb6-b964-00b5cb4367a2 req-3fc29742-d309-404c-bcee-b30f1a1b7758 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:49.621809 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-132efb0b-958e-4fb6-b964-00b5cb4367a2 req-3fc29742-d309-404c-bcee-b30f1a1b7758 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:49.657178 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5d8b8bc0-8627-432f-80b8-a83ea9949c3c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:49.668466 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5d8b8bc0-8627-432f-80b8-a83ea9949c3c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:49.675648 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-132efb0b-958e-4fb6-b964-00b5cb4367a2 req-3fc29742-d309-404c-bcee-b30f1a1b7758 service nova] Creating event network-vif-deleted:0fb5904a-0991-4b4f-b361-c14b24d2bc04 for instance 68300698-35cc-4b4c-8046-7d1ce02c0079 on hv-cinder-85862 Sep 21 16:29:49.678616 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5d8b8bc0-8627-432f-80b8-a83ea9949c3c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:49.683449 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-5d8b8bc0-8627-432f-80b8-a83ea9949c3c tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1738 microversion: 2.20 time: 0.363348 Sep 21 16:29:49.684504 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 485/877] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:29:49 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1738 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:29:49.690274 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-132efb0b-958e-4fb6-b964-00b5cb4367a2 req-3fc29742-d309-404c-bcee-b30f1a1b7758 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098186 Sep 21 16:29:49.691243 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 393/878] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:29:49.732116 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-7530c7ea-1cb3-4df3-9574-a7521b2564c0 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:49.732836 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-7530c7ea-1cb3-4df3-9574-a7521b2564c0 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:49.743203 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7530c7ea-1cb3-4df3-9574-a7521b2564c0 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:49.744128 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7530c7ea-1cb3-4df3-9574-a7521b2564c0 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:49.744619 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7530c7ea-1cb3-4df3-9574-a7521b2564c0 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:49.745623 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7530c7ea-1cb3-4df3-9574-a7521b2564c0 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:49.746021 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7530c7ea-1cb3-4df3-9574-a7521b2564c0 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:49.747494 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7530c7ea-1cb3-4df3-9574-a7521b2564c0 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:49.801405 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7530c7ea-1cb3-4df3-9574-a7521b2564c0 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:49.802024 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7530c7ea-1cb3-4df3-9574-a7521b2564c0 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:49.802596 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7530c7ea-1cb3-4df3-9574-a7521b2564c0 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:49.803281 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.objects.instance [None req-7530c7ea-1cb3-4df3-9574-a7521b2564c0 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lazy-loading 'fault' on Instance uuid 68300698-35cc-4b4c-8046-7d1ce02c0079 {{(pid=120532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 16:29:49.885847 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-7530c7ea-1cb3-4df3-9574-a7521b2564c0 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:49.898219 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-7530c7ea-1cb3-4df3-9574-a7521b2564c0 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079" status: 200 len: 1327 microversion: 2.1 time: 0.170205 Sep 21 16:29:49.898801 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 486/879] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:49 2022] GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079 => generated 1327 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:50.547610 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-78dcea37-c97e-4f9d-a40c-3e87ba30a571 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:50.549102 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-78dcea37-c97e-4f9d-a40c-3e87ba30a571 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:50.556708 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-78dcea37-c97e-4f9d-a40c-3e87ba30a571 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:50.557353 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-78dcea37-c97e-4f9d-a40c-3e87ba30a571 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:50.558101 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-78dcea37-c97e-4f9d-a40c-3e87ba30a571 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:50.559117 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-78dcea37-c97e-4f9d-a40c-3e87ba30a571 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:50.559871 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-78dcea37-c97e-4f9d-a40c-3e87ba30a571 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:50.560521 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-78dcea37-c97e-4f9d-a40c-3e87ba30a571 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:50.638745 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-78dcea37-c97e-4f9d-a40c-3e87ba30a571 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:50.651887 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-78dcea37-c97e-4f9d-a40c-3e87ba30a571 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1144 microversion: 2.1 time: 0.107564 Sep 21 16:29:50.652719 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 394/880] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:50 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1144 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:50.715642 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-d1c99f35-8165-4a0a-98fd-2e9a80abac5e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:50.716573 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-d1c99f35-8165-4a0a-98fd-2e9a80abac5e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:50.724531 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d1c99f35-8165-4a0a-98fd-2e9a80abac5e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:50.725303 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d1c99f35-8165-4a0a-98fd-2e9a80abac5e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:50.725827 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d1c99f35-8165-4a0a-98fd-2e9a80abac5e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:50.726834 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d1c99f35-8165-4a0a-98fd-2e9a80abac5e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:50.727426 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d1c99f35-8165-4a0a-98fd-2e9a80abac5e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:50.727929 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d1c99f35-8165-4a0a-98fd-2e9a80abac5e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:50.910121 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d1c99f35-8165-4a0a-98fd-2e9a80abac5e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:50.926241 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d1c99f35-8165-4a0a-98fd-2e9a80abac5e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:50.926989 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-8c05f4b1-3e3f-4212-861c-056057cee491 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:50.927842 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-8c05f4b1-3e3f-4212-861c-056057cee491 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:50.934954 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8c05f4b1-3e3f-4212-861c-056057cee491 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:50.935766 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8c05f4b1-3e3f-4212-861c-056057cee491 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:50.936432 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8c05f4b1-3e3f-4212-861c-056057cee491 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:50.937321 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d1c99f35-8165-4a0a-98fd-2e9a80abac5e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:50.937627 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8c05f4b1-3e3f-4212-861c-056057cee491 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:50.938297 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8c05f4b1-3e3f-4212-861c-056057cee491 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:50.938920 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8c05f4b1-3e3f-4212-861c-056057cee491 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:50.939249 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-d1c99f35-8165-4a0a-98fd-2e9a80abac5e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1738 microversion: 2.20 time: 0.228264 Sep 21 16:29:50.954078 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 487/881] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:29:50 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1738 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 16:29:50.993787 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8c05f4b1-3e3f-4212-861c-056057cee491 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:50.994556 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8c05f4b1-3e3f-4212-861c-056057cee491 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:50.995259 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8c05f4b1-3e3f-4212-861c-056057cee491 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:50.995870 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.objects.instance [None req-8c05f4b1-3e3f-4212-861c-056057cee491 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lazy-loading 'fault' on Instance uuid 68300698-35cc-4b4c-8046-7d1ce02c0079 {{(pid=120531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 16:29:51.054985 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-8c05f4b1-3e3f-4212-861c-056057cee491 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:51.063718 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-8c05f4b1-3e3f-4212-861c-056057cee491 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079" status: 200 len: 1327 microversion: 2.1 time: 0.140436 Sep 21 16:29:51.064727 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 395/882] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:50 2022] GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079 => generated 1327 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:51.689889 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-411619da-a28d-45e3-93ef-1cb654be2624 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:51.691738 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-411619da-a28d-45e3-93ef-1cb654be2624 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:51.704580 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-411619da-a28d-45e3-93ef-1cb654be2624 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:51.705323 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-411619da-a28d-45e3-93ef-1cb654be2624 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:51.705986 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-411619da-a28d-45e3-93ef-1cb654be2624 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:51.707267 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-411619da-a28d-45e3-93ef-1cb654be2624 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:51.708158 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-411619da-a28d-45e3-93ef-1cb654be2624 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:51.708869 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-411619da-a28d-45e3-93ef-1cb654be2624 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:51.811262 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-411619da-a28d-45e3-93ef-1cb654be2624 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:51.820036 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-411619da-a28d-45e3-93ef-1cb654be2624 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1144 microversion: 2.1 time: 0.136955 Sep 21 16:29:51.820628 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 488/883] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:51 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1144 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:29:51.981282 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-83576311-5808-4afe-9a9e-48568c253a40 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:51.981852 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-83576311-5808-4afe-9a9e-48568c253a40 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:51.989480 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-83576311-5808-4afe-9a9e-48568c253a40 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:51.989953 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-83576311-5808-4afe-9a9e-48568c253a40 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:51.990413 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-83576311-5808-4afe-9a9e-48568c253a40 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:51.991358 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-83576311-5808-4afe-9a9e-48568c253a40 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:51.992021 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-83576311-5808-4afe-9a9e-48568c253a40 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:51.992621 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-83576311-5808-4afe-9a9e-48568c253a40 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:52.101436 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-263be78a-0a89-4185-a768-eedb568d53e8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:52.102358 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-263be78a-0a89-4185-a768-eedb568d53e8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:52.117777 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-263be78a-0a89-4185-a768-eedb568d53e8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:52.119075 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-263be78a-0a89-4185-a768-eedb568d53e8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:52.119847 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-263be78a-0a89-4185-a768-eedb568d53e8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:52.120914 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-263be78a-0a89-4185-a768-eedb568d53e8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:52.121690 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-263be78a-0a89-4185-a768-eedb568d53e8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:52.122681 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-263be78a-0a89-4185-a768-eedb568d53e8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:52.161743 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-263be78a-0a89-4185-a768-eedb568d53e8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:52.162495 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-263be78a-0a89-4185-a768-eedb568d53e8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:52.163257 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-263be78a-0a89-4185-a768-eedb568d53e8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:52.164092 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.objects.instance [None req-263be78a-0a89-4185-a768-eedb568d53e8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lazy-loading 'fault' on Instance uuid 68300698-35cc-4b4c-8046-7d1ce02c0079 {{(pid=120532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 16:29:52.170511 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-83576311-5808-4afe-9a9e-48568c253a40 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:52.183780 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-83576311-5808-4afe-9a9e-48568c253a40 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:52.185435 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-83576311-5808-4afe-9a9e-48568c253a40 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:52.187229 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-83576311-5808-4afe-9a9e-48568c253a40 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1738 microversion: 2.20 time: 0.219481 Sep 21 16:29:52.188956 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 396/884] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:29:51 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1738 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:29:52.230568 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-263be78a-0a89-4185-a768-eedb568d53e8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e5204475ce7477f9cfeeffed457a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c326adfa14149e5ae1d4eb45f4807b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:52.239877 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-263be78a-0a89-4185-a768-eedb568d53e8 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079" status: 200 len: 1327 microversion: 2.1 time: 0.142395 Sep 21 16:29:52.240374 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 489/885] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:52 2022] GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079 => generated 1327 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:29:52.865022 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-60c7af8a-0a23-4dd3-b5be-1481ad7d7e78 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:52.865644 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-60c7af8a-0a23-4dd3-b5be-1481ad7d7e78 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:52.872372 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-60c7af8a-0a23-4dd3-b5be-1481ad7d7e78 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:52.873145 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-60c7af8a-0a23-4dd3-b5be-1481ad7d7e78 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:52.873778 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-60c7af8a-0a23-4dd3-b5be-1481ad7d7e78 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:52.874752 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-60c7af8a-0a23-4dd3-b5be-1481ad7d7e78 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:52.875383 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-60c7af8a-0a23-4dd3-b5be-1481ad7d7e78 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:52.875808 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-60c7af8a-0a23-4dd3-b5be-1481ad7d7e78 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:52.949541 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-60c7af8a-0a23-4dd3-b5be-1481ad7d7e78 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:52.958589 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-60c7af8a-0a23-4dd3-b5be-1481ad7d7e78 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1144 microversion: 2.1 time: 0.097546 Sep 21 16:29:52.973625 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 397/886] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:52 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1144 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:29:53.215997 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-25d7e21f-79bd-45b9-9ac9-62656f7ca76b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:53.217395 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-25d7e21f-79bd-45b9-9ac9-62656f7ca76b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:53.228430 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-25d7e21f-79bd-45b9-9ac9-62656f7ca76b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:53.228858 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-25d7e21f-79bd-45b9-9ac9-62656f7ca76b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:53.229466 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-25d7e21f-79bd-45b9-9ac9-62656f7ca76b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:53.230252 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-25d7e21f-79bd-45b9-9ac9-62656f7ca76b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:53.230715 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-25d7e21f-79bd-45b9-9ac9-62656f7ca76b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:53.231143 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-25d7e21f-79bd-45b9-9ac9-62656f7ca76b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:53.278279 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-ea15f668-392f-400a-81c7-e012c052377b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:53.279179 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-ea15f668-392f-400a-81c7-e012c052377b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:53.286497 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ea15f668-392f-400a-81c7-e012c052377b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:53.286983 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ea15f668-392f-400a-81c7-e012c052377b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:53.287406 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ea15f668-392f-400a-81c7-e012c052377b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:53.288287 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ea15f668-392f-400a-81c7-e012c052377b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:53.288904 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ea15f668-392f-400a-81c7-e012c052377b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:53.289487 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ea15f668-392f-400a-81c7-e012c052377b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:53.307528 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.wsgi [None req-ea15f668-392f-400a-81c7-e012c052377b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] HTTP exception thrown: Instance 68300698-35cc-4b4c-8046-7d1ce02c0079 could not be found. Sep 21 16:29:53.309346 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-ea15f668-392f-400a-81c7-e012c052377b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Request method failure captured: Sep 21 16:29:53.309346 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: request: GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079 HTTP/1.1 Sep 21 16:29:53.309346 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept: application/json Sep 21 16:29:53.309346 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept-Encoding: identity Sep 21 16:29:53.309346 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Connection: close Sep 21 16:29:53.309346 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Length: 0 Sep 21 16:29:53.309346 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Type: application/json Sep 21 16:29:53.309346 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Host: 10.222.0.64 Sep 21 16:29:53.309346 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Openstack-System-Scope: None Sep 21 16:29:53.309346 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: User-Agent: python-urllib3/1.26.12 Sep 21 16:29:53.309346 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Auth-Token: gAAAAABjKzpyHhR1ZSfzV-Xd9gOhE0QRKKSIaACmdxmP_TjVPq1jNWq-ZxVfgTb8GscS291dsfNu5pr9fywV7YolB84nDNYMNkwEma38_6kcNu8JKc0A8o_imeJm1RCLDwg__IUVG-9uJoUdWtszbRS3bK1Sv_YTQwl-H7luSNRLBDZz4uR3Q94 Sep 21 16:29:53.309346 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Id: None Sep 21 16:29:53.309346 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Name: None Sep 21 16:29:53.309346 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Identity-Status: Confirmed Sep 21 16:29:53.309346 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Is-Admin-Project: True Sep 21 16:29:53.309346 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Id: default Sep 21 16:29:53.309346 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Name: Default Sep 21 16:29:53.309346 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Id: 9c326adfa14149e5ae1d4eb45f4807b8 Sep 21 16:29:53.309346 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Name: tempest-AttachVolumeTestJSON-1198726165 Sep 21 16:29:53.309346 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Role: member,reader Sep 21 16:29:53.309346 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Roles: member,reader Sep 21 16:29:53.311079 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9c326adfa14149e5ae1d4eb45f4807b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9c326adfa14149e5ae1d4eb45f4807b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9c326adfa14149e5ae1d4eb45f4807b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9c326adfa14149e5ae1d4eb45f4807b8"}]}] Sep 21 16:29:53.311079 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant: tempest-AttachVolumeTestJSON-1198726165 Sep 21 16:29:53.311079 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Id: 9c326adfa14149e5ae1d4eb45f4807b8 Sep 21 16:29:53.311079 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1198726165 Sep 21 16:29:53.311079 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User: tempest-AttachVolumeTestJSON-1198726165-project Sep 21 16:29:53.311079 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Id: default Sep 21 16:29:53.311079 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Name: Default Sep 21 16:29:53.311079 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Id: 2e5204475ce7477f9cfeeffed457a445 Sep 21 16:29:53.311079 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Name: tempest-AttachVolumeTestJSON-1198726165-project Sep 21 16:29:53.311079 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: method: > Sep 21 16:29:53.311079 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: exception: Instance 68300698-35cc-4b4c-8046-7d1ce02c0079 could not be found. Sep 21 16:29:53.311079 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: action_args: {'id': '68300698-35cc-4b4c-8046-7d1ce02c0079'} Sep 21 16:29:53.312146 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:29:53.312146 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:29:53.312146 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 16:29:53.312146 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 16:29:53.312146 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 16:29:53.312146 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 16:29:53.312146 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 16:29:53.312146 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 16:29:53.312146 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 16:29:53.312146 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 16:29:53.312146 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68300698-35cc-4b4c-8046-7d1ce02c0079 could not be found. Sep 21 16:29:53.312146 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:29:53.312146 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:29:53.312146 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:29:53.312146 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:29:53.312146 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:29:53.312146 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:29:53.312146 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:29:53.312146 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:29:53.312146 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:29:53.313439 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:29:53.313439 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 16:29:53.313439 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 16:29:53.313439 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 16:29:53.313439 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 16:29:53.313439 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 16:29:53.313439 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:29:53.313439 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68300698-35cc-4b4c-8046-7d1ce02c0079 could not be found. Sep 21 16:29:53.313439 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:29:53.313439 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:29:53.313439 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:29:53.313439 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:29:53.313439 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:29:53.313439 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:29:53.313439 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:29:53.313439 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:29:53.313439 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68300698-35cc-4b4c-8046-7d1ce02c0079 could not be found. Sep 21 16:29:53.313439 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:29:53.314696 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-ea15f668-392f-400a-81c7-e012c052377b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Returning 404 to user: Instance 68300698-35cc-4b4c-8046-7d1ce02c0079 could not be found. {{(pid=120531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:29:53.314696 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-ea15f668-392f-400a-81c7-e012c052377b tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079" status: 404 len: 111 microversion: 2.1 time: 0.038733 Sep 21 16:29:53.314696 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 398/887] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:53 2022] GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 21 16:29:53.323969 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-49a0aa52-704d-42ac-a02c-973afcc34e00 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '.version_select at 0x7fdb88a8fa60>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:53.353313 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-49a0aa52-704d-42ac-a02c-973afcc34e00 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1619193929" status: 202 len: 0 microversion: 2.1 time: 0.036241 Sep 21 16:29:53.362274 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 399/888] 10.222.0.64 () {58 vars in 1221 bytes} [Wed Sep 21 16:29:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1619193929 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 21 16:29:53.403775 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-25d7e21f-79bd-45b9-9ac9-62656f7ca76b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:53.413726 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-25d7e21f-79bd-45b9-9ac9-62656f7ca76b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:53.415414 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-25d7e21f-79bd-45b9-9ac9-62656f7ca76b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:53.416800 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-25d7e21f-79bd-45b9-9ac9-62656f7ca76b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1738 microversion: 2.20 time: 0.206311 Sep 21 16:29:53.417662 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 490/889] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:29:53 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1738 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:29:53.980623 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-8ecf8623-b4c1-487c-801f-74e2b0258ae7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:53.981546 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-8ecf8623-b4c1-487c-801f-74e2b0258ae7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:53.994488 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8ecf8623-b4c1-487c-801f-74e2b0258ae7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:53.995025 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8ecf8623-b4c1-487c-801f-74e2b0258ae7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:53.995298 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8ecf8623-b4c1-487c-801f-74e2b0258ae7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:53.996195 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8ecf8623-b4c1-487c-801f-74e2b0258ae7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:53.996798 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8ecf8623-b4c1-487c-801f-74e2b0258ae7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:53.997453 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8ecf8623-b4c1-487c-801f-74e2b0258ae7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:54.073324 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-8ecf8623-b4c1-487c-801f-74e2b0258ae7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:54.082284 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-8ecf8623-b4c1-487c-801f-74e2b0258ae7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1192 microversion: 2.1 time: 0.105495 Sep 21 16:29:54.083075 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 400/890] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:53 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1192 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:54.449001 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-3c65cf97-38c1-46ed-a11c-ad47b4bb92e4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:54.451167 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-3c65cf97-38c1-46ed-a11c-ad47b4bb92e4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:54.462207 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3c65cf97-38c1-46ed-a11c-ad47b4bb92e4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:54.463054 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3c65cf97-38c1-46ed-a11c-ad47b4bb92e4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:54.463791 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3c65cf97-38c1-46ed-a11c-ad47b4bb92e4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:54.464983 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3c65cf97-38c1-46ed-a11c-ad47b4bb92e4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:54.465752 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3c65cf97-38c1-46ed-a11c-ad47b4bb92e4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:54.466499 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3c65cf97-38c1-46ed-a11c-ad47b4bb92e4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:54.615256 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-3c65cf97-38c1-46ed-a11c-ad47b4bb92e4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:54.623968 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-3c65cf97-38c1-46ed-a11c-ad47b4bb92e4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:54.626095 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-3c65cf97-38c1-46ed-a11c-ad47b4bb92e4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:54.627361 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-3c65cf97-38c1-46ed-a11c-ad47b4bb92e4 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1720 microversion: 2.20 time: 0.186000 Sep 21 16:29:54.644409 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 491/891] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:29:54 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1720 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:29:55.105702 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-ca0e3b73-5295-4091-977b-34993c672915 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:55.106384 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-ca0e3b73-5295-4091-977b-34993c672915 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:55.112976 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ca0e3b73-5295-4091-977b-34993c672915 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:55.113465 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ca0e3b73-5295-4091-977b-34993c672915 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:55.113895 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ca0e3b73-5295-4091-977b-34993c672915 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:55.114621 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ca0e3b73-5295-4091-977b-34993c672915 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:55.115094 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ca0e3b73-5295-4091-977b-34993c672915 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:55.115516 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ca0e3b73-5295-4091-977b-34993c672915 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:55.195025 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-ca0e3b73-5295-4091-977b-34993c672915 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:55.203824 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-ca0e3b73-5295-4091-977b-34993c672915 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1198 microversion: 2.1 time: 0.102075 Sep 21 16:29:55.219250 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 401/892] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:55 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1198 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:55.653291 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-5743e40b-5fb8-4588-8c2c-d83131bc4bb2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:55.653926 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-5743e40b-5fb8-4588-8c2c-d83131bc4bb2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:55.659984 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5743e40b-5fb8-4588-8c2c-d83131bc4bb2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:55.660469 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5743e40b-5fb8-4588-8c2c-d83131bc4bb2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:55.660902 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5743e40b-5fb8-4588-8c2c-d83131bc4bb2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:55.661596 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5743e40b-5fb8-4588-8c2c-d83131bc4bb2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:55.662078 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5743e40b-5fb8-4588-8c2c-d83131bc4bb2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:55.662496 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5743e40b-5fb8-4588-8c2c-d83131bc4bb2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:55.790779 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5743e40b-5fb8-4588-8c2c-d83131bc4bb2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:55.799445 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5743e40b-5fb8-4588-8c2c-d83131bc4bb2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:55.800892 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5743e40b-5fb8-4588-8c2c-d83131bc4bb2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:55.802072 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-5743e40b-5fb8-4588-8c2c-d83131bc4bb2 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1720 microversion: 2.20 time: 0.153010 Sep 21 16:29:55.802647 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 492/893] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:29:55 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:29:56.227804 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-a644ba36-d917-4371-81fa-3fae82fbb92f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:56.228414 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-a644ba36-d917-4371-81fa-3fae82fbb92f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:56.235995 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a644ba36-d917-4371-81fa-3fae82fbb92f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:56.236483 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a644ba36-d917-4371-81fa-3fae82fbb92f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:56.236921 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a644ba36-d917-4371-81fa-3fae82fbb92f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:56.237625 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a644ba36-d917-4371-81fa-3fae82fbb92f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:56.238104 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a644ba36-d917-4371-81fa-3fae82fbb92f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:56.238520 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a644ba36-d917-4371-81fa-3fae82fbb92f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:56.330426 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-6b700ebd-50e6-4528-a7a3-b5f3e122cb55 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:56.331071 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-6b700ebd-50e6-4528-a7a3-b5f3e122cb55 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:56.337688 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6b700ebd-50e6-4528-a7a3-b5f3e122cb55 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:56.338144 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6b700ebd-50e6-4528-a7a3-b5f3e122cb55 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:56.338585 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6b700ebd-50e6-4528-a7a3-b5f3e122cb55 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:56.339300 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6b700ebd-50e6-4528-a7a3-b5f3e122cb55 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:56.339763 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6b700ebd-50e6-4528-a7a3-b5f3e122cb55 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:56.340187 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6b700ebd-50e6-4528-a7a3-b5f3e122cb55 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:56.355049 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.wsgi [None req-6b700ebd-50e6-4528-a7a3-b5f3e122cb55 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] HTTP exception thrown: Instance 68300698-35cc-4b4c-8046-7d1ce02c0079 could not be found. Sep 21 16:29:56.356664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-6b700ebd-50e6-4528-a7a3-b5f3e122cb55 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Request method failure captured: Sep 21 16:29:56.356664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: request: DELETE /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079 HTTP/1.1 Sep 21 16:29:56.356664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept: application/json Sep 21 16:29:56.356664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept-Encoding: identity Sep 21 16:29:56.356664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Connection: close Sep 21 16:29:56.356664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Length: 0 Sep 21 16:29:56.356664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Type: application/json Sep 21 16:29:56.356664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Host: 10.222.0.64 Sep 21 16:29:56.356664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Openstack-System-Scope: None Sep 21 16:29:56.356664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: User-Agent: python-urllib3/1.26.12 Sep 21 16:29:56.356664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Auth-Token: gAAAAABjKzpyHhR1ZSfzV-Xd9gOhE0QRKKSIaACmdxmP_TjVPq1jNWq-ZxVfgTb8GscS291dsfNu5pr9fywV7YolB84nDNYMNkwEma38_6kcNu8JKc0A8o_imeJm1RCLDwg__IUVG-9uJoUdWtszbRS3bK1Sv_YTQwl-H7luSNRLBDZz4uR3Q94 Sep 21 16:29:56.356664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Id: None Sep 21 16:29:56.356664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Name: None Sep 21 16:29:56.356664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Identity-Status: Confirmed Sep 21 16:29:56.356664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Is-Admin-Project: True Sep 21 16:29:56.356664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Id: default Sep 21 16:29:56.356664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Name: Default Sep 21 16:29:56.356664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Id: 9c326adfa14149e5ae1d4eb45f4807b8 Sep 21 16:29:56.356664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Name: tempest-AttachVolumeTestJSON-1198726165 Sep 21 16:29:56.356664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Role: member,reader Sep 21 16:29:56.356664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Roles: member,reader Sep 21 16:29:56.358757 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9c326adfa14149e5ae1d4eb45f4807b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9c326adfa14149e5ae1d4eb45f4807b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9c326adfa14149e5ae1d4eb45f4807b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9c326adfa14149e5ae1d4eb45f4807b8"}]}] Sep 21 16:29:56.358757 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant: tempest-AttachVolumeTestJSON-1198726165 Sep 21 16:29:56.358757 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Id: 9c326adfa14149e5ae1d4eb45f4807b8 Sep 21 16:29:56.358757 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1198726165 Sep 21 16:29:56.358757 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User: tempest-AttachVolumeTestJSON-1198726165-project Sep 21 16:29:56.358757 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Id: default Sep 21 16:29:56.358757 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Name: Default Sep 21 16:29:56.358757 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Id: 2e5204475ce7477f9cfeeffed457a445 Sep 21 16:29:56.358757 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Name: tempest-AttachVolumeTestJSON-1198726165-project Sep 21 16:29:56.358757 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: method: > Sep 21 16:29:56.358757 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: exception: Instance 68300698-35cc-4b4c-8046-7d1ce02c0079 could not be found. Sep 21 16:29:56.358757 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: action_args: {'id': '68300698-35cc-4b4c-8046-7d1ce02c0079'} Sep 21 16:29:56.360346 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:29:56.360346 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:29:56.360346 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 16:29:56.360346 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 16:29:56.360346 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 16:29:56.360346 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 16:29:56.360346 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 16:29:56.360346 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 16:29:56.360346 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 16:29:56.360346 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 16:29:56.360346 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68300698-35cc-4b4c-8046-7d1ce02c0079 could not be found. Sep 21 16:29:56.360346 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:29:56.360346 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:29:56.360346 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:29:56.360346 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:29:56.360346 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:29:56.360346 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:29:56.360346 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:29:56.360346 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:29:56.360346 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:29:56.361560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:29:56.361560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 21 16:29:56.361560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 21 16:29:56.361560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 21 16:29:56.361560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 21 16:29:56.361560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 16:29:56.361560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 16:29:56.361560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 16:29:56.361560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:29:56.361560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68300698-35cc-4b4c-8046-7d1ce02c0079 could not be found. Sep 21 16:29:56.361560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:29:56.361560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:29:56.361560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:29:56.361560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:29:56.361560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:29:56.361560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:29:56.361560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:29:56.361560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:29:56.361560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68300698-35cc-4b4c-8046-7d1ce02c0079 could not be found. Sep 21 16:29:56.361560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:29:56.363318 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-6b700ebd-50e6-4528-a7a3-b5f3e122cb55 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Returning 404 to user: Instance 68300698-35cc-4b4c-8046-7d1ce02c0079 could not be found. {{(pid=120532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:29:56.363318 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-6b700ebd-50e6-4528-a7a3-b5f3e122cb55 tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "DELETE /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079" status: 404 len: 111 microversion: 2.1 time: 0.031682 Sep 21 16:29:56.363318 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 493/894] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Sep 21 16:29:56 2022] DELETE /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 21 16:29:56.367688 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-2a1b8c7c-cefd-4aa3-ade9-ed682f03ee4f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:56.368319 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-2a1b8c7c-cefd-4aa3-ade9-ed682f03ee4f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 68300698-35cc-4b4c-8046-7d1ce02c0079] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:56.374591 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2a1b8c7c-cefd-4aa3-ade9-ed682f03ee4f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:56.375085 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2a1b8c7c-cefd-4aa3-ade9-ed682f03ee4f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:56.375525 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2a1b8c7c-cefd-4aa3-ade9-ed682f03ee4f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:56.376235 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2a1b8c7c-cefd-4aa3-ade9-ed682f03ee4f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:56.376692 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2a1b8c7c-cefd-4aa3-ade9-ed682f03ee4f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:56.377124 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2a1b8c7c-cefd-4aa3-ade9-ed682f03ee4f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:56.385115 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-a644ba36-d917-4371-81fa-3fae82fbb92f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:56.391333 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.wsgi [None req-2a1b8c7c-cefd-4aa3-ade9-ed682f03ee4f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] HTTP exception thrown: Instance 68300698-35cc-4b4c-8046-7d1ce02c0079 could not be found. Sep 21 16:29:56.393189 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-2a1b8c7c-cefd-4aa3-ade9-ed682f03ee4f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Request method failure captured: Sep 21 16:29:56.393189 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: request: GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079 HTTP/1.1 Sep 21 16:29:56.393189 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept: application/json Sep 21 16:29:56.393189 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept-Encoding: identity Sep 21 16:29:56.393189 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Connection: close Sep 21 16:29:56.393189 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Length: 0 Sep 21 16:29:56.393189 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Type: application/json Sep 21 16:29:56.393189 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Host: 10.222.0.64 Sep 21 16:29:56.393189 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Openstack-System-Scope: None Sep 21 16:29:56.393189 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: User-Agent: python-urllib3/1.26.12 Sep 21 16:29:56.393189 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Auth-Token: gAAAAABjKzpyHhR1ZSfzV-Xd9gOhE0QRKKSIaACmdxmP_TjVPq1jNWq-ZxVfgTb8GscS291dsfNu5pr9fywV7YolB84nDNYMNkwEma38_6kcNu8JKc0A8o_imeJm1RCLDwg__IUVG-9uJoUdWtszbRS3bK1Sv_YTQwl-H7luSNRLBDZz4uR3Q94 Sep 21 16:29:56.393189 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Id: None Sep 21 16:29:56.393189 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Name: None Sep 21 16:29:56.393189 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Identity-Status: Confirmed Sep 21 16:29:56.393189 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Is-Admin-Project: True Sep 21 16:29:56.393189 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Id: default Sep 21 16:29:56.393189 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Name: Default Sep 21 16:29:56.393189 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Id: 9c326adfa14149e5ae1d4eb45f4807b8 Sep 21 16:29:56.393189 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Name: tempest-AttachVolumeTestJSON-1198726165 Sep 21 16:29:56.393189 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Role: member,reader Sep 21 16:29:56.393189 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Roles: member,reader Sep 21 16:29:56.394781 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9c326adfa14149e5ae1d4eb45f4807b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9c326adfa14149e5ae1d4eb45f4807b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9c326adfa14149e5ae1d4eb45f4807b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9c326adfa14149e5ae1d4eb45f4807b8"}]}] Sep 21 16:29:56.394781 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant: tempest-AttachVolumeTestJSON-1198726165 Sep 21 16:29:56.394781 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Id: 9c326adfa14149e5ae1d4eb45f4807b8 Sep 21 16:29:56.394781 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1198726165 Sep 21 16:29:56.394781 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User: tempest-AttachVolumeTestJSON-1198726165-project Sep 21 16:29:56.394781 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Id: default Sep 21 16:29:56.394781 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Name: Default Sep 21 16:29:56.394781 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Id: 2e5204475ce7477f9cfeeffed457a445 Sep 21 16:29:56.394781 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Name: tempest-AttachVolumeTestJSON-1198726165-project Sep 21 16:29:56.394781 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: method: > Sep 21 16:29:56.394781 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: exception: Instance 68300698-35cc-4b4c-8046-7d1ce02c0079 could not be found. Sep 21 16:29:56.394781 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: action_args: {'id': '68300698-35cc-4b4c-8046-7d1ce02c0079'} Sep 21 16:29:56.395560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:29:56.395560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:29:56.395560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 16:29:56.395560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 16:29:56.395560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 16:29:56.395560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 16:29:56.395560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 16:29:56.395560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 16:29:56.395560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 16:29:56.395560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 16:29:56.395560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68300698-35cc-4b4c-8046-7d1ce02c0079 could not be found. Sep 21 16:29:56.395560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:29:56.395560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:29:56.395560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:29:56.395560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:29:56.395560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:29:56.395560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:29:56.395560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:29:56.395560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:29:56.395560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:29:56.396952 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:29:56.396952 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 16:29:56.396952 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 16:29:56.396952 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 16:29:56.396952 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 16:29:56.396952 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 16:29:56.396952 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:29:56.396952 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68300698-35cc-4b4c-8046-7d1ce02c0079 could not be found. Sep 21 16:29:56.396952 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:29:56.396952 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:29:56.396952 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:29:56.396952 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:29:56.396952 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:29:56.396952 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:29:56.396952 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:29:56.396952 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:29:56.396952 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68300698-35cc-4b4c-8046-7d1ce02c0079 could not be found. Sep 21 16:29:56.396952 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:29:56.398395 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-2a1b8c7c-cefd-4aa3-ade9-ed682f03ee4f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Returning 404 to user: Instance 68300698-35cc-4b4c-8046-7d1ce02c0079 could not be found. {{(pid=120532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:29:56.398486 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-a644ba36-d917-4371-81fa-3fae82fbb92f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1265 microversion: 2.1 time: 0.170056 Sep 21 16:29:56.398623 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-2a1b8c7c-cefd-4aa3-ade9-ed682f03ee4f tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079" status: 404 len: 111 microversion: 2.1 time: 0.030852 Sep 21 16:29:56.398623 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 494/895] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:56 2022] GET /compute/v2.1/servers/68300698-35cc-4b4c-8046-7d1ce02c0079 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 16:29:56.398791 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 402/896] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:56 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:56.828360 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-fde79463-599a-45dc-9db7-1b69ecabefec tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:56.829019 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-fde79463-599a-45dc-9db7-1b69ecabefec tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:56.835455 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fde79463-599a-45dc-9db7-1b69ecabefec tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:56.835932 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fde79463-599a-45dc-9db7-1b69ecabefec tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:56.836367 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fde79463-599a-45dc-9db7-1b69ecabefec tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:56.837056 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fde79463-599a-45dc-9db7-1b69ecabefec tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:56.837512 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fde79463-599a-45dc-9db7-1b69ecabefec tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:56.837935 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fde79463-599a-45dc-9db7-1b69ecabefec tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:56.967993 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-fde79463-599a-45dc-9db7-1b69ecabefec tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:56.975996 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-fde79463-599a-45dc-9db7-1b69ecabefec tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:56.977449 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-fde79463-599a-45dc-9db7-1b69ecabefec tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:56.978639 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-fde79463-599a-45dc-9db7-1b69ecabefec tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1720 microversion: 2.20 time: 0.154944 Sep 21 16:29:56.979195 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 495/897] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:29:56 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:29:57.421996 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-1080354c-43b7-4efd-b88a-68e69bce2652 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:57.422696 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-1080354c-43b7-4efd-b88a-68e69bce2652 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:57.429137 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1080354c-43b7-4efd-b88a-68e69bce2652 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:57.429612 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1080354c-43b7-4efd-b88a-68e69bce2652 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:57.430040 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1080354c-43b7-4efd-b88a-68e69bce2652 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:57.430735 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1080354c-43b7-4efd-b88a-68e69bce2652 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:57.431182 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1080354c-43b7-4efd-b88a-68e69bce2652 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:57.431594 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1080354c-43b7-4efd-b88a-68e69bce2652 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:57.573558 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-1080354c-43b7-4efd-b88a-68e69bce2652 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:57.582020 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-1080354c-43b7-4efd-b88a-68e69bce2652 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1265 microversion: 2.1 time: 0.164438 Sep 21 16:29:57.582611 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 403/898] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:57 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:58.004651 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-17014f2f-980a-41f1-b0e8-7880c355bf49 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:58.005311 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-17014f2f-980a-41f1-b0e8-7880c355bf49 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:58.011817 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-17014f2f-980a-41f1-b0e8-7880c355bf49 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:58.012299 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-17014f2f-980a-41f1-b0e8-7880c355bf49 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:58.012731 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-17014f2f-980a-41f1-b0e8-7880c355bf49 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:58.013419 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-17014f2f-980a-41f1-b0e8-7880c355bf49 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:58.013867 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-17014f2f-980a-41f1-b0e8-7880c355bf49 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:58.014397 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-17014f2f-980a-41f1-b0e8-7880c355bf49 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:58.169408 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-17014f2f-980a-41f1-b0e8-7880c355bf49 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:58.177958 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-17014f2f-980a-41f1-b0e8-7880c355bf49 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:58.179464 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-17014f2f-980a-41f1-b0e8-7880c355bf49 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:58.180637 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-17014f2f-980a-41f1-b0e8-7880c355bf49 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1720 microversion: 2.20 time: 0.180070 Sep 21 16:29:58.181203 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 496/899] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:29:57 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1720 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:29:58.605942 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-1d5997e5-3ec9-44d0-8419-55f13b2e8070 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:58.606595 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-1d5997e5-3ec9-44d0-8419-55f13b2e8070 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:58.625376 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1d5997e5-3ec9-44d0-8419-55f13b2e8070 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:58.626325 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1d5997e5-3ec9-44d0-8419-55f13b2e8070 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:58.627238 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1d5997e5-3ec9-44d0-8419-55f13b2e8070 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:58.629815 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1d5997e5-3ec9-44d0-8419-55f13b2e8070 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:58.631215 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1d5997e5-3ec9-44d0-8419-55f13b2e8070 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:58.632807 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1d5997e5-3ec9-44d0-8419-55f13b2e8070 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:58.948375 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-1d5997e5-3ec9-44d0-8419-55f13b2e8070 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:58.959553 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-1d5997e5-3ec9-44d0-8419-55f13b2e8070 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1265 microversion: 2.1 time: 0.358188 Sep 21 16:29:58.960315 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 404/900] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:58 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1265 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:29:59.206190 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-943f1086-7fa0-4407-baa9-f8bbe5fe8103 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:59.207396 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-943f1086-7fa0-4407-baa9-f8bbe5fe8103 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:59.209302 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell0:SELECT=2 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:29:59.210891 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell0:SELECT=6 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:29:59.227804 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-943f1086-7fa0-4407-baa9-f8bbe5fe8103 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:59.228464 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-943f1086-7fa0-4407-baa9-f8bbe5fe8103 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:59.228923 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-943f1086-7fa0-4407-baa9-f8bbe5fe8103 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:59.229768 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-943f1086-7fa0-4407-baa9-f8bbe5fe8103 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:59.236254 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-d18bad1b-15d6-4dea-9c52-4340bdf8bb03 req-fbb9ccd0-53b9-4147-b233-bd746aee3c29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce59fd53-2d4c-477e-8326-672737e561f5", "name": "network-vif-unplugged", "status": "completed", "tag": "5abd346c-df9c-4cb2-b976-8f9adc822383"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:29:59.242917 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-943f1086-7fa0-4407-baa9-f8bbe5fe8103 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:59.243380 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-943f1086-7fa0-4407-baa9-f8bbe5fe8103 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:59.256993 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-d18bad1b-15d6-4dea-9c52-4340bdf8bb03 req-fbb9ccd0-53b9-4147-b233-bd746aee3c29 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:59.262001 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-d18bad1b-15d6-4dea-9c52-4340bdf8bb03 req-fbb9ccd0-53b9-4147-b233-bd746aee3c29 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:59.262782 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-d18bad1b-15d6-4dea-9c52-4340bdf8bb03 req-fbb9ccd0-53b9-4147-b233-bd746aee3c29 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:59.282777 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.compute.server_external_events [req-d18bad1b-15d6-4dea-9c52-4340bdf8bb03 req-fbb9ccd0-53b9-4147-b233-bd746aee3c29 service nova] Unable to find a host for instance ce59fd53-2d4c-477e-8326-672737e561f5. Dropping event network-vif-unplugged {{(pid=120531) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 21 16:29:59.284053 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-d18bad1b-15d6-4dea-9c52-4340bdf8bb03 req-fbb9ccd0-53b9-4147-b233-bd746aee3c29 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.052055 Sep 21 16:29:59.285268 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 405/901] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 54 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 21 16:29:59.424515 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-c2689ee2-a30c-4502-85ae-13e804851df3 req-b5d5a1a1-ea12-4f40-9111-77147f4bb1ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15ec6390-e13e-4e88-8bdc-62507b36a9a6", "tag": "ce1a423d-237c-4ca8-8c26-29b613b76535"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:29:59.435544 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-c2689ee2-a30c-4502-85ae-13e804851df3 req-b5d5a1a1-ea12-4f40-9111-77147f4bb1ab service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:59.435796 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-943f1086-7fa0-4407-baa9-f8bbe5fe8103 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:59.436647 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-c2689ee2-a30c-4502-85ae-13e804851df3 req-b5d5a1a1-ea12-4f40-9111-77147f4bb1ab service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:59.437525 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-c2689ee2-a30c-4502-85ae-13e804851df3 req-b5d5a1a1-ea12-4f40-9111-77147f4bb1ab service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:59.447276 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-943f1086-7fa0-4407-baa9-f8bbe5fe8103 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:59.448845 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-943f1086-7fa0-4407-baa9-f8bbe5fe8103 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:29:59.450126 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-943f1086-7fa0-4407-baa9-f8bbe5fe8103 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1663 microversion: 2.20 time: 0.248881 Sep 21 16:29:59.450542 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-c2689ee2-a30c-4502-85ae-13e804851df3 req-b5d5a1a1-ea12-4f40-9111-77147f4bb1ab service nova] Creating event network-changed:ce1a423d-237c-4ca8-8c26-29b613b76535 for instance 15ec6390-e13e-4e88-8bdc-62507b36a9a6 on hv-cinder-85862 Sep 21 16:29:59.457430 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 497/902] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:29:59 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1663 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:29:59.460300 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-c2689ee2-a30c-4502-85ae-13e804851df3 req-b5d5a1a1-ea12-4f40-9111-77147f4bb1ab service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039739 Sep 21 16:29:59.461195 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 406/903] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:29:59.482243 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c18989d5-08b4-4675-87bc-e70233e1d54e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "357b089e-f199-4127-934f-82a063f5c18f"}} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:29:59.490198 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-c18989d5-08b4-4675-87bc-e70233e1d54e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:59.498328 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c18989d5-08b4-4675-87bc-e70233e1d54e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:59.499126 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c18989d5-08b4-4675-87bc-e70233e1d54e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:59.499583 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c18989d5-08b4-4675-87bc-e70233e1d54e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:59.500289 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c18989d5-08b4-4675-87bc-e70233e1d54e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:59.500739 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c18989d5-08b4-4675-87bc-e70233e1d54e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:59.501160 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c18989d5-08b4-4675-87bc-e70233e1d54e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:59.663577 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell0:SELECT=2 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:29:59.668750 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-f068e4c4-4716-4d88-b3e0-399aeead8eef tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:59.669344 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-f068e4c4-4716-4d88-b3e0-399aeead8eef tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:59.676038 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f068e4c4-4716-4d88-b3e0-399aeead8eef tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:59.676511 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f068e4c4-4716-4d88-b3e0-399aeead8eef tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:59.677130 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f068e4c4-4716-4d88-b3e0-399aeead8eef tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:59.678170 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f068e4c4-4716-4d88-b3e0-399aeead8eef tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:59.678631 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f068e4c4-4716-4d88-b3e0-399aeead8eef tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:59.679224 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f068e4c4-4716-4d88-b3e0-399aeead8eef tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:59.684544 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=100 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:29:59.695565 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.wsgi [None req-f068e4c4-4716-4d88-b3e0-399aeead8eef tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] HTTP exception thrown: Instance 1c1436cc-a3f6-4683-abf2-e8835aa53021 could not be found. Sep 21 16:29:59.697254 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-f068e4c4-4716-4d88-b3e0-399aeead8eef tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Request method failure captured: Sep 21 16:29:59.697254 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: request: DELETE /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 HTTP/1.1 Sep 21 16:29:59.697254 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept: application/json Sep 21 16:29:59.697254 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept-Encoding: identity Sep 21 16:29:59.697254 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Connection: close Sep 21 16:29:59.697254 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Length: 0 Sep 21 16:29:59.697254 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Type: application/json Sep 21 16:29:59.697254 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Host: 10.222.0.64 Sep 21 16:29:59.697254 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Openstack-System-Scope: None Sep 21 16:29:59.697254 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: User-Agent: python-urllib3/1.26.12 Sep 21 16:29:59.697254 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Auth-Token: gAAAAABjKzpyHhR1ZSfzV-Xd9gOhE0QRKKSIaACmdxmP_TjVPq1jNWq-ZxVfgTb8GscS291dsfNu5pr9fywV7YolB84nDNYMNkwEma38_6kcNu8JKc0A8o_imeJm1RCLDwg__IUVG-9uJoUdWtszbRS3bK1Sv_YTQwl-H7luSNRLBDZz4uR3Q94 Sep 21 16:29:59.697254 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Id: None Sep 21 16:29:59.697254 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Name: None Sep 21 16:29:59.697254 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Identity-Status: Confirmed Sep 21 16:29:59.697254 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Is-Admin-Project: True Sep 21 16:29:59.697254 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Id: default Sep 21 16:29:59.697254 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Name: Default Sep 21 16:29:59.697254 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Id: 9c326adfa14149e5ae1d4eb45f4807b8 Sep 21 16:29:59.697254 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Name: tempest-AttachVolumeTestJSON-1198726165 Sep 21 16:29:59.697254 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Role: member,reader Sep 21 16:29:59.697254 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Roles: member,reader Sep 21 16:29:59.700341 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9c326adfa14149e5ae1d4eb45f4807b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9c326adfa14149e5ae1d4eb45f4807b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9c326adfa14149e5ae1d4eb45f4807b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9c326adfa14149e5ae1d4eb45f4807b8"}]}] Sep 21 16:29:59.700341 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant: tempest-AttachVolumeTestJSON-1198726165 Sep 21 16:29:59.700341 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Id: 9c326adfa14149e5ae1d4eb45f4807b8 Sep 21 16:29:59.700341 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1198726165 Sep 21 16:29:59.700341 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User: tempest-AttachVolumeTestJSON-1198726165-project Sep 21 16:29:59.700341 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Id: default Sep 21 16:29:59.700341 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Name: Default Sep 21 16:29:59.700341 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Id: 2e5204475ce7477f9cfeeffed457a445 Sep 21 16:29:59.700341 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Name: tempest-AttachVolumeTestJSON-1198726165-project Sep 21 16:29:59.700341 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: method: > Sep 21 16:29:59.700341 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: exception: Instance 1c1436cc-a3f6-4683-abf2-e8835aa53021 could not be found. Sep 21 16:29:59.700341 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: action_args: {'id': '1c1436cc-a3f6-4683-abf2-e8835aa53021'} Sep 21 16:29:59.701485 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:29:59.701485 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:29:59.701485 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 16:29:59.701485 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 16:29:59.701485 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 16:29:59.701485 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 16:29:59.701485 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 16:29:59.701485 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 16:29:59.701485 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 16:29:59.701485 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 16:29:59.701485 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c1436cc-a3f6-4683-abf2-e8835aa53021 could not be found. Sep 21 16:29:59.701485 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:29:59.701485 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:29:59.701485 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:29:59.701485 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:29:59.701485 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:29:59.701485 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:29:59.701485 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:29:59.701485 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:29:59.701485 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:29:59.704933 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:29:59.704933 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 21 16:29:59.704933 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 21 16:29:59.704933 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 21 16:29:59.704933 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 21 16:29:59.704933 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 16:29:59.704933 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 16:29:59.704933 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 16:29:59.704933 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:29:59.704933 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c1436cc-a3f6-4683-abf2-e8835aa53021 could not be found. Sep 21 16:29:59.704933 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:29:59.704933 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:29:59.704933 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:29:59.704933 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:29:59.704933 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:29:59.704933 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:29:59.704933 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:29:59.704933 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:29:59.704933 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c1436cc-a3f6-4683-abf2-e8835aa53021 could not be found. Sep 21 16:29:59.704933 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:29:59.708244 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-f068e4c4-4716-4d88-b3e0-399aeead8eef tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Returning 404 to user: Instance 1c1436cc-a3f6-4683-abf2-e8835aa53021 could not be found. {{(pid=120531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:29:59.708244 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-f068e4c4-4716-4d88-b3e0-399aeead8eef tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "DELETE /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 404 len: 111 microversion: 2.1 time: 0.036377 Sep 21 16:29:59.708244 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 407/904] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Sep 21 16:29:59 2022] DELETE /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 16:29:59.709966 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-5a65ea5b-c273-4207-8635-6874623a69dd tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:59.710756 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-5a65ea5b-c273-4207-8635-6874623a69dd tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] [instance: 1c1436cc-a3f6-4683-abf2-e8835aa53021] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:29:59.719165 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5a65ea5b-c273-4207-8635-6874623a69dd tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:59.719875 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5a65ea5b-c273-4207-8635-6874623a69dd tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:59.720103 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5a65ea5b-c273-4207-8635-6874623a69dd tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:59.720903 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5a65ea5b-c273-4207-8635-6874623a69dd tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:29:59.721448 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5a65ea5b-c273-4207-8635-6874623a69dd tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:29:59.721935 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5a65ea5b-c273-4207-8635-6874623a69dd tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:29:59.737536 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.wsgi [None req-5a65ea5b-c273-4207-8635-6874623a69dd tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] HTTP exception thrown: Instance 1c1436cc-a3f6-4683-abf2-e8835aa53021 could not be found. Sep 21 16:29:59.739343 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-5a65ea5b-c273-4207-8635-6874623a69dd tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Request method failure captured: Sep 21 16:29:59.739343 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: request: GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 HTTP/1.1 Sep 21 16:29:59.739343 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept: application/json Sep 21 16:29:59.739343 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept-Encoding: identity Sep 21 16:29:59.739343 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Connection: close Sep 21 16:29:59.739343 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Length: 0 Sep 21 16:29:59.739343 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Type: application/json Sep 21 16:29:59.739343 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Host: 10.222.0.64 Sep 21 16:29:59.739343 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Openstack-System-Scope: None Sep 21 16:29:59.739343 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: User-Agent: python-urllib3/1.26.12 Sep 21 16:29:59.739343 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Auth-Token: gAAAAABjKzpyHhR1ZSfzV-Xd9gOhE0QRKKSIaACmdxmP_TjVPq1jNWq-ZxVfgTb8GscS291dsfNu5pr9fywV7YolB84nDNYMNkwEma38_6kcNu8JKc0A8o_imeJm1RCLDwg__IUVG-9uJoUdWtszbRS3bK1Sv_YTQwl-H7luSNRLBDZz4uR3Q94 Sep 21 16:29:59.739343 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Id: None Sep 21 16:29:59.739343 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Name: None Sep 21 16:29:59.739343 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Identity-Status: Confirmed Sep 21 16:29:59.739343 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Is-Admin-Project: True Sep 21 16:29:59.739343 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Id: default Sep 21 16:29:59.739343 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Name: Default Sep 21 16:29:59.739343 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Id: 9c326adfa14149e5ae1d4eb45f4807b8 Sep 21 16:29:59.739343 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Name: tempest-AttachVolumeTestJSON-1198726165 Sep 21 16:29:59.739343 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Role: member,reader Sep 21 16:29:59.739343 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Roles: member,reader Sep 21 16:29:59.740952 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9c326adfa14149e5ae1d4eb45f4807b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9c326adfa14149e5ae1d4eb45f4807b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9c326adfa14149e5ae1d4eb45f4807b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9c326adfa14149e5ae1d4eb45f4807b8"}]}] Sep 21 16:29:59.740952 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant: tempest-AttachVolumeTestJSON-1198726165 Sep 21 16:29:59.740952 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Id: 9c326adfa14149e5ae1d4eb45f4807b8 Sep 21 16:29:59.740952 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1198726165 Sep 21 16:29:59.740952 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User: tempest-AttachVolumeTestJSON-1198726165-project Sep 21 16:29:59.740952 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Id: default Sep 21 16:29:59.740952 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Name: Default Sep 21 16:29:59.740952 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Id: 2e5204475ce7477f9cfeeffed457a445 Sep 21 16:29:59.740952 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Name: tempest-AttachVolumeTestJSON-1198726165-project Sep 21 16:29:59.740952 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: method: > Sep 21 16:29:59.740952 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: exception: Instance 1c1436cc-a3f6-4683-abf2-e8835aa53021 could not be found. Sep 21 16:29:59.740952 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: action_args: {'id': '1c1436cc-a3f6-4683-abf2-e8835aa53021'} Sep 21 16:29:59.741800 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:29:59.741800 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:29:59.741800 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 16:29:59.741800 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 16:29:59.741800 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 16:29:59.741800 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 16:29:59.741800 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 16:29:59.741800 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 16:29:59.741800 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 16:29:59.741800 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 16:29:59.741800 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c1436cc-a3f6-4683-abf2-e8835aa53021 could not be found. Sep 21 16:29:59.741800 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:29:59.741800 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:29:59.741800 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:29:59.741800 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:29:59.741800 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:29:59.741800 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:29:59.741800 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:29:59.741800 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:29:59.741800 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:29:59.743717 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:29:59.743717 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 16:29:59.743717 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 16:29:59.743717 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 16:29:59.743717 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 16:29:59.743717 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 16:29:59.743717 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:29:59.743717 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c1436cc-a3f6-4683-abf2-e8835aa53021 could not be found. Sep 21 16:29:59.743717 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:29:59.743717 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:29:59.743717 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:29:59.743717 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:29:59.743717 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:29:59.743717 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:29:59.743717 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:29:59.743717 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:29:59.743717 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c1436cc-a3f6-4683-abf2-e8835aa53021 could not be found. Sep 21 16:29:59.743717 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:29:59.745734 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:29:59.746801 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-5a65ea5b-c273-4207-8635-6874623a69dd tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] Returning 404 to user: Instance 1c1436cc-a3f6-4683-abf2-e8835aa53021 could not be found. {{(pid=120531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:29:59.747903 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-5a65ea5b-c273-4207-8635-6874623a69dd tempest-AttachVolumeTestJSON-1198726165 tempest-AttachVolumeTestJSON-1198726165-project] 10.222.0.64 "GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021" status: 404 len: 111 microversion: 2.1 time: 0.043612 Sep 21 16:29:59.748793 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 408/905] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:59 2022] GET /compute/v2.1/servers/1c1436cc-a3f6-4683-abf2-e8835aa53021 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 16:29:59.921869 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-c18989d5-08b4-4675-87bc-e70233e1d54e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "POST /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.447121 Sep 21 16:29:59.923209 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 498/906] 10.222.0.64 () {62 vars in 1364 bytes} [Wed Sep 21 16:29:59 2022] POST /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5/os-volume_attachments => generated 188 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 21 16:29:59.992942 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-5aeda039-8492-450f-ac01-ad5bc3e93141 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:29:59.995142 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-5aeda039-8492-450f-ac01-ad5bc3e93141 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:00.006508 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5aeda039-8492-450f-ac01-ad5bc3e93141 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:00.007767 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5aeda039-8492-450f-ac01-ad5bc3e93141 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:00.009874 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5aeda039-8492-450f-ac01-ad5bc3e93141 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:00.011622 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5aeda039-8492-450f-ac01-ad5bc3e93141 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:00.014329 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5aeda039-8492-450f-ac01-ad5bc3e93141 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:00.015559 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5aeda039-8492-450f-ac01-ad5bc3e93141 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:00.111781 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-b781a681-800a-43ea-b201-47e7ee21cb45 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:00.112590 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-b781a681-800a-43ea-b201-47e7ee21cb45 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:00.121715 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b781a681-800a-43ea-b201-47e7ee21cb45 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:00.122238 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b781a681-800a-43ea-b201-47e7ee21cb45 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:00.122672 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b781a681-800a-43ea-b201-47e7ee21cb45 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:00.124433 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b781a681-800a-43ea-b201-47e7ee21cb45 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:00.124433 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b781a681-800a-43ea-b201-47e7ee21cb45 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:00.124433 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b781a681-800a-43ea-b201-47e7ee21cb45 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:00.258234 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-5aeda039-8492-450f-ac01-ad5bc3e93141 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:00.272151 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-5aeda039-8492-450f-ac01-ad5bc3e93141 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1265 microversion: 2.1 time: 0.289714 Sep 21 16:30:00.282234 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 409/907] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:29:59 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1265 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:30:00.465825 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-b781a681-800a-43ea-b201-47e7ee21cb45 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "DELETE /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5/os-volume_attachments/357b089e-f199-4127-934f-82a063f5c18f" status: 202 len: 0 microversion: 2.20 time: 0.358696 Sep 21 16:30:00.470760 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 499/908] 10.222.0.64 () {60 vars in 1457 bytes} [Wed Sep 21 16:30:00 2022] DELETE /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5/os-volume_attachments/357b089e-f199-4127-934f-82a063f5c18f => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 21 16:30:00.565169 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-18487c4e-eebc-49c3-a55d-7d087771ae71 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:30:00.566068 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-18487c4e-eebc-49c3-a55d-7d087771ae71 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:00.574077 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-18487c4e-eebc-49c3-a55d-7d087771ae71 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:00.575644 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-18487c4e-eebc-49c3-a55d-7d087771ae71 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:00.576121 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-18487c4e-eebc-49c3-a55d-7d087771ae71 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:00.576847 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-18487c4e-eebc-49c3-a55d-7d087771ae71 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:00.578192 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-18487c4e-eebc-49c3-a55d-7d087771ae71 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:00.578588 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-18487c4e-eebc-49c3-a55d-7d087771ae71 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:00.650139 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-18487c4e-eebc-49c3-a55d-7d087771ae71 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120531) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 21 16:30:00.737910 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-18487c4e-eebc-49c3-a55d-7d087771ae71 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "POST /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5/action" status: 202 len: 0 microversion: 2.20 time: 0.178982 Sep 21 16:30:00.740609 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 410/909] 10.222.0.64 () {62 vars in 1319 bytes} [Wed Sep 21 16:30:00 2022] POST /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 21 16:30:00.748581 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-83cba142-c23a-4a4a-b0ca-9e5e792f6d1a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:00.750030 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-83cba142-c23a-4a4a-b0ca-9e5e792f6d1a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:00.759429 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-83cba142-c23a-4a4a-b0ca-9e5e792f6d1a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:00.760310 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-83cba142-c23a-4a4a-b0ca-9e5e792f6d1a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:00.760988 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-83cba142-c23a-4a4a-b0ca-9e5e792f6d1a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:00.761924 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-83cba142-c23a-4a4a-b0ca-9e5e792f6d1a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:00.762642 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-83cba142-c23a-4a4a-b0ca-9e5e792f6d1a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:00.763322 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-83cba142-c23a-4a4a-b0ca-9e5e792f6d1a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:01.009328 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-83cba142-c23a-4a4a-b0ca-9e5e792f6d1a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:01.019476 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-83cba142-c23a-4a4a-b0ca-9e5e792f6d1a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:01.021421 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-83cba142-c23a-4a4a-b0ca-9e5e792f6d1a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:01.022612 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-83cba142-c23a-4a4a-b0ca-9e5e792f6d1a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1671 microversion: 2.20 time: 0.278425 Sep 21 16:30:01.023251 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 500/910] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:30:00 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1671 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:30:01.298158 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-6dfaf93a-dc02-42dc-abd9-c66bfddb3236 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:01.298932 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-6dfaf93a-dc02-42dc-abd9-c66bfddb3236 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:01.306569 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6dfaf93a-dc02-42dc-abd9-c66bfddb3236 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:01.307036 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6dfaf93a-dc02-42dc-abd9-c66bfddb3236 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:01.307474 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6dfaf93a-dc02-42dc-abd9-c66bfddb3236 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:01.308836 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6dfaf93a-dc02-42dc-abd9-c66bfddb3236 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:01.309563 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6dfaf93a-dc02-42dc-abd9-c66bfddb3236 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:01.310341 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6dfaf93a-dc02-42dc-abd9-c66bfddb3236 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:01.518538 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-6dfaf93a-dc02-42dc-abd9-c66bfddb3236 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:01.534818 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-6dfaf93a-dc02-42dc-abd9-c66bfddb3236 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1265 microversion: 2.1 time: 0.240870 Sep 21 16:30:01.535339 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 411/911] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:30:01 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:30:02.052185 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-7c2b4366-e83b-4f97-b310-f56b841dfd3e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:02.053126 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-7c2b4366-e83b-4f97-b310-f56b841dfd3e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:02.060884 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7c2b4366-e83b-4f97-b310-f56b841dfd3e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:02.061777 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7c2b4366-e83b-4f97-b310-f56b841dfd3e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:02.063139 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7c2b4366-e83b-4f97-b310-f56b841dfd3e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:02.064229 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7c2b4366-e83b-4f97-b310-f56b841dfd3e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:02.064913 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7c2b4366-e83b-4f97-b310-f56b841dfd3e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:02.065342 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7c2b4366-e83b-4f97-b310-f56b841dfd3e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:02.249543 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-7c2b4366-e83b-4f97-b310-f56b841dfd3e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:02.259099 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-7c2b4366-e83b-4f97-b310-f56b841dfd3e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:02.260925 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-7c2b4366-e83b-4f97-b310-f56b841dfd3e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:02.262164 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-7c2b4366-e83b-4f97-b310-f56b841dfd3e tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1673 microversion: 2.20 time: 0.216316 Sep 21 16:30:02.263257 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 501/912] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:30:02 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1673 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:30:02.569779 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-99e2769a-97f8-4133-ae3d-c9520a6e3bfb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:02.570426 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-99e2769a-97f8-4133-ae3d-c9520a6e3bfb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:02.578176 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-99e2769a-97f8-4133-ae3d-c9520a6e3bfb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:02.578673 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-99e2769a-97f8-4133-ae3d-c9520a6e3bfb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:02.579107 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-99e2769a-97f8-4133-ae3d-c9520a6e3bfb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:02.579814 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-99e2769a-97f8-4133-ae3d-c9520a6e3bfb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:02.580271 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-99e2769a-97f8-4133-ae3d-c9520a6e3bfb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:02.580689 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-99e2769a-97f8-4133-ae3d-c9520a6e3bfb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:02.916954 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-99e2769a-97f8-4133-ae3d-c9520a6e3bfb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:02.928232 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-99e2769a-97f8-4133-ae3d-c9520a6e3bfb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1265 microversion: 2.1 time: 0.362171 Sep 21 16:30:02.930582 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 412/913] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:30:02 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1265 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:30:03.290095 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-9fab18ec-06aa-46f0-a123-b3750d87f296 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:03.290783 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-9fab18ec-06aa-46f0-a123-b3750d87f296 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:03.298031 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9fab18ec-06aa-46f0-a123-b3750d87f296 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:03.298565 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9fab18ec-06aa-46f0-a123-b3750d87f296 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:03.299241 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9fab18ec-06aa-46f0-a123-b3750d87f296 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:03.299985 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9fab18ec-06aa-46f0-a123-b3750d87f296 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:03.300453 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9fab18ec-06aa-46f0-a123-b3750d87f296 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:03.300879 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9fab18ec-06aa-46f0-a123-b3750d87f296 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:03.582649 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-9fab18ec-06aa-46f0-a123-b3750d87f296 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:03.598655 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-9fab18ec-06aa-46f0-a123-b3750d87f296 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:03.603628 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-9fab18ec-06aa-46f0-a123-b3750d87f296 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:03.605516 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-9fab18ec-06aa-46f0-a123-b3750d87f296 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1729 microversion: 2.20 time: 0.320272 Sep 21 16:30:03.631020 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 502/914] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:30:03 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1729 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:30:03.954726 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-021a53cd-f6ed-49b8-a118-50f6d815d98e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:03.955340 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-021a53cd-f6ed-49b8-a118-50f6d815d98e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:03.997836 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-021a53cd-f6ed-49b8-a118-50f6d815d98e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:04.000999 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-021a53cd-f6ed-49b8-a118-50f6d815d98e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:04.001493 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-021a53cd-f6ed-49b8-a118-50f6d815d98e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:04.002356 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-021a53cd-f6ed-49b8-a118-50f6d815d98e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:04.003481 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-021a53cd-f6ed-49b8-a118-50f6d815d98e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:04.003481 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-021a53cd-f6ed-49b8-a118-50f6d815d98e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:04.264243 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-021a53cd-f6ed-49b8-a118-50f6d815d98e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:04.279368 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-021a53cd-f6ed-49b8-a118-50f6d815d98e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1265 microversion: 2.1 time: 0.330696 Sep 21 16:30:04.281399 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 413/915] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:30:03 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1265 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:30:04.647521 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-5b2f1921-9267-453a-be1c-c4036f5c4b07 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:04.648864 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-5b2f1921-9267-453a-be1c-c4036f5c4b07 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:04.662783 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5b2f1921-9267-453a-be1c-c4036f5c4b07 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:04.663700 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5b2f1921-9267-453a-be1c-c4036f5c4b07 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:04.665064 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5b2f1921-9267-453a-be1c-c4036f5c4b07 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:04.666800 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5b2f1921-9267-453a-be1c-c4036f5c4b07 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:04.667819 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5b2f1921-9267-453a-be1c-c4036f5c4b07 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:04.668958 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5b2f1921-9267-453a-be1c-c4036f5c4b07 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:05.265768 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5b2f1921-9267-453a-be1c-c4036f5c4b07 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:05.282457 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5b2f1921-9267-453a-be1c-c4036f5c4b07 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:05.284540 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5b2f1921-9267-453a-be1c-c4036f5c4b07 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:05.290846 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-5b2f1921-9267-453a-be1c-c4036f5c4b07 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1729 microversion: 2.20 time: 0.653918 Sep 21 16:30:05.291820 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 503/916] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:30:04 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1729 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:30:05.304085 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d6d3cb63-dd68-472c-a7b8-5872b03105e0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:05.305451 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d6d3cb63-dd68-472c-a7b8-5872b03105e0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:05.320936 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d6d3cb63-dd68-472c-a7b8-5872b03105e0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:05.321804 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d6d3cb63-dd68-472c-a7b8-5872b03105e0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:05.322517 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d6d3cb63-dd68-472c-a7b8-5872b03105e0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:05.323630 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d6d3cb63-dd68-472c-a7b8-5872b03105e0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:05.324346 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d6d3cb63-dd68-472c-a7b8-5872b03105e0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:05.330802 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d6d3cb63-dd68-472c-a7b8-5872b03105e0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:05.629560 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d6d3cb63-dd68-472c-a7b8-5872b03105e0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:05.648977 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d6d3cb63-dd68-472c-a7b8-5872b03105e0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1265 microversion: 2.1 time: 0.349025 Sep 21 16:30:05.652126 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 414/917] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:30:05 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1265 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:30:06.323777 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-41b6e424-dfd1-467d-87a2-442643eaf9ac tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:06.324431 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-41b6e424-dfd1-467d-87a2-442643eaf9ac tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:06.336315 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-41b6e424-dfd1-467d-87a2-442643eaf9ac tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:06.338272 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-41b6e424-dfd1-467d-87a2-442643eaf9ac tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:06.338996 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-41b6e424-dfd1-467d-87a2-442643eaf9ac tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:06.340853 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-41b6e424-dfd1-467d-87a2-442643eaf9ac tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:06.343789 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-41b6e424-dfd1-467d-87a2-442643eaf9ac tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:06.345648 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-41b6e424-dfd1-467d-87a2-442643eaf9ac tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:06.622016 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-41b6e424-dfd1-467d-87a2-442643eaf9ac tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:06.633960 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-41b6e424-dfd1-467d-87a2-442643eaf9ac tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:06.647068 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-41b6e424-dfd1-467d-87a2-442643eaf9ac tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:06.648669 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-41b6e424-dfd1-467d-87a2-442643eaf9ac tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1729 microversion: 2.20 time: 0.329334 Sep 21 16:30:06.651563 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 504/918] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:30:06 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1729 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:30:06.678458 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-e872715e-e03e-441f-81a0-9f17851e8f40 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:06.679765 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-e872715e-e03e-441f-81a0-9f17851e8f40 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:06.689284 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e872715e-e03e-441f-81a0-9f17851e8f40 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:06.689879 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e872715e-e03e-441f-81a0-9f17851e8f40 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:06.690716 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e872715e-e03e-441f-81a0-9f17851e8f40 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:06.691808 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e872715e-e03e-441f-81a0-9f17851e8f40 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:06.692220 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e872715e-e03e-441f-81a0-9f17851e8f40 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:06.692747 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e872715e-e03e-441f-81a0-9f17851e8f40 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:06.961748 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-e872715e-e03e-441f-81a0-9f17851e8f40 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:06.974566 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-e872715e-e03e-441f-81a0-9f17851e8f40 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1265 microversion: 2.1 time: 0.299628 Sep 21 16:30:06.976996 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 415/919] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:30:06 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1265 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:30:07.679891 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-79e0facf-a879-4ee6-89a1-e1f9cb8e6b96 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:07.681030 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-79e0facf-a879-4ee6-89a1-e1f9cb8e6b96 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:07.688511 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-79e0facf-a879-4ee6-89a1-e1f9cb8e6b96 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:07.689074 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-79e0facf-a879-4ee6-89a1-e1f9cb8e6b96 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:07.689570 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-79e0facf-a879-4ee6-89a1-e1f9cb8e6b96 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:07.690545 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-79e0facf-a879-4ee6-89a1-e1f9cb8e6b96 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:07.690926 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-79e0facf-a879-4ee6-89a1-e1f9cb8e6b96 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:07.691361 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-79e0facf-a879-4ee6-89a1-e1f9cb8e6b96 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:07.917752 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-79e0facf-a879-4ee6-89a1-e1f9cb8e6b96 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:07.928735 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-79e0facf-a879-4ee6-89a1-e1f9cb8e6b96 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:07.931705 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-79e0facf-a879-4ee6-89a1-e1f9cb8e6b96 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:07.933070 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-79e0facf-a879-4ee6-89a1-e1f9cb8e6b96 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1729 microversion: 2.20 time: 0.258386 Sep 21 16:30:07.933987 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 505/920] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:30:07 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1729 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:30:08.002425 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-27337a8e-962e-433f-b765-bd4cc2f7fe84 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:08.003040 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-27337a8e-962e-433f-b765-bd4cc2f7fe84 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:08.021175 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-27337a8e-962e-433f-b765-bd4cc2f7fe84 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:08.023600 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-27337a8e-962e-433f-b765-bd4cc2f7fe84 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:08.024227 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-27337a8e-962e-433f-b765-bd4cc2f7fe84 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:08.025129 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-27337a8e-962e-433f-b765-bd4cc2f7fe84 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:08.025751 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-27337a8e-962e-433f-b765-bd4cc2f7fe84 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:08.026366 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-27337a8e-962e-433f-b765-bd4cc2f7fe84 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:08.244184 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-27337a8e-962e-433f-b765-bd4cc2f7fe84 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:08.253707 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-27337a8e-962e-433f-b765-bd4cc2f7fe84 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1265 microversion: 2.1 time: 0.255506 Sep 21 16:30:08.257440 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 416/921] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:30:07 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1265 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:30:08.958935 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ef561d7d-3579-407c-aef4-740284e98e59 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:08.959838 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ef561d7d-3579-407c-aef4-740284e98e59 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:08.968100 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ef561d7d-3579-407c-aef4-740284e98e59 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:08.968949 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ef561d7d-3579-407c-aef4-740284e98e59 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:08.969600 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ef561d7d-3579-407c-aef4-740284e98e59 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:08.970555 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ef561d7d-3579-407c-aef4-740284e98e59 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:08.971220 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ef561d7d-3579-407c-aef4-740284e98e59 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:08.971854 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ef561d7d-3579-407c-aef4-740284e98e59 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:09.144311 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ef561d7d-3579-407c-aef4-740284e98e59 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:09.160273 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ef561d7d-3579-407c-aef4-740284e98e59 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:09.164489 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ef561d7d-3579-407c-aef4-740284e98e59 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:09.166672 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ef561d7d-3579-407c-aef4-740284e98e59 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1729 microversion: 2.20 time: 0.211676 Sep 21 16:30:09.167367 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 506/922] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:30:08 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1729 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:30:09.283568 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-09d309d3-482b-4820-a785-5387f239b343 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:09.284153 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-09d309d3-482b-4820-a785-5387f239b343 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:09.291270 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-09d309d3-482b-4820-a785-5387f239b343 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:09.291756 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-09d309d3-482b-4820-a785-5387f239b343 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:09.292314 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-09d309d3-482b-4820-a785-5387f239b343 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:09.293149 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-09d309d3-482b-4820-a785-5387f239b343 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:09.293615 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-09d309d3-482b-4820-a785-5387f239b343 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:09.294031 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-09d309d3-482b-4820-a785-5387f239b343 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:09.493930 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-09d309d3-482b-4820-a785-5387f239b343 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:09.505313 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-09d309d3-482b-4820-a785-5387f239b343 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1265 microversion: 2.1 time: 0.225531 Sep 21 16:30:09.520036 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 417/923] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:30:09 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1265 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:30:10.196185 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-47d5b238-0513-4ad9-b572-ac14715ecc1b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:10.196835 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-47d5b238-0513-4ad9-b572-ac14715ecc1b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:10.211293 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-47d5b238-0513-4ad9-b572-ac14715ecc1b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:10.221684 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-47d5b238-0513-4ad9-b572-ac14715ecc1b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:10.222506 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-47d5b238-0513-4ad9-b572-ac14715ecc1b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:10.223424 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-47d5b238-0513-4ad9-b572-ac14715ecc1b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:10.225141 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-47d5b238-0513-4ad9-b572-ac14715ecc1b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:10.226787 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-47d5b238-0513-4ad9-b572-ac14715ecc1b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:10.529038 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-5c767b91-4b9b-49fd-bbeb-6324da638f36 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:10.530424 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-5c767b91-4b9b-49fd-bbeb-6324da638f36 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:10.540379 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5c767b91-4b9b-49fd-bbeb-6324da638f36 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:10.540878 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5c767b91-4b9b-49fd-bbeb-6324da638f36 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:10.541315 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5c767b91-4b9b-49fd-bbeb-6324da638f36 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:10.541999 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-47d5b238-0513-4ad9-b572-ac14715ecc1b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:10.542338 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5c767b91-4b9b-49fd-bbeb-6324da638f36 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:10.542801 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5c767b91-4b9b-49fd-bbeb-6324da638f36 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:10.543226 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5c767b91-4b9b-49fd-bbeb-6324da638f36 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:10.554484 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-47d5b238-0513-4ad9-b572-ac14715ecc1b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:10.556902 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-47d5b238-0513-4ad9-b572-ac14715ecc1b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:10.562065 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-47d5b238-0513-4ad9-b572-ac14715ecc1b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1729 microversion: 2.20 time: 0.369612 Sep 21 16:30:10.563528 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 507/924] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:30:10 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1729 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:30:10.811284 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-5c767b91-4b9b-49fd-bbeb-6324da638f36 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:10.833362 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-5c767b91-4b9b-49fd-bbeb-6324da638f36 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1265 microversion: 2.1 time: 0.308766 Sep 21 16:30:10.838664 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 418/925] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:30:10 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1265 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:30:11.598147 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c9b81415-4a10-4a05-ab94-87e23b956310 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:11.598777 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-c9b81415-4a10-4a05-ab94-87e23b956310 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:11.605426 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c9b81415-4a10-4a05-ab94-87e23b956310 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:11.606325 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c9b81415-4a10-4a05-ab94-87e23b956310 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:11.607175 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c9b81415-4a10-4a05-ab94-87e23b956310 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:11.607955 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c9b81415-4a10-4a05-ab94-87e23b956310 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:11.608854 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c9b81415-4a10-4a05-ab94-87e23b956310 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:11.608987 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c9b81415-4a10-4a05-ab94-87e23b956310 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:11.832310 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-c9b81415-4a10-4a05-ab94-87e23b956310 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:11.841538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-c9b81415-4a10-4a05-ab94-87e23b956310 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:11.843304 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-c9b81415-4a10-4a05-ab94-87e23b956310 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:11.844667 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-c9b81415-4a10-4a05-ab94-87e23b956310 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1729 microversion: 2.20 time: 0.256728 Sep 21 16:30:11.845420 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 508/926] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:30:11 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1729 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:30:11.862756 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-50578e8e-70b9-4da5-a4e3-10cc2160d663 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:11.864256 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-50578e8e-70b9-4da5-a4e3-10cc2160d663 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:11.887631 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-50578e8e-70b9-4da5-a4e3-10cc2160d663 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:11.892955 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-50578e8e-70b9-4da5-a4e3-10cc2160d663 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:11.893762 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-50578e8e-70b9-4da5-a4e3-10cc2160d663 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:11.896923 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-50578e8e-70b9-4da5-a4e3-10cc2160d663 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:11.898796 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-50578e8e-70b9-4da5-a4e3-10cc2160d663 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:11.900227 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-50578e8e-70b9-4da5-a4e3-10cc2160d663 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:12.164999 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-50578e8e-70b9-4da5-a4e3-10cc2160d663 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:12.173643 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-50578e8e-70b9-4da5-a4e3-10cc2160d663 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1265 microversion: 2.1 time: 0.316638 Sep 21 16:30:12.174262 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 419/927] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:30:11 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1265 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:30:12.892644 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-2f5a76c7-146c-4121-8bad-5e3251a1b563 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:12.893682 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-2f5a76c7-146c-4121-8bad-5e3251a1b563 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:12.909855 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2f5a76c7-146c-4121-8bad-5e3251a1b563 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:12.911120 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2f5a76c7-146c-4121-8bad-5e3251a1b563 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:12.912067 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2f5a76c7-146c-4121-8bad-5e3251a1b563 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:12.914285 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2f5a76c7-146c-4121-8bad-5e3251a1b563 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:12.915560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2f5a76c7-146c-4121-8bad-5e3251a1b563 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:12.916666 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2f5a76c7-146c-4121-8bad-5e3251a1b563 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:13.152692 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-2f5a76c7-146c-4121-8bad-5e3251a1b563 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:13.166195 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-2f5a76c7-146c-4121-8bad-5e3251a1b563 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:13.170822 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-2f5a76c7-146c-4121-8bad-5e3251a1b563 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:13.172128 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-2f5a76c7-146c-4121-8bad-5e3251a1b563 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1729 microversion: 2.20 time: 0.296274 Sep 21 16:30:13.172784 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 509/928] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:30:12 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1729 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:30:13.281387 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-177877e9-1d58-4850-a2b8-3e1e7e786d9b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:13.282915 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-177877e9-1d58-4850-a2b8-3e1e7e786d9b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:13.294784 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-177877e9-1d58-4850-a2b8-3e1e7e786d9b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:13.297327 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-177877e9-1d58-4850-a2b8-3e1e7e786d9b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:13.298684 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-177877e9-1d58-4850-a2b8-3e1e7e786d9b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:13.300462 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-177877e9-1d58-4850-a2b8-3e1e7e786d9b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:13.301535 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-177877e9-1d58-4850-a2b8-3e1e7e786d9b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:13.302225 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-177877e9-1d58-4850-a2b8-3e1e7e786d9b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:13.504271 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-177877e9-1d58-4850-a2b8-3e1e7e786d9b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:13.522899 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-177877e9-1d58-4850-a2b8-3e1e7e786d9b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1265 microversion: 2.1 time: 0.252964 Sep 21 16:30:13.528687 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 420/929] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:30:13 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:30:14.204876 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-0c521c8e-9df2-4af0-a828-37352b5fecb0 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:14.205594 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-0c521c8e-9df2-4af0-a828-37352b5fecb0 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:14.208193 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:30:14.214369 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0c521c8e-9df2-4af0-a828-37352b5fecb0 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:14.214870 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0c521c8e-9df2-4af0-a828-37352b5fecb0 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:14.215304 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0c521c8e-9df2-4af0-a828-37352b5fecb0 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:14.216014 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0c521c8e-9df2-4af0-a828-37352b5fecb0 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:14.216470 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0c521c8e-9df2-4af0-a828-37352b5fecb0 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:14.216923 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0c521c8e-9df2-4af0-a828-37352b5fecb0 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:14.396320 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-0c521c8e-9df2-4af0-a828-37352b5fecb0 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:14.412235 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-0c521c8e-9df2-4af0-a828-37352b5fecb0 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:14.413873 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-0c521c8e-9df2-4af0-a828-37352b5fecb0 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:14.416054 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-0c521c8e-9df2-4af0-a828-37352b5fecb0 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1729 microversion: 2.20 time: 0.215771 Sep 21 16:30:14.416808 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 510/930] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:30:14 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1729 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:30:14.483322 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-3fe79f7e-1f86-4178-a47e-c877eed0cc81 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:14.484174 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-3fe79f7e-1f86-4178-a47e-c877eed0cc81 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 591bdacc-1358-430f-961a-f648f5cf8e19] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:14.492676 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3fe79f7e-1f86-4178-a47e-c877eed0cc81 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:14.493166 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3fe79f7e-1f86-4178-a47e-c877eed0cc81 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:14.493605 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3fe79f7e-1f86-4178-a47e-c877eed0cc81 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:14.494477 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3fe79f7e-1f86-4178-a47e-c877eed0cc81 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:14.494922 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3fe79f7e-1f86-4178-a47e-c877eed0cc81 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:14.495346 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3fe79f7e-1f86-4178-a47e-c877eed0cc81 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:14.522774 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-3fe79f7e-1f86-4178-a47e-c877eed0cc81 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19/ips" status: 200 len: 150 microversion: 2.1 time: 0.044206 Sep 21 16:30:14.523343 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 421/931] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Sep 21 16:30:14 2022] GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:30:14.546444 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-1ced18f0-9ddd-43d1-adb9-05c6c648ebc6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:14.547419 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-1ced18f0-9ddd-43d1-adb9-05c6c648ebc6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:14.554003 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1ced18f0-9ddd-43d1-adb9-05c6c648ebc6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:14.554724 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1ced18f0-9ddd-43d1-adb9-05c6c648ebc6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:14.555579 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1ced18f0-9ddd-43d1-adb9-05c6c648ebc6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:14.556487 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1ced18f0-9ddd-43d1-adb9-05c6c648ebc6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:14.556948 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1ced18f0-9ddd-43d1-adb9-05c6c648ebc6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:14.557387 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1ced18f0-9ddd-43d1-adb9-05c6c648ebc6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:14.560137 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=4,nova_cell1:UPDATE=7 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:30:14.766502 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-1ced18f0-9ddd-43d1-adb9-05c6c648ebc6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:14.776162 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-1ced18f0-9ddd-43d1-adb9-05c6c648ebc6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1265 microversion: 2.1 time: 0.233844 Sep 21 16:30:14.777214 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 511/932] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:30:14 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:30:15.443814 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-3243e1c7-4c27-4c78-b189-30da0b749049 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:15.445513 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-3243e1c7-4c27-4c78-b189-30da0b749049 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:15.452994 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3243e1c7-4c27-4c78-b189-30da0b749049 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:15.453646 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3243e1c7-4c27-4c78-b189-30da0b749049 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:15.454348 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3243e1c7-4c27-4c78-b189-30da0b749049 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:15.455315 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3243e1c7-4c27-4c78-b189-30da0b749049 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:15.457032 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3243e1c7-4c27-4c78-b189-30da0b749049 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:15.457467 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3243e1c7-4c27-4c78-b189-30da0b749049 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:15.629709 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-3243e1c7-4c27-4c78-b189-30da0b749049 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:15.643600 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-3243e1c7-4c27-4c78-b189-30da0b749049 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:15.645937 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-3243e1c7-4c27-4c78-b189-30da0b749049 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:15.647198 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-3243e1c7-4c27-4c78-b189-30da0b749049 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1729 microversion: 2.20 time: 0.208066 Sep 21 16:30:15.647964 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 422/933] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:30:15 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1729 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:30:15.800546 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-b59c8857-e7dc-4ce2-a6ea-659628ed6390 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:15.801188 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-b59c8857-e7dc-4ce2-a6ea-659628ed6390 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:15.807785 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b59c8857-e7dc-4ce2-a6ea-659628ed6390 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:15.808493 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b59c8857-e7dc-4ce2-a6ea-659628ed6390 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:15.808943 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b59c8857-e7dc-4ce2-a6ea-659628ed6390 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:15.809621 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b59c8857-e7dc-4ce2-a6ea-659628ed6390 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:15.810086 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b59c8857-e7dc-4ce2-a6ea-659628ed6390 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:15.810724 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b59c8857-e7dc-4ce2-a6ea-659628ed6390 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:15.956424 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-b59c8857-e7dc-4ce2-a6ea-659628ed6390 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:15.966547 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-b59c8857-e7dc-4ce2-a6ea-659628ed6390 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1265 microversion: 2.1 time: 0.169779 Sep 21 16:30:15.968106 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 512/934] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:30:15 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:30:16.034647 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-17bfe278-93c9-4e3a-8e91-8f09243c99a8 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4568a61c-94fd-4147-93bc-a066333ccd10"}} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:30:16.037334 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-17bfe278-93c9-4e3a-8e91-8f09243c99a8 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 591bdacc-1358-430f-961a-f648f5cf8e19] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:16.044106 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-17bfe278-93c9-4e3a-8e91-8f09243c99a8 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:16.044839 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-17bfe278-93c9-4e3a-8e91-8f09243c99a8 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:16.045471 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-17bfe278-93c9-4e3a-8e91-8f09243c99a8 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:16.046386 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-17bfe278-93c9-4e3a-8e91-8f09243c99a8 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:16.047054 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-17bfe278-93c9-4e3a-8e91-8f09243c99a8 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:16.047681 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-17bfe278-93c9-4e3a-8e91-8f09243c99a8 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:16.461654 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:30:16.490023 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-17bfe278-93c9-4e3a-8e91-8f09243c99a8 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "POST /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.458883 Sep 21 16:30:16.491405 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 423/935] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Sep 21 16:30:16 2022] POST /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19/os-volume_attachments => generated 194 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:30:16.681174 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-7894c679-a466-47d7-8cc9-534abab729b1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:16.682232 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-7894c679-a466-47d7-8cc9-534abab729b1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:16.692554 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7894c679-a466-47d7-8cc9-534abab729b1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:16.693698 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7894c679-a466-47d7-8cc9-534abab729b1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:16.694449 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7894c679-a466-47d7-8cc9-534abab729b1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:16.695632 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7894c679-a466-47d7-8cc9-534abab729b1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:16.696420 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7894c679-a466-47d7-8cc9-534abab729b1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:16.697365 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7894c679-a466-47d7-8cc9-534abab729b1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:16.850792 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-7894c679-a466-47d7-8cc9-534abab729b1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:16.861367 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-7894c679-a466-47d7-8cc9-534abab729b1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:16.863130 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-7894c679-a466-47d7-8cc9-534abab729b1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:16.864564 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-7894c679-a466-47d7-8cc9-534abab729b1 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1729 microversion: 2.20 time: 0.191433 Sep 21 16:30:16.869039 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 513/936] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:30:16 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1729 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:30:16.991300 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-4d547269-bf3f-4a88-be6f-00010b2df6a5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:16.992008 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-4d547269-bf3f-4a88-be6f-00010b2df6a5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:17.000022 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4d547269-bf3f-4a88-be6f-00010b2df6a5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:17.000510 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4d547269-bf3f-4a88-be6f-00010b2df6a5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:17.000937 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4d547269-bf3f-4a88-be6f-00010b2df6a5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:17.001631 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4d547269-bf3f-4a88-be6f-00010b2df6a5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:17.002105 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4d547269-bf3f-4a88-be6f-00010b2df6a5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:17.002523 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4d547269-bf3f-4a88-be6f-00010b2df6a5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:17.138847 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-4d547269-bf3f-4a88-be6f-00010b2df6a5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:17.146941 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-4d547269-bf3f-4a88-be6f-00010b2df6a5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1265 microversion: 2.1 time: 0.160278 Sep 21 16:30:17.147642 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 424/937] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:30:16 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:30:17.892389 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-b57dccb1-b50f-4dad-a42c-d8e4e694c91d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:17.893005 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-b57dccb1-b50f-4dad-a42c-d8e4e694c91d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:17.900111 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b57dccb1-b50f-4dad-a42c-d8e4e694c91d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:17.900849 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b57dccb1-b50f-4dad-a42c-d8e4e694c91d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:17.901457 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b57dccb1-b50f-4dad-a42c-d8e4e694c91d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:17.902200 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b57dccb1-b50f-4dad-a42c-d8e4e694c91d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:17.903052 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b57dccb1-b50f-4dad-a42c-d8e4e694c91d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:17.903242 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b57dccb1-b50f-4dad-a42c-d8e4e694c91d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:18.084910 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-b57dccb1-b50f-4dad-a42c-d8e4e694c91d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:18.094696 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-b57dccb1-b50f-4dad-a42c-d8e4e694c91d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:18.096243 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-b57dccb1-b50f-4dad-a42c-d8e4e694c91d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:18.097506 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-b57dccb1-b50f-4dad-a42c-d8e4e694c91d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1729 microversion: 2.20 time: 0.209437 Sep 21 16:30:18.098405 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 514/938] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:30:17 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1729 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:30:18.173693 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-cbf4f106-e7c0-437b-b04f-6a7a12261472 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:18.174375 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-cbf4f106-e7c0-437b-b04f-6a7a12261472 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:18.178101 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:30:18.182032 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cbf4f106-e7c0-437b-b04f-6a7a12261472 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:18.182602 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cbf4f106-e7c0-437b-b04f-6a7a12261472 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:18.183041 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cbf4f106-e7c0-437b-b04f-6a7a12261472 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:18.183786 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cbf4f106-e7c0-437b-b04f-6a7a12261472 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:18.184273 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cbf4f106-e7c0-437b-b04f-6a7a12261472 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:18.184662 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cbf4f106-e7c0-437b-b04f-6a7a12261472 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:18.417609 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-cbf4f106-e7c0-437b-b04f-6a7a12261472 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:18.430621 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-cbf4f106-e7c0-437b-b04f-6a7a12261472 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1265 microversion: 2.1 time: 0.262411 Sep 21 16:30:18.431214 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 425/939] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:30:18 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1265 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:30:19.123417 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-fc246567-c787-49d6-9fc7-53a14229014d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:19.124035 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-fc246567-c787-49d6-9fc7-53a14229014d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:19.133530 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fc246567-c787-49d6-9fc7-53a14229014d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:19.134028 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fc246567-c787-49d6-9fc7-53a14229014d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:19.134514 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fc246567-c787-49d6-9fc7-53a14229014d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:19.135246 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fc246567-c787-49d6-9fc7-53a14229014d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:19.135915 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fc246567-c787-49d6-9fc7-53a14229014d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:19.136344 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fc246567-c787-49d6-9fc7-53a14229014d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:19.294139 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-fc246567-c787-49d6-9fc7-53a14229014d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:19.304099 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-fc246567-c787-49d6-9fc7-53a14229014d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:19.306090 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-fc246567-c787-49d6-9fc7-53a14229014d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:19.308197 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-fc246567-c787-49d6-9fc7-53a14229014d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1729 microversion: 2.20 time: 0.188241 Sep 21 16:30:19.309268 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 515/940] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:30:19 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1729 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:30:19.455820 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-55b1cf64-3be2-4322-a616-7f854774b610 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:19.456529 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-55b1cf64-3be2-4322-a616-7f854774b610 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:19.468969 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-55b1cf64-3be2-4322-a616-7f854774b610 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:19.469816 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-55b1cf64-3be2-4322-a616-7f854774b610 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:19.470682 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-55b1cf64-3be2-4322-a616-7f854774b610 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:19.474183 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-55b1cf64-3be2-4322-a616-7f854774b610 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:19.475077 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-55b1cf64-3be2-4322-a616-7f854774b610 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:19.475680 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-55b1cf64-3be2-4322-a616-7f854774b610 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:19.562023 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-45b0dd52-a137-4a84-904d-93ece77ceecc req-b5c4df2f-52ee-4410-8310-edbc63562740 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15ec6390-e13e-4e88-8bdc-62507b36a9a6", "name": "network-vif-plugged", "status": "completed", "tag": "ce1a423d-237c-4ca8-8c26-29b613b76535"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:30:19.575404 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-45b0dd52-a137-4a84-904d-93ece77ceecc req-b5c4df2f-52ee-4410-8310-edbc63562740 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:19.577567 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-45b0dd52-a137-4a84-904d-93ece77ceecc req-b5c4df2f-52ee-4410-8310-edbc63562740 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:19.578255 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-45b0dd52-a137-4a84-904d-93ece77ceecc req-b5c4df2f-52ee-4410-8310-edbc63562740 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:19.596556 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-45b0dd52-a137-4a84-904d-93ece77ceecc req-b5c4df2f-52ee-4410-8310-edbc63562740 service nova] Creating event network-vif-plugged:ce1a423d-237c-4ca8-8c26-29b613b76535 for instance 15ec6390-e13e-4e88-8bdc-62507b36a9a6 on hv-cinder-85862 Sep 21 16:30:19.602917 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-45b0dd52-a137-4a84-904d-93ece77ceecc req-b5c4df2f-52ee-4410-8310-edbc63562740 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046080 Sep 21 16:30:19.605478 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 516/941] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:30:19.696681 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-55b1cf64-3be2-4322-a616-7f854774b610 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:19.706878 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-55b1cf64-3be2-4322-a616-7f854774b610 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1265 microversion: 2.1 time: 0.256280 Sep 21 16:30:19.707381 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 426/942] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:30:19 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:30:20.345958 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-3597fd00-22fe-4499-b8d7-4a4b8807173b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:20.346766 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-3597fd00-22fe-4499-b8d7-4a4b8807173b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:20.353525 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3597fd00-22fe-4499-b8d7-4a4b8807173b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:20.354132 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3597fd00-22fe-4499-b8d7-4a4b8807173b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:20.354639 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3597fd00-22fe-4499-b8d7-4a4b8807173b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:20.355378 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3597fd00-22fe-4499-b8d7-4a4b8807173b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:20.355836 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3597fd00-22fe-4499-b8d7-4a4b8807173b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:20.356261 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3597fd00-22fe-4499-b8d7-4a4b8807173b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:20.504084 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-3597fd00-22fe-4499-b8d7-4a4b8807173b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:20.525432 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-3597fd00-22fe-4499-b8d7-4a4b8807173b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:20.526996 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-3597fd00-22fe-4499-b8d7-4a4b8807173b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:20.529593 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-3597fd00-22fe-4499-b8d7-4a4b8807173b tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1729 microversion: 2.20 time: 0.192291 Sep 21 16:30:20.530732 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 517/943] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:30:20 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1729 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:30:20.734744 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-a7bf5b81-d9fd-477e-94ee-dadb30815d78 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:20.736009 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-a7bf5b81-d9fd-477e-94ee-dadb30815d78 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:20.743546 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a7bf5b81-d9fd-477e-94ee-dadb30815d78 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:20.744071 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a7bf5b81-d9fd-477e-94ee-dadb30815d78 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:20.744556 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a7bf5b81-d9fd-477e-94ee-dadb30815d78 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:20.745250 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a7bf5b81-d9fd-477e-94ee-dadb30815d78 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:20.745704 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a7bf5b81-d9fd-477e-94ee-dadb30815d78 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:20.746158 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a7bf5b81-d9fd-477e-94ee-dadb30815d78 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:20.960724 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-a7bf5b81-d9fd-477e-94ee-dadb30815d78 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:20.972210 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-a7bf5b81-d9fd-477e-94ee-dadb30815d78 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1265 microversion: 2.1 time: 0.241573 Sep 21 16:30:20.973565 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 427/944] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:30:20 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:30:21.556207 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-a72a101f-10de-4a68-bda4-ecc50021edc9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:21.556800 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-a72a101f-10de-4a68-bda4-ecc50021edc9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:21.565233 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a72a101f-10de-4a68-bda4-ecc50021edc9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:21.565927 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a72a101f-10de-4a68-bda4-ecc50021edc9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:21.566946 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a72a101f-10de-4a68-bda4-ecc50021edc9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:21.567429 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a72a101f-10de-4a68-bda4-ecc50021edc9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:21.567895 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a72a101f-10de-4a68-bda4-ecc50021edc9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:21.568346 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a72a101f-10de-4a68-bda4-ecc50021edc9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:21.644149 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-63c13792-cfb4-49ba-be78-4eda72ec5f71 req-0473fac3-4ae0-482a-b5b4-26d18403411a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce59fd53-2d4c-477e-8326-672737e561f5", "name": "network-vif-plugged", "status": "completed", "tag": "5abd346c-df9c-4cb2-b976-8f9adc822383"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:30:21.659428 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-63c13792-cfb4-49ba-be78-4eda72ec5f71 req-0473fac3-4ae0-482a-b5b4-26d18403411a service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:21.660222 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-63c13792-cfb4-49ba-be78-4eda72ec5f71 req-0473fac3-4ae0-482a-b5b4-26d18403411a service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:21.660689 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-63c13792-cfb4-49ba-be78-4eda72ec5f71 req-0473fac3-4ae0-482a-b5b4-26d18403411a service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:21.688061 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-63c13792-cfb4-49ba-be78-4eda72ec5f71 req-0473fac3-4ae0-482a-b5b4-26d18403411a service nova] Creating event network-vif-plugged:5abd346c-df9c-4cb2-b976-8f9adc822383 for instance ce59fd53-2d4c-477e-8326-672737e561f5 on hv-cinder-85862 Sep 21 16:30:21.696035 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-63c13792-cfb4-49ba-be78-4eda72ec5f71 req-0473fac3-4ae0-482a-b5b4-26d18403411a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056711 Sep 21 16:30:21.696772 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 428/945] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:30:21.768663 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a72a101f-10de-4a68-bda4-ecc50021edc9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:21.783331 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a72a101f-10de-4a68-bda4-ecc50021edc9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:21.796843 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a72a101f-10de-4a68-bda4-ecc50021edc9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:21.798314 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-a72a101f-10de-4a68-bda4-ecc50021edc9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1729 microversion: 2.20 time: 0.246629 Sep 21 16:30:21.799107 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 518/946] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:30:21 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1729 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:30:22.001475 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-1970df99-2b9e-4639-a1dd-d8385ac1cd8e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:22.002840 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-1970df99-2b9e-4639-a1dd-d8385ac1cd8e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:22.009249 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1970df99-2b9e-4639-a1dd-d8385ac1cd8e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:22.009737 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1970df99-2b9e-4639-a1dd-d8385ac1cd8e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:22.010321 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1970df99-2b9e-4639-a1dd-d8385ac1cd8e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:22.011086 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1970df99-2b9e-4639-a1dd-d8385ac1cd8e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:22.011528 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1970df99-2b9e-4639-a1dd-d8385ac1cd8e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:22.011947 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1970df99-2b9e-4639-a1dd-d8385ac1cd8e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:22.174993 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-1970df99-2b9e-4639-a1dd-d8385ac1cd8e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:22.189153 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-1970df99-2b9e-4639-a1dd-d8385ac1cd8e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1453 microversion: 2.1 time: 0.192665 Sep 21 16:30:22.190141 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 429/947] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:30:21 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1453 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:30:22.213245 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-e70e2d86-d56c-4856-8a3e-5655d3e0a2df tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:22.213851 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-e70e2d86-d56c-4856-8a3e-5655d3e0a2df tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:22.220525 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e70e2d86-d56c-4856-8a3e-5655d3e0a2df tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:22.221002 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e70e2d86-d56c-4856-8a3e-5655d3e0a2df tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:22.221617 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e70e2d86-d56c-4856-8a3e-5655d3e0a2df tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:22.222531 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e70e2d86-d56c-4856-8a3e-5655d3e0a2df tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:22.223186 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e70e2d86-d56c-4856-8a3e-5655d3e0a2df tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:22.223533 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e70e2d86-d56c-4856-8a3e-5655d3e0a2df tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:22.379510 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-e70e2d86-d56c-4856-8a3e-5655d3e0a2df tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:22.388844 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-e70e2d86-d56c-4856-8a3e-5655d3e0a2df tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1453 microversion: 2.1 time: 0.179850 Sep 21 16:30:22.389616 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 519/948] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:30:22 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1453 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:30:22.831827 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-66a2744d-5bc3-40bc-ada7-2243c3de429d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:22.832612 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-66a2744d-5bc3-40bc-ada7-2243c3de429d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:22.849650 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-66a2744d-5bc3-40bc-ada7-2243c3de429d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:22.850950 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-66a2744d-5bc3-40bc-ada7-2243c3de429d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:22.853933 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-66a2744d-5bc3-40bc-ada7-2243c3de429d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:22.854753 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-66a2744d-5bc3-40bc-ada7-2243c3de429d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:22.855259 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-66a2744d-5bc3-40bc-ada7-2243c3de429d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:22.857918 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-66a2744d-5bc3-40bc-ada7-2243c3de429d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:23.196439 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-66a2744d-5bc3-40bc-ada7-2243c3de429d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:23.212919 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-66a2744d-5bc3-40bc-ada7-2243c3de429d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:23.217773 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-66a2744d-5bc3-40bc-ada7-2243c3de429d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:23.222427 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-66a2744d-5bc3-40bc-ada7-2243c3de429d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1729 microversion: 2.20 time: 0.393805 Sep 21 16:30:23.240052 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 430/949] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:30:22 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1729 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:30:24.256910 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-6efa9314-85da-4232-aca5-992a602c8925 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:24.258597 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-6efa9314-85da-4232-aca5-992a602c8925 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:24.272030 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6efa9314-85da-4232-aca5-992a602c8925 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:24.272684 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6efa9314-85da-4232-aca5-992a602c8925 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:24.273816 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6efa9314-85da-4232-aca5-992a602c8925 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:24.275255 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6efa9314-85da-4232-aca5-992a602c8925 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:24.276020 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6efa9314-85da-4232-aca5-992a602c8925 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:24.279669 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6efa9314-85da-4232-aca5-992a602c8925 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:24.507722 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-290dddf1-3aa5-4ffc-8b2a-958b3d82af46 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:24.508857 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-290dddf1-3aa5-4ffc-8b2a-958b3d82af46 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 591bdacc-1358-430f-961a-f648f5cf8e19] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:24.517705 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-290dddf1-3aa5-4ffc-8b2a-958b3d82af46 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:24.518240 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-290dddf1-3aa5-4ffc-8b2a-958b3d82af46 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:24.518669 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-290dddf1-3aa5-4ffc-8b2a-958b3d82af46 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:24.519504 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-290dddf1-3aa5-4ffc-8b2a-958b3d82af46 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:24.519819 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-290dddf1-3aa5-4ffc-8b2a-958b3d82af46 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:24.522994 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-290dddf1-3aa5-4ffc-8b2a-958b3d82af46 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:24.671058 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-6efa9314-85da-4232-aca5-992a602c8925 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:24.682449 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-6efa9314-85da-4232-aca5-992a602c8925 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:24.685263 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-6efa9314-85da-4232-aca5-992a602c8925 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:24.687159 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-6efa9314-85da-4232-aca5-992a602c8925 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1729 microversion: 2.20 time: 0.435190 Sep 21 16:30:24.688088 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 520/950] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:30:24 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1729 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:30:24.715882 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.objects.instance [None req-290dddf1-3aa5-4ffc-8b2a-958b3d82af46 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lazy-loading 'services' on Instance uuid 591bdacc-1358-430f-961a-f648f5cf8e19 {{(pid=120531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 16:30:24.754710 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-460a8ff6-fb9a-48e6-9afe-7572abbb8cd8 req-9f97973d-b25f-421f-9f02-32870327125f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15ec6390-e13e-4e88-8bdc-62507b36a9a6", "tag": "ce1a423d-237c-4ca8-8c26-29b613b76535"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:30:24.766204 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-460a8ff6-fb9a-48e6-9afe-7572abbb8cd8 req-9f97973d-b25f-421f-9f02-32870327125f service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:24.767208 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-460a8ff6-fb9a-48e6-9afe-7572abbb8cd8 req-9f97973d-b25f-421f-9f02-32870327125f service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:24.767796 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-460a8ff6-fb9a-48e6-9afe-7572abbb8cd8 req-9f97973d-b25f-421f-9f02-32870327125f service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:24.786807 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-460a8ff6-fb9a-48e6-9afe-7572abbb8cd8 req-9f97973d-b25f-421f-9f02-32870327125f service nova] Creating event network-changed:ce1a423d-237c-4ca8-8c26-29b613b76535 for instance 15ec6390-e13e-4e88-8bdc-62507b36a9a6 on hv-cinder-85862 Sep 21 16:30:24.795506 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-460a8ff6-fb9a-48e6-9afe-7572abbb8cd8 req-9f97973d-b25f-421f-9f02-32870327125f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044036 Sep 21 16:30:24.802087 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 521/951] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:30:24.893909 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-290dddf1-3aa5-4ffc-8b2a-958b3d82af46 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "DELETE /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19/os-volume_attachments/4568a61c-94fd-4147-93bc-a066333ccd10" status: 202 len: 0 microversion: 2.1 time: 0.390229 Sep 21 16:30:24.895525 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 431/952] 10.222.0.64 () {58 vars in 1416 bytes} [Wed Sep 21 16:30:24 2022] DELETE /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19/os-volume_attachments/4568a61c-94fd-4147-93bc-a066333ccd10 => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 16:30:24.905105 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-d21699a7-ea6e-4d99-afc3-674bd2231864 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:24.907563 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-d21699a7-ea6e-4d99-afc3-674bd2231864 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 591bdacc-1358-430f-961a-f648f5cf8e19] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:24.929528 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d21699a7-ea6e-4d99-afc3-674bd2231864 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:24.930711 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d21699a7-ea6e-4d99-afc3-674bd2231864 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:24.932535 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d21699a7-ea6e-4d99-afc3-674bd2231864 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:24.936173 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d21699a7-ea6e-4d99-afc3-674bd2231864 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:24.937373 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d21699a7-ea6e-4d99-afc3-674bd2231864 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:24.938132 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d21699a7-ea6e-4d99-afc3-674bd2231864 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:25.009312 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-d21699a7-ea6e-4d99-afc3-674bd2231864 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109029 Sep 21 16:30:25.015452 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 522/953] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Sep 21 16:30:24 2022] GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:30:25.716576 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-438545ee-259a-49de-8b11-e35f6ace1f2f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:25.717961 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-438545ee-259a-49de-8b11-e35f6ace1f2f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:25.725197 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-438545ee-259a-49de-8b11-e35f6ace1f2f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:25.725691 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-438545ee-259a-49de-8b11-e35f6ace1f2f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:25.726300 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-438545ee-259a-49de-8b11-e35f6ace1f2f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:25.727258 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-438545ee-259a-49de-8b11-e35f6ace1f2f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:25.727891 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-438545ee-259a-49de-8b11-e35f6ace1f2f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:25.728464 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-438545ee-259a-49de-8b11-e35f6ace1f2f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:25.924252 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-438545ee-259a-49de-8b11-e35f6ace1f2f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:25.939866 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-438545ee-259a-49de-8b11-e35f6ace1f2f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:25.941745 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-438545ee-259a-49de-8b11-e35f6ace1f2f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:25.943226 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-438545ee-259a-49de-8b11-e35f6ace1f2f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1716 microversion: 2.20 time: 0.233307 Sep 21 16:30:25.959015 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 432/954] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:30:25 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1716 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:30:26.023503 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-3393178d-92aa-497c-a53f-0185ff18a398 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:26.025771 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-3393178d-92aa-497c-a53f-0185ff18a398 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 591bdacc-1358-430f-961a-f648f5cf8e19] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:26.036292 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3393178d-92aa-497c-a53f-0185ff18a398 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:26.037036 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3393178d-92aa-497c-a53f-0185ff18a398 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:26.037640 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3393178d-92aa-497c-a53f-0185ff18a398 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:26.038539 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3393178d-92aa-497c-a53f-0185ff18a398 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:26.039152 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3393178d-92aa-497c-a53f-0185ff18a398 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:26.039732 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3393178d-92aa-497c-a53f-0185ff18a398 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:26.079023 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-3393178d-92aa-497c-a53f-0185ff18a398 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059531 Sep 21 16:30:26.079626 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 523/955] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Sep 21 16:30:26 2022] GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 21 16:30:26.166129 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-4c12e800-bfd0-42f1-a5d0-e9727f8c2206 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:26.166730 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-4c12e800-bfd0-42f1-a5d0-e9727f8c2206 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 591bdacc-1358-430f-961a-f648f5cf8e19] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:26.183625 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4c12e800-bfd0-42f1-a5d0-e9727f8c2206 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:26.184550 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4c12e800-bfd0-42f1-a5d0-e9727f8c2206 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:26.185860 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4c12e800-bfd0-42f1-a5d0-e9727f8c2206 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:26.186902 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4c12e800-bfd0-42f1-a5d0-e9727f8c2206 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:26.187440 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4c12e800-bfd0-42f1-a5d0-e9727f8c2206 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:26.189111 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4c12e800-bfd0-42f1-a5d0-e9727f8c2206 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:26.227405 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-4c12e800-bfd0-42f1-a5d0-e9727f8c2206 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 591bdacc-1358-430f-961a-f648f5cf8e19] Going to try to terminate instance {{(pid=120531) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 16:30:26.324673 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-4c12e800-bfd0-42f1-a5d0-e9727f8c2206 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "DELETE /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19" status: 204 len: 0 microversion: 2.1 time: 0.166815 Sep 21 16:30:26.325311 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 433/956] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Sep 21 16:30:26 2022] DELETE /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 21 16:30:26.334497 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-023347bf-640b-4c58-8d27-f9d1a86d3e64 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:26.335115 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-023347bf-640b-4c58-8d27-f9d1a86d3e64 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 591bdacc-1358-430f-961a-f648f5cf8e19] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:26.341583 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-023347bf-640b-4c58-8d27-f9d1a86d3e64 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:26.342100 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-023347bf-640b-4c58-8d27-f9d1a86d3e64 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:26.342547 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-023347bf-640b-4c58-8d27-f9d1a86d3e64 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:26.343234 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-023347bf-640b-4c58-8d27-f9d1a86d3e64 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:26.343725 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-023347bf-640b-4c58-8d27-f9d1a86d3e64 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:26.344155 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-023347bf-640b-4c58-8d27-f9d1a86d3e64 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:26.475802 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-023347bf-640b-4c58-8d27-f9d1a86d3e64 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:26.485312 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-023347bf-640b-4c58-8d27-f9d1a86d3e64 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19" status: 200 len: 1680 microversion: 2.1 time: 0.154946 Sep 21 16:30:26.485906 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 524/957] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:30:26 2022] GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:30:27.510524 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-ff84c2b3-76ca-4a88-97ef-765fcde4bb78 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:27.511533 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-ff84c2b3-76ca-4a88-97ef-765fcde4bb78 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 591bdacc-1358-430f-961a-f648f5cf8e19] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:27.521971 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ff84c2b3-76ca-4a88-97ef-765fcde4bb78 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:27.523088 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ff84c2b3-76ca-4a88-97ef-765fcde4bb78 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:27.523710 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ff84c2b3-76ca-4a88-97ef-765fcde4bb78 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:27.524591 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ff84c2b3-76ca-4a88-97ef-765fcde4bb78 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:27.525056 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ff84c2b3-76ca-4a88-97ef-765fcde4bb78 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:27.526377 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ff84c2b3-76ca-4a88-97ef-765fcde4bb78 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:27.673081 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-ff84c2b3-76ca-4a88-97ef-765fcde4bb78 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:27.683191 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-ff84c2b3-76ca-4a88-97ef-765fcde4bb78 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19" status: 200 len: 1680 microversion: 2.1 time: 0.178030 Sep 21 16:30:27.683781 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 434/958] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:30:27 2022] GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19 => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:30:28.710537 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-de277d7e-f82e-415d-8d7e-a0727ffbb293 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:28.711159 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-de277d7e-f82e-415d-8d7e-a0727ffbb293 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 591bdacc-1358-430f-961a-f648f5cf8e19] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:28.721235 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-de277d7e-f82e-415d-8d7e-a0727ffbb293 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:28.724344 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-de277d7e-f82e-415d-8d7e-a0727ffbb293 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:28.724344 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-de277d7e-f82e-415d-8d7e-a0727ffbb293 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:28.724344 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-de277d7e-f82e-415d-8d7e-a0727ffbb293 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:28.724344 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-de277d7e-f82e-415d-8d7e-a0727ffbb293 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:28.724780 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-de277d7e-f82e-415d-8d7e-a0727ffbb293 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:29.122462 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-de277d7e-f82e-415d-8d7e-a0727ffbb293 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b917d84a650f4355a676e315ea039f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7a3e77ddf14b48986752434dda6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:29.166345 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-de277d7e-f82e-415d-8d7e-a0727ffbb293 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19" status: 200 len: 1614 microversion: 2.1 time: 0.456527 Sep 21 16:30:29.171364 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-2e590fed-195d-4f75-89b9-01cb1c2b4788 req-58e1f0ac-10d1-476b-a672-bec6f2014e78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "591bdacc-1358-430f-961a-f648f5cf8e19", "name": "network-vif-deleted", "tag": "1caf6ff4-eb49-4542-a687-9ca98562df23"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:30:29.173966 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 525/959] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:30:28 2022] GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19 => generated 1614 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:30:29.213285 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-2e590fed-195d-4f75-89b9-01cb1c2b4788 req-58e1f0ac-10d1-476b-a672-bec6f2014e78 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:29.214660 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-2e590fed-195d-4f75-89b9-01cb1c2b4788 req-58e1f0ac-10d1-476b-a672-bec6f2014e78 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:29.215115 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-2e590fed-195d-4f75-89b9-01cb1c2b4788 req-58e1f0ac-10d1-476b-a672-bec6f2014e78 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:29.265574 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-2e590fed-195d-4f75-89b9-01cb1c2b4788 req-58e1f0ac-10d1-476b-a672-bec6f2014e78 service nova] Creating event network-vif-deleted:1caf6ff4-eb49-4542-a687-9ca98562df23 for instance 591bdacc-1358-430f-961a-f648f5cf8e19 on hv-cinder-85862 Sep 21 16:30:29.279645 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-2e590fed-195d-4f75-89b9-01cb1c2b4788 req-58e1f0ac-10d1-476b-a672-bec6f2014e78 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115645 Sep 21 16:30:29.280200 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 435/960] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:30:30.196080 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-cdca77cd-131b-4e26-9f1d-7ea3f4457868 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:30.196706 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-cdca77cd-131b-4e26-9f1d-7ea3f4457868 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 591bdacc-1358-430f-961a-f648f5cf8e19] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:30.203526 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cdca77cd-131b-4e26-9f1d-7ea3f4457868 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:30.204040 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cdca77cd-131b-4e26-9f1d-7ea3f4457868 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:30.204467 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cdca77cd-131b-4e26-9f1d-7ea3f4457868 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:30.205183 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cdca77cd-131b-4e26-9f1d-7ea3f4457868 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:30.205647 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cdca77cd-131b-4e26-9f1d-7ea3f4457868 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:30.206112 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cdca77cd-131b-4e26-9f1d-7ea3f4457868 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:30.221164 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.wsgi [None req-cdca77cd-131b-4e26-9f1d-7ea3f4457868 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] HTTP exception thrown: Instance 591bdacc-1358-430f-961a-f648f5cf8e19 could not be found. Sep 21 16:30:30.222880 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-cdca77cd-131b-4e26-9f1d-7ea3f4457868 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Request method failure captured: Sep 21 16:30:30.222880 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: request: GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19 HTTP/1.1 Sep 21 16:30:30.222880 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept: application/json Sep 21 16:30:30.222880 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept-Encoding: identity Sep 21 16:30:30.222880 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Connection: close Sep 21 16:30:30.222880 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Length: 0 Sep 21 16:30:30.222880 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Type: application/json Sep 21 16:30:30.222880 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Host: 10.222.0.64 Sep 21 16:30:30.222880 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Openstack-System-Scope: None Sep 21 16:30:30.222880 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: User-Agent: python-urllib3/1.26.12 Sep 21 16:30:30.222880 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Auth-Token: gAAAAABjKzptDl5Jwme7JQaRL3V8XsiXvjsgkfXKC5CR9zEf_XxPd1NsWodDna8_dBwDJyu9_lHil_M0vLPPzmX177kcKqWx5X8mqOmQSrRLHHx1LRIv3gdLEkJSUiwMVF6fR-kEaNic5IQ5zuSAZa0555zHli7HQ0zguOZ1COKKRN-ARxj0HyM Sep 21 16:30:30.222880 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Id: None Sep 21 16:30:30.222880 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Name: None Sep 21 16:30:30.222880 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Identity-Status: Confirmed Sep 21 16:30:30.222880 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Is-Admin-Project: True Sep 21 16:30:30.222880 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Id: default Sep 21 16:30:30.222880 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Name: Default Sep 21 16:30:30.222880 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Id: ce7a3e77ddf14b48986752434dda6d33 Sep 21 16:30:30.222880 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Name: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:30:30.222880 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Role: member,reader Sep 21 16:30:30.222880 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Roles: member,reader Sep 21 16:30:30.224389 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce7a3e77ddf14b48986752434dda6d33"}]}] Sep 21 16:30:30.224389 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:30:30.224389 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Id: ce7a3e77ddf14b48986752434dda6d33 Sep 21 16:30:30.224389 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:30:30.224389 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User: tempest-AttachVolumeNegativeTest-67026365-project Sep 21 16:30:30.224389 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Id: default Sep 21 16:30:30.224389 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Name: Default Sep 21 16:30:30.224389 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Id: b917d84a650f4355a676e315ea039f0e Sep 21 16:30:30.224389 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Name: tempest-AttachVolumeNegativeTest-67026365-project Sep 21 16:30:30.224389 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: method: > Sep 21 16:30:30.224389 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: exception: Instance 591bdacc-1358-430f-961a-f648f5cf8e19 could not be found. Sep 21 16:30:30.224389 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: action_args: {'id': '591bdacc-1358-430f-961a-f648f5cf8e19'} Sep 21 16:30:30.225174 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:30:30.225174 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:30:30.225174 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 16:30:30.225174 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 16:30:30.225174 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 16:30:30.225174 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 16:30:30.225174 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 16:30:30.225174 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 16:30:30.225174 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 16:30:30.225174 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 16:30:30.225174 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 591bdacc-1358-430f-961a-f648f5cf8e19 could not be found. Sep 21 16:30:30.225174 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:30:30.225174 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:30:30.225174 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:30:30.225174 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:30:30.225174 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:30:30.225174 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:30:30.225174 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:30:30.225174 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:30:30.225174 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:30:30.226970 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:30:30.226970 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 16:30:30.226970 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 16:30:30.226970 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 16:30:30.226970 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 16:30:30.226970 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 16:30:30.226970 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:30:30.226970 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 591bdacc-1358-430f-961a-f648f5cf8e19 could not be found. Sep 21 16:30:30.226970 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:30:30.226970 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:30:30.226970 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:30:30.226970 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:30:30.226970 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:30:30.226970 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:30:30.226970 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:30:30.226970 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:30:30.226970 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 591bdacc-1358-430f-961a-f648f5cf8e19 could not be found. Sep 21 16:30:30.226970 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:30:30.229318 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-cdca77cd-131b-4e26-9f1d-7ea3f4457868 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Returning 404 to user: Instance 591bdacc-1358-430f-961a-f648f5cf8e19 could not be found. {{(pid=120532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:30:30.229318 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-cdca77cd-131b-4e26-9f1d-7ea3f4457868 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19" status: 404 len: 111 microversion: 2.1 time: 0.032337 Sep 21 16:30:30.235273 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-458ff3b8-1e77-40d9-8743-a782e8ceb3cb tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '.version_select at 0x7fdb889b95e0>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:30.238196 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 526/961] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:30:30 2022] GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 16:30:30.268691 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-458ff3b8-1e77-40d9-8743-a782e8ceb3cb tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-524913399" status: 202 len: 0 microversion: 2.1 time: 0.038658 Sep 21 16:30:30.273108 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 436/962] 10.222.0.64 () {58 vars in 1218 bytes} [Wed Sep 21 16:30:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-524913399 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 16:30:32.303216 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-6586d10e-b7f3-4226-989b-ee2c1e3a5d8b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:32.304765 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-6586d10e-b7f3-4226-989b-ee2c1e3a5d8b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 591bdacc-1358-430f-961a-f648f5cf8e19] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:32.317054 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6586d10e-b7f3-4226-989b-ee2c1e3a5d8b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:32.318472 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6586d10e-b7f3-4226-989b-ee2c1e3a5d8b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:32.319007 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6586d10e-b7f3-4226-989b-ee2c1e3a5d8b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:32.319853 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6586d10e-b7f3-4226-989b-ee2c1e3a5d8b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:32.320236 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6586d10e-b7f3-4226-989b-ee2c1e3a5d8b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:32.320915 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6586d10e-b7f3-4226-989b-ee2c1e3a5d8b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:32.339268 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.wsgi [None req-6586d10e-b7f3-4226-989b-ee2c1e3a5d8b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] HTTP exception thrown: Instance 591bdacc-1358-430f-961a-f648f5cf8e19 could not be found. Sep 21 16:30:32.341021 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-6586d10e-b7f3-4226-989b-ee2c1e3a5d8b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Request method failure captured: Sep 21 16:30:32.341021 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: request: DELETE /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19 HTTP/1.1 Sep 21 16:30:32.341021 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept: application/json Sep 21 16:30:32.341021 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept-Encoding: identity Sep 21 16:30:32.341021 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Connection: close Sep 21 16:30:32.341021 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Length: 0 Sep 21 16:30:32.341021 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Type: application/json Sep 21 16:30:32.341021 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Host: 10.222.0.64 Sep 21 16:30:32.341021 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Openstack-System-Scope: None Sep 21 16:30:32.341021 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: User-Agent: python-urllib3/1.26.12 Sep 21 16:30:32.341021 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Auth-Token: gAAAAABjKzptDl5Jwme7JQaRL3V8XsiXvjsgkfXKC5CR9zEf_XxPd1NsWodDna8_dBwDJyu9_lHil_M0vLPPzmX177kcKqWx5X8mqOmQSrRLHHx1LRIv3gdLEkJSUiwMVF6fR-kEaNic5IQ5zuSAZa0555zHli7HQ0zguOZ1COKKRN-ARxj0HyM Sep 21 16:30:32.341021 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Id: None Sep 21 16:30:32.341021 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Name: None Sep 21 16:30:32.341021 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Identity-Status: Confirmed Sep 21 16:30:32.341021 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Is-Admin-Project: True Sep 21 16:30:32.341021 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Id: default Sep 21 16:30:32.341021 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Name: Default Sep 21 16:30:32.341021 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Id: ce7a3e77ddf14b48986752434dda6d33 Sep 21 16:30:32.341021 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Name: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:30:32.341021 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Role: member,reader Sep 21 16:30:32.341021 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Roles: member,reader Sep 21 16:30:32.342714 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce7a3e77ddf14b48986752434dda6d33"}]}] Sep 21 16:30:32.342714 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:30:32.342714 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Id: ce7a3e77ddf14b48986752434dda6d33 Sep 21 16:30:32.342714 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:30:32.342714 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User: tempest-AttachVolumeNegativeTest-67026365-project Sep 21 16:30:32.342714 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Id: default Sep 21 16:30:32.342714 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Name: Default Sep 21 16:30:32.342714 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Id: b917d84a650f4355a676e315ea039f0e Sep 21 16:30:32.342714 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Name: tempest-AttachVolumeNegativeTest-67026365-project Sep 21 16:30:32.342714 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: method: > Sep 21 16:30:32.342714 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: exception: Instance 591bdacc-1358-430f-961a-f648f5cf8e19 could not be found. Sep 21 16:30:32.342714 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: action_args: {'id': '591bdacc-1358-430f-961a-f648f5cf8e19'} Sep 21 16:30:32.343664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:30:32.343664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:30:32.343664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 16:30:32.343664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 16:30:32.343664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 16:30:32.343664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 16:30:32.343664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 16:30:32.343664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 16:30:32.343664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 16:30:32.343664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 16:30:32.343664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 591bdacc-1358-430f-961a-f648f5cf8e19 could not be found. Sep 21 16:30:32.343664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:30:32.343664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:30:32.343664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:30:32.343664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:30:32.343664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:30:32.343664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:30:32.343664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:30:32.343664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:30:32.343664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:30:32.345196 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:30:32.345196 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 21 16:30:32.345196 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 21 16:30:32.345196 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 21 16:30:32.345196 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 21 16:30:32.345196 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 16:30:32.345196 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 16:30:32.345196 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 16:30:32.345196 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:30:32.345196 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 591bdacc-1358-430f-961a-f648f5cf8e19 could not be found. Sep 21 16:30:32.345196 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:30:32.345196 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:30:32.345196 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:30:32.345196 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:30:32.345196 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:30:32.345196 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:30:32.345196 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:30:32.345196 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:30:32.345196 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 591bdacc-1358-430f-961a-f648f5cf8e19 could not be found. Sep 21 16:30:32.345196 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:30:32.347696 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-6586d10e-b7f3-4226-989b-ee2c1e3a5d8b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Returning 404 to user: Instance 591bdacc-1358-430f-961a-f648f5cf8e19 could not be found. {{(pid=120532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:30:32.348584 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-6586d10e-b7f3-4226-989b-ee2c1e3a5d8b tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "DELETE /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19" status: 404 len: 111 microversion: 2.1 time: 0.049692 Sep 21 16:30:32.349183 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 527/963] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Sep 21 16:30:32 2022] DELETE /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 16:30:32.358962 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-a99b59ab-959e-4102-af15-9bcd78e54f78 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:32.360775 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-a99b59ab-959e-4102-af15-9bcd78e54f78 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 591bdacc-1358-430f-961a-f648f5cf8e19] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:32.368681 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a99b59ab-959e-4102-af15-9bcd78e54f78 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:32.369428 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a99b59ab-959e-4102-af15-9bcd78e54f78 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:32.370020 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a99b59ab-959e-4102-af15-9bcd78e54f78 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:32.370926 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a99b59ab-959e-4102-af15-9bcd78e54f78 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:32.372251 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a99b59ab-959e-4102-af15-9bcd78e54f78 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:32.372880 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a99b59ab-959e-4102-af15-9bcd78e54f78 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:32.388674 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.wsgi [None req-a99b59ab-959e-4102-af15-9bcd78e54f78 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] HTTP exception thrown: Instance 591bdacc-1358-430f-961a-f648f5cf8e19 could not be found. Sep 21 16:30:32.390694 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-a99b59ab-959e-4102-af15-9bcd78e54f78 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Request method failure captured: Sep 21 16:30:32.390694 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: request: GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19 HTTP/1.1 Sep 21 16:30:32.390694 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept: application/json Sep 21 16:30:32.390694 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept-Encoding: identity Sep 21 16:30:32.390694 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Connection: close Sep 21 16:30:32.390694 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Length: 0 Sep 21 16:30:32.390694 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Type: application/json Sep 21 16:30:32.390694 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Host: 10.222.0.64 Sep 21 16:30:32.390694 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Openstack-System-Scope: None Sep 21 16:30:32.390694 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: User-Agent: python-urllib3/1.26.12 Sep 21 16:30:32.390694 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Auth-Token: gAAAAABjKzptDl5Jwme7JQaRL3V8XsiXvjsgkfXKC5CR9zEf_XxPd1NsWodDna8_dBwDJyu9_lHil_M0vLPPzmX177kcKqWx5X8mqOmQSrRLHHx1LRIv3gdLEkJSUiwMVF6fR-kEaNic5IQ5zuSAZa0555zHli7HQ0zguOZ1COKKRN-ARxj0HyM Sep 21 16:30:32.390694 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Id: None Sep 21 16:30:32.390694 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Name: None Sep 21 16:30:32.390694 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Identity-Status: Confirmed Sep 21 16:30:32.390694 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Is-Admin-Project: True Sep 21 16:30:32.390694 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Id: default Sep 21 16:30:32.390694 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Name: Default Sep 21 16:30:32.390694 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Id: ce7a3e77ddf14b48986752434dda6d33 Sep 21 16:30:32.390694 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Name: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:30:32.390694 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Role: member,reader Sep 21 16:30:32.390694 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Roles: member,reader Sep 21 16:30:32.392519 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce7a3e77ddf14b48986752434dda6d33"}]}] Sep 21 16:30:32.392519 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:30:32.392519 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Id: ce7a3e77ddf14b48986752434dda6d33 Sep 21 16:30:32.392519 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:30:32.392519 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User: tempest-AttachVolumeNegativeTest-67026365-project Sep 21 16:30:32.392519 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Id: default Sep 21 16:30:32.392519 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Name: Default Sep 21 16:30:32.392519 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Id: b917d84a650f4355a676e315ea039f0e Sep 21 16:30:32.392519 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Name: tempest-AttachVolumeNegativeTest-67026365-project Sep 21 16:30:32.392519 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: method: > Sep 21 16:30:32.392519 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: exception: Instance 591bdacc-1358-430f-961a-f648f5cf8e19 could not be found. Sep 21 16:30:32.392519 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: action_args: {'id': '591bdacc-1358-430f-961a-f648f5cf8e19'} Sep 21 16:30:32.393410 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:30:32.393410 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:30:32.393410 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 16:30:32.393410 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 16:30:32.393410 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 16:30:32.393410 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 16:30:32.393410 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 16:30:32.393410 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 16:30:32.393410 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 16:30:32.393410 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 16:30:32.393410 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 591bdacc-1358-430f-961a-f648f5cf8e19 could not be found. Sep 21 16:30:32.393410 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:30:32.393410 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:30:32.393410 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:30:32.393410 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:30:32.393410 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:30:32.393410 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:30:32.393410 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:30:32.393410 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:30:32.393410 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:30:32.394713 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:30:32.394713 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 16:30:32.394713 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 16:30:32.394713 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 16:30:32.394713 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 16:30:32.394713 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 16:30:32.394713 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:30:32.394713 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 591bdacc-1358-430f-961a-f648f5cf8e19 could not be found. Sep 21 16:30:32.394713 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:30:32.394713 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:30:32.394713 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:30:32.394713 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:30:32.394713 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:30:32.394713 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:30:32.394713 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:30:32.394713 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:30:32.394713 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 591bdacc-1358-430f-961a-f648f5cf8e19 could not be found. Sep 21 16:30:32.394713 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:30:32.395792 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-a99b59ab-959e-4102-af15-9bcd78e54f78 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Returning 404 to user: Instance 591bdacc-1358-430f-961a-f648f5cf8e19 could not be found. {{(pid=120531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:30:32.397096 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-a99b59ab-959e-4102-af15-9bcd78e54f78 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19" status: 404 len: 111 microversion: 2.1 time: 0.043341 Sep 21 16:30:32.398033 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 437/964] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:30:32 2022] GET /compute/v2.1/servers/591bdacc-1358-430f-961a-f648f5cf8e19 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 16:30:33.599318 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-28c89966-eba4-4505-b113-43ad9acc5963 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:33.599847 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-28c89966-eba4-4505-b113-43ad9acc5963 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 608e4231-8635-45db-b2d6-6b0710c3120f] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:33.609274 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-28c89966-eba4-4505-b113-43ad9acc5963 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:33.609762 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-28c89966-eba4-4505-b113-43ad9acc5963 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:33.610610 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-28c89966-eba4-4505-b113-43ad9acc5963 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:33.611468 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-28c89966-eba4-4505-b113-43ad9acc5963 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:33.611929 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-28c89966-eba4-4505-b113-43ad9acc5963 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:33.612353 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-28c89966-eba4-4505-b113-43ad9acc5963 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:33.630555 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.wsgi [None req-28c89966-eba4-4505-b113-43ad9acc5963 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] HTTP exception thrown: Instance 608e4231-8635-45db-b2d6-6b0710c3120f could not be found. Sep 21 16:30:33.632770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-28c89966-eba4-4505-b113-43ad9acc5963 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Request method failure captured: Sep 21 16:30:33.632770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: request: DELETE /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f HTTP/1.1 Sep 21 16:30:33.632770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept: application/json Sep 21 16:30:33.632770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept-Encoding: identity Sep 21 16:30:33.632770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Connection: close Sep 21 16:30:33.632770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Length: 0 Sep 21 16:30:33.632770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Type: application/json Sep 21 16:30:33.632770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Host: 10.222.0.64 Sep 21 16:30:33.632770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Openstack-System-Scope: None Sep 21 16:30:33.632770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: User-Agent: python-urllib3/1.26.12 Sep 21 16:30:33.632770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Auth-Token: gAAAAABjKzptDl5Jwme7JQaRL3V8XsiXvjsgkfXKC5CR9zEf_XxPd1NsWodDna8_dBwDJyu9_lHil_M0vLPPzmX177kcKqWx5X8mqOmQSrRLHHx1LRIv3gdLEkJSUiwMVF6fR-kEaNic5IQ5zuSAZa0555zHli7HQ0zguOZ1COKKRN-ARxj0HyM Sep 21 16:30:33.632770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Id: None Sep 21 16:30:33.632770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Name: None Sep 21 16:30:33.632770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Identity-Status: Confirmed Sep 21 16:30:33.632770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Is-Admin-Project: True Sep 21 16:30:33.632770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Id: default Sep 21 16:30:33.632770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Name: Default Sep 21 16:30:33.632770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Id: ce7a3e77ddf14b48986752434dda6d33 Sep 21 16:30:33.632770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Name: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:30:33.632770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Role: member,reader Sep 21 16:30:33.632770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Roles: member,reader Sep 21 16:30:33.634571 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce7a3e77ddf14b48986752434dda6d33"}]}] Sep 21 16:30:33.634571 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:30:33.634571 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Id: ce7a3e77ddf14b48986752434dda6d33 Sep 21 16:30:33.634571 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:30:33.634571 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User: tempest-AttachVolumeNegativeTest-67026365-project Sep 21 16:30:33.634571 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Id: default Sep 21 16:30:33.634571 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Name: Default Sep 21 16:30:33.634571 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Id: b917d84a650f4355a676e315ea039f0e Sep 21 16:30:33.634571 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Name: tempest-AttachVolumeNegativeTest-67026365-project Sep 21 16:30:33.634571 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: method: > Sep 21 16:30:33.634571 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: exception: Instance 608e4231-8635-45db-b2d6-6b0710c3120f could not be found. Sep 21 16:30:33.634571 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: action_args: {'id': '608e4231-8635-45db-b2d6-6b0710c3120f'} Sep 21 16:30:33.635476 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:30:33.635476 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:30:33.635476 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 16:30:33.635476 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 16:30:33.635476 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 16:30:33.635476 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 16:30:33.635476 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 16:30:33.635476 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 16:30:33.635476 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 16:30:33.635476 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 16:30:33.635476 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 608e4231-8635-45db-b2d6-6b0710c3120f could not be found. Sep 21 16:30:33.635476 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:30:33.635476 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:30:33.635476 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:30:33.635476 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:30:33.635476 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:30:33.635476 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:30:33.635476 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:30:33.635476 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:30:33.635476 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:30:33.636927 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:30:33.636927 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 21 16:30:33.636927 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 21 16:30:33.636927 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 21 16:30:33.636927 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 21 16:30:33.636927 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 16:30:33.636927 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 16:30:33.636927 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 16:30:33.636927 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:30:33.636927 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 608e4231-8635-45db-b2d6-6b0710c3120f could not be found. Sep 21 16:30:33.636927 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:30:33.636927 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:30:33.636927 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:30:33.636927 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:30:33.636927 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:30:33.636927 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:30:33.636927 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:30:33.636927 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:30:33.636927 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 608e4231-8635-45db-b2d6-6b0710c3120f could not be found. Sep 21 16:30:33.636927 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:30:33.638271 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-28c89966-eba4-4505-b113-43ad9acc5963 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Returning 404 to user: Instance 608e4231-8635-45db-b2d6-6b0710c3120f could not be found. {{(pid=120532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:30:33.638271 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-28c89966-eba4-4505-b113-43ad9acc5963 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "DELETE /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f" status: 404 len: 111 microversion: 2.1 time: 0.043613 Sep 21 16:30:33.638271 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 528/965] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Sep 21 16:30:33 2022] DELETE /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 16:30:33.647287 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-1572b41a-02ad-4de5-bc8c-951ddaf564a6 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:33.647905 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-1572b41a-02ad-4de5-bc8c-951ddaf564a6 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 608e4231-8635-45db-b2d6-6b0710c3120f] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:33.655190 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1572b41a-02ad-4de5-bc8c-951ddaf564a6 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:33.655878 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1572b41a-02ad-4de5-bc8c-951ddaf564a6 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:33.656389 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1572b41a-02ad-4de5-bc8c-951ddaf564a6 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:33.657107 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1572b41a-02ad-4de5-bc8c-951ddaf564a6 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:33.657558 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1572b41a-02ad-4de5-bc8c-951ddaf564a6 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:33.657977 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1572b41a-02ad-4de5-bc8c-951ddaf564a6 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:33.673304 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.wsgi [None req-1572b41a-02ad-4de5-bc8c-951ddaf564a6 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] HTTP exception thrown: Instance 608e4231-8635-45db-b2d6-6b0710c3120f could not be found. Sep 21 16:30:33.674848 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-1572b41a-02ad-4de5-bc8c-951ddaf564a6 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Request method failure captured: Sep 21 16:30:33.674848 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: request: GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f HTTP/1.1 Sep 21 16:30:33.674848 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept: application/json Sep 21 16:30:33.674848 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept-Encoding: identity Sep 21 16:30:33.674848 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Connection: close Sep 21 16:30:33.674848 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Length: 0 Sep 21 16:30:33.674848 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Type: application/json Sep 21 16:30:33.674848 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Host: 10.222.0.64 Sep 21 16:30:33.674848 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Openstack-System-Scope: None Sep 21 16:30:33.674848 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: User-Agent: python-urllib3/1.26.12 Sep 21 16:30:33.674848 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Auth-Token: gAAAAABjKzptDl5Jwme7JQaRL3V8XsiXvjsgkfXKC5CR9zEf_XxPd1NsWodDna8_dBwDJyu9_lHil_M0vLPPzmX177kcKqWx5X8mqOmQSrRLHHx1LRIv3gdLEkJSUiwMVF6fR-kEaNic5IQ5zuSAZa0555zHli7HQ0zguOZ1COKKRN-ARxj0HyM Sep 21 16:30:33.674848 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Id: None Sep 21 16:30:33.674848 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Name: None Sep 21 16:30:33.674848 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Identity-Status: Confirmed Sep 21 16:30:33.674848 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Is-Admin-Project: True Sep 21 16:30:33.674848 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Id: default Sep 21 16:30:33.674848 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Name: Default Sep 21 16:30:33.674848 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Id: ce7a3e77ddf14b48986752434dda6d33 Sep 21 16:30:33.674848 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Name: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:30:33.674848 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Role: member,reader Sep 21 16:30:33.674848 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Roles: member,reader Sep 21 16:30:33.676580 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce7a3e77ddf14b48986752434dda6d33"}]}] Sep 21 16:30:33.676580 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:30:33.676580 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Id: ce7a3e77ddf14b48986752434dda6d33 Sep 21 16:30:33.676580 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:30:33.676580 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User: tempest-AttachVolumeNegativeTest-67026365-project Sep 21 16:30:33.676580 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Id: default Sep 21 16:30:33.676580 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Name: Default Sep 21 16:30:33.676580 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Id: b917d84a650f4355a676e315ea039f0e Sep 21 16:30:33.676580 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Name: tempest-AttachVolumeNegativeTest-67026365-project Sep 21 16:30:33.676580 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: method: > Sep 21 16:30:33.676580 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: exception: Instance 608e4231-8635-45db-b2d6-6b0710c3120f could not be found. Sep 21 16:30:33.676580 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: action_args: {'id': '608e4231-8635-45db-b2d6-6b0710c3120f'} Sep 21 16:30:33.679242 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:30:33.679242 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:30:33.679242 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 16:30:33.679242 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 16:30:33.679242 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 16:30:33.679242 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 16:30:33.679242 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 16:30:33.679242 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 16:30:33.679242 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 16:30:33.679242 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 16:30:33.679242 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 608e4231-8635-45db-b2d6-6b0710c3120f could not be found. Sep 21 16:30:33.679242 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:30:33.679242 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:30:33.679242 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:30:33.679242 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:30:33.679242 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:30:33.679242 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:30:33.679242 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:30:33.679242 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:30:33.679242 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:30:33.681252 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:30:33.681252 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 16:30:33.681252 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 16:30:33.681252 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 16:30:33.681252 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 16:30:33.681252 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 16:30:33.681252 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:30:33.681252 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 608e4231-8635-45db-b2d6-6b0710c3120f could not be found. Sep 21 16:30:33.681252 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:30:33.681252 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:30:33.681252 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:30:33.681252 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:30:33.681252 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:30:33.681252 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:30:33.681252 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:30:33.681252 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:30:33.681252 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 608e4231-8635-45db-b2d6-6b0710c3120f could not be found. Sep 21 16:30:33.681252 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:30:33.682868 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-1572b41a-02ad-4de5-bc8c-951ddaf564a6 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Returning 404 to user: Instance 608e4231-8635-45db-b2d6-6b0710c3120f could not be found. {{(pid=120531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:30:33.682868 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-1572b41a-02ad-4de5-bc8c-951ddaf564a6 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f" status: 404 len: 111 microversion: 2.1 time: 0.034337 Sep 21 16:30:33.682868 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 438/966] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:30:33 2022] GET /compute/v2.1/servers/608e4231-8635-45db-b2d6-6b0710c3120f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 16:30:33.686207 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-553bebb4-dcee-444b-a7ed-078ec9036534 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:33.686706 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-553bebb4-dcee-444b-a7ed-078ec9036534 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 7ffeddb1-1776-4585-9f48-3920444b4b18] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:33.695513 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-553bebb4-dcee-444b-a7ed-078ec9036534 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:33.696000 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-553bebb4-dcee-444b-a7ed-078ec9036534 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:33.696442 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-553bebb4-dcee-444b-a7ed-078ec9036534 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:33.697160 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-553bebb4-dcee-444b-a7ed-078ec9036534 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:33.698699 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-553bebb4-dcee-444b-a7ed-078ec9036534 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:33.699150 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-553bebb4-dcee-444b-a7ed-078ec9036534 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:33.717320 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.wsgi [None req-553bebb4-dcee-444b-a7ed-078ec9036534 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] HTTP exception thrown: Instance 7ffeddb1-1776-4585-9f48-3920444b4b18 could not be found. Sep 21 16:30:33.719179 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-553bebb4-dcee-444b-a7ed-078ec9036534 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Request method failure captured: Sep 21 16:30:33.719179 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: request: DELETE /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18 HTTP/1.1 Sep 21 16:30:33.719179 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept: application/json Sep 21 16:30:33.719179 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept-Encoding: identity Sep 21 16:30:33.719179 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Connection: close Sep 21 16:30:33.719179 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Length: 0 Sep 21 16:30:33.719179 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Type: application/json Sep 21 16:30:33.719179 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Host: 10.222.0.64 Sep 21 16:30:33.719179 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Openstack-System-Scope: None Sep 21 16:30:33.719179 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: User-Agent: python-urllib3/1.26.12 Sep 21 16:30:33.719179 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Auth-Token: gAAAAABjKzptDl5Jwme7JQaRL3V8XsiXvjsgkfXKC5CR9zEf_XxPd1NsWodDna8_dBwDJyu9_lHil_M0vLPPzmX177kcKqWx5X8mqOmQSrRLHHx1LRIv3gdLEkJSUiwMVF6fR-kEaNic5IQ5zuSAZa0555zHli7HQ0zguOZ1COKKRN-ARxj0HyM Sep 21 16:30:33.719179 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Id: None Sep 21 16:30:33.719179 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Name: None Sep 21 16:30:33.719179 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Identity-Status: Confirmed Sep 21 16:30:33.719179 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Is-Admin-Project: True Sep 21 16:30:33.719179 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Id: default Sep 21 16:30:33.719179 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Name: Default Sep 21 16:30:33.719179 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Id: ce7a3e77ddf14b48986752434dda6d33 Sep 21 16:30:33.719179 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Name: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:30:33.719179 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Role: member,reader Sep 21 16:30:33.719179 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Roles: member,reader Sep 21 16:30:33.720809 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce7a3e77ddf14b48986752434dda6d33"}]}] Sep 21 16:30:33.720809 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:30:33.720809 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Id: ce7a3e77ddf14b48986752434dda6d33 Sep 21 16:30:33.720809 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:30:33.720809 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User: tempest-AttachVolumeNegativeTest-67026365-project Sep 21 16:30:33.720809 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Id: default Sep 21 16:30:33.720809 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Name: Default Sep 21 16:30:33.720809 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Id: b917d84a650f4355a676e315ea039f0e Sep 21 16:30:33.720809 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Name: tempest-AttachVolumeNegativeTest-67026365-project Sep 21 16:30:33.720809 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: method: > Sep 21 16:30:33.720809 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: exception: Instance 7ffeddb1-1776-4585-9f48-3920444b4b18 could not be found. Sep 21 16:30:33.720809 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: action_args: {'id': '7ffeddb1-1776-4585-9f48-3920444b4b18'} Sep 21 16:30:33.721676 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:30:33.721676 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:30:33.721676 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 16:30:33.721676 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 16:30:33.721676 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 16:30:33.721676 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 16:30:33.721676 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 16:30:33.721676 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 16:30:33.721676 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 16:30:33.721676 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 16:30:33.721676 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ffeddb1-1776-4585-9f48-3920444b4b18 could not be found. Sep 21 16:30:33.721676 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:30:33.721676 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:30:33.721676 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:30:33.721676 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:30:33.721676 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:30:33.721676 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:30:33.721676 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:30:33.721676 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:30:33.721676 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:30:33.723313 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:30:33.723313 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 21 16:30:33.723313 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 21 16:30:33.723313 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 21 16:30:33.723313 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 21 16:30:33.723313 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 16:30:33.723313 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 16:30:33.723313 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 16:30:33.723313 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:30:33.723313 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ffeddb1-1776-4585-9f48-3920444b4b18 could not be found. Sep 21 16:30:33.723313 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:30:33.723313 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:30:33.723313 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:30:33.723313 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:30:33.723313 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:30:33.723313 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:30:33.723313 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:30:33.723313 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:30:33.723313 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ffeddb1-1776-4585-9f48-3920444b4b18 could not be found. Sep 21 16:30:33.723313 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:30:33.724805 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-553bebb4-dcee-444b-a7ed-078ec9036534 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Returning 404 to user: Instance 7ffeddb1-1776-4585-9f48-3920444b4b18 could not be found. {{(pid=120532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:30:33.724805 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-553bebb4-dcee-444b-a7ed-078ec9036534 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "DELETE /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18" status: 404 len: 111 microversion: 2.1 time: 0.038872 Sep 21 16:30:33.724805 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 529/967] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Sep 21 16:30:33 2022] DELETE /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 16:30:33.735077 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d3aca78d-8891-4f64-a9e0-5686b37d5671 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:33.735692 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d3aca78d-8891-4f64-a9e0-5686b37d5671 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 7ffeddb1-1776-4585-9f48-3920444b4b18] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:33.745935 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d3aca78d-8891-4f64-a9e0-5686b37d5671 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:33.746635 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d3aca78d-8891-4f64-a9e0-5686b37d5671 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:33.747048 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d3aca78d-8891-4f64-a9e0-5686b37d5671 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:33.748041 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d3aca78d-8891-4f64-a9e0-5686b37d5671 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:33.748833 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d3aca78d-8891-4f64-a9e0-5686b37d5671 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:33.749596 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d3aca78d-8891-4f64-a9e0-5686b37d5671 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:33.769504 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.wsgi [None req-d3aca78d-8891-4f64-a9e0-5686b37d5671 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] HTTP exception thrown: Instance 7ffeddb1-1776-4585-9f48-3920444b4b18 could not be found. Sep 21 16:30:33.771311 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d3aca78d-8891-4f64-a9e0-5686b37d5671 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Request method failure captured: Sep 21 16:30:33.771311 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: request: GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18 HTTP/1.1 Sep 21 16:30:33.771311 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept: application/json Sep 21 16:30:33.771311 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept-Encoding: identity Sep 21 16:30:33.771311 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Connection: close Sep 21 16:30:33.771311 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Length: 0 Sep 21 16:30:33.771311 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Type: application/json Sep 21 16:30:33.771311 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Host: 10.222.0.64 Sep 21 16:30:33.771311 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Openstack-System-Scope: None Sep 21 16:30:33.771311 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: User-Agent: python-urllib3/1.26.12 Sep 21 16:30:33.771311 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Auth-Token: gAAAAABjKzptDl5Jwme7JQaRL3V8XsiXvjsgkfXKC5CR9zEf_XxPd1NsWodDna8_dBwDJyu9_lHil_M0vLPPzmX177kcKqWx5X8mqOmQSrRLHHx1LRIv3gdLEkJSUiwMVF6fR-kEaNic5IQ5zuSAZa0555zHli7HQ0zguOZ1COKKRN-ARxj0HyM Sep 21 16:30:33.771311 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Id: None Sep 21 16:30:33.771311 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Name: None Sep 21 16:30:33.771311 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Identity-Status: Confirmed Sep 21 16:30:33.771311 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Is-Admin-Project: True Sep 21 16:30:33.771311 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Id: default Sep 21 16:30:33.771311 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Name: Default Sep 21 16:30:33.771311 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Id: ce7a3e77ddf14b48986752434dda6d33 Sep 21 16:30:33.771311 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Name: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:30:33.771311 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Role: member,reader Sep 21 16:30:33.771311 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Roles: member,reader Sep 21 16:30:33.772974 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce7a3e77ddf14b48986752434dda6d33"}]}] Sep 21 16:30:33.772974 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:30:33.772974 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Id: ce7a3e77ddf14b48986752434dda6d33 Sep 21 16:30:33.772974 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:30:33.772974 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User: tempest-AttachVolumeNegativeTest-67026365-project Sep 21 16:30:33.772974 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Id: default Sep 21 16:30:33.772974 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Name: Default Sep 21 16:30:33.772974 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Id: b917d84a650f4355a676e315ea039f0e Sep 21 16:30:33.772974 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Name: tempest-AttachVolumeNegativeTest-67026365-project Sep 21 16:30:33.772974 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: method: > Sep 21 16:30:33.772974 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: exception: Instance 7ffeddb1-1776-4585-9f48-3920444b4b18 could not be found. Sep 21 16:30:33.772974 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: action_args: {'id': '7ffeddb1-1776-4585-9f48-3920444b4b18'} Sep 21 16:30:33.773739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:30:33.773739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:30:33.773739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 16:30:33.773739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 16:30:33.773739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 16:30:33.773739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 16:30:33.773739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 16:30:33.773739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 16:30:33.773739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 16:30:33.773739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 16:30:33.773739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ffeddb1-1776-4585-9f48-3920444b4b18 could not be found. Sep 21 16:30:33.773739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:30:33.773739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:30:33.773739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:30:33.773739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:30:33.773739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:30:33.773739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:30:33.773739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:30:33.773739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:30:33.773739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:30:33.775066 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:30:33.775066 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 16:30:33.775066 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 16:30:33.775066 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 16:30:33.775066 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 16:30:33.775066 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 16:30:33.775066 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:30:33.775066 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ffeddb1-1776-4585-9f48-3920444b4b18 could not be found. Sep 21 16:30:33.775066 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:30:33.775066 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:30:33.775066 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:30:33.775066 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:30:33.775066 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:30:33.775066 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:30:33.775066 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:30:33.775066 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:30:33.775066 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ffeddb1-1776-4585-9f48-3920444b4b18 could not be found. Sep 21 16:30:33.775066 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:30:33.777538 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d3aca78d-8891-4f64-a9e0-5686b37d5671 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Returning 404 to user: Instance 7ffeddb1-1776-4585-9f48-3920444b4b18 could not be found. {{(pid=120531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:30:33.779187 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d3aca78d-8891-4f64-a9e0-5686b37d5671 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18" status: 404 len: 111 microversion: 2.1 time: 0.052382 Sep 21 16:30:33.779960 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 439/968] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:30:33 2022] GET /compute/v2.1/servers/7ffeddb1-1776-4585-9f48-3920444b4b18 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 16:30:34.965782 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-4ed8e808-5526-4bc3-9c1e-266c7b4564a7 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:34.966385 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-4ed8e808-5526-4bc3-9c1e-266c7b4564a7 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:34.974273 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4ed8e808-5526-4bc3-9c1e-266c7b4564a7 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:34.975752 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4ed8e808-5526-4bc3-9c1e-266c7b4564a7 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:34.976362 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4ed8e808-5526-4bc3-9c1e-266c7b4564a7 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:34.977334 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4ed8e808-5526-4bc3-9c1e-266c7b4564a7 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:34.978132 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4ed8e808-5526-4bc3-9c1e-266c7b4564a7 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:34.978538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4ed8e808-5526-4bc3-9c1e-266c7b4564a7 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:34.995824 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.wsgi [None req-4ed8e808-5526-4bc3-9c1e-266c7b4564a7 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] HTTP exception thrown: Instance 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 could not be found. Sep 21 16:30:34.997433 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-4ed8e808-5526-4bc3-9c1e-266c7b4564a7 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Request method failure captured: Sep 21 16:30:34.997433 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: request: DELETE /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 HTTP/1.1 Sep 21 16:30:34.997433 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept: application/json Sep 21 16:30:34.997433 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept-Encoding: identity Sep 21 16:30:34.997433 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Connection: close Sep 21 16:30:34.997433 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Length: 0 Sep 21 16:30:34.997433 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Type: application/json Sep 21 16:30:34.997433 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Host: 10.222.0.64 Sep 21 16:30:34.997433 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Openstack-System-Scope: None Sep 21 16:30:34.997433 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: User-Agent: python-urllib3/1.26.12 Sep 21 16:30:34.997433 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Auth-Token: gAAAAABjKzptDl5Jwme7JQaRL3V8XsiXvjsgkfXKC5CR9zEf_XxPd1NsWodDna8_dBwDJyu9_lHil_M0vLPPzmX177kcKqWx5X8mqOmQSrRLHHx1LRIv3gdLEkJSUiwMVF6fR-kEaNic5IQ5zuSAZa0555zHli7HQ0zguOZ1COKKRN-ARxj0HyM Sep 21 16:30:34.997433 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Id: None Sep 21 16:30:34.997433 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Name: None Sep 21 16:30:34.997433 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Identity-Status: Confirmed Sep 21 16:30:34.997433 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Is-Admin-Project: True Sep 21 16:30:34.997433 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Id: default Sep 21 16:30:34.997433 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Name: Default Sep 21 16:30:34.997433 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Id: ce7a3e77ddf14b48986752434dda6d33 Sep 21 16:30:34.997433 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Name: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:30:34.997433 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Role: member,reader Sep 21 16:30:34.997433 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Roles: member,reader Sep 21 16:30:34.999171 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce7a3e77ddf14b48986752434dda6d33"}]}] Sep 21 16:30:34.999171 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:30:34.999171 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Id: ce7a3e77ddf14b48986752434dda6d33 Sep 21 16:30:34.999171 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:30:34.999171 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User: tempest-AttachVolumeNegativeTest-67026365-project Sep 21 16:30:34.999171 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Id: default Sep 21 16:30:34.999171 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Name: Default Sep 21 16:30:34.999171 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Id: b917d84a650f4355a676e315ea039f0e Sep 21 16:30:34.999171 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Name: tempest-AttachVolumeNegativeTest-67026365-project Sep 21 16:30:34.999171 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: method: > Sep 21 16:30:34.999171 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: exception: Instance 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 could not be found. Sep 21 16:30:34.999171 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: action_args: {'id': '72c89a30-cc9f-472e-9fa3-8ad2f7c36b77'} Sep 21 16:30:35.000034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:30:35.000034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:30:35.000034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 16:30:35.000034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 16:30:35.000034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 16:30:35.000034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 16:30:35.000034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 16:30:35.000034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 16:30:35.000034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 16:30:35.000034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 16:30:35.000034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 could not be found. Sep 21 16:30:35.000034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:30:35.000034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:30:35.000034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:30:35.000034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:30:35.000034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:30:35.000034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:30:35.000034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:30:35.000034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:30:35.000034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:30:35.001413 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:30:35.001413 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 21 16:30:35.001413 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 21 16:30:35.001413 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 21 16:30:35.001413 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 21 16:30:35.001413 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 16:30:35.001413 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 16:30:35.001413 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 16:30:35.001413 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:30:35.001413 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 could not be found. Sep 21 16:30:35.001413 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:30:35.001413 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:30:35.001413 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:30:35.001413 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:30:35.001413 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:30:35.001413 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:30:35.001413 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:30:35.001413 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:30:35.001413 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 could not be found. Sep 21 16:30:35.001413 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:30:35.004333 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-4ed8e808-5526-4bc3-9c1e-266c7b4564a7 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Returning 404 to user: Instance 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 could not be found. {{(pid=120532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:30:35.005206 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-4ed8e808-5526-4bc3-9c1e-266c7b4564a7 tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "DELETE /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77" status: 404 len: 111 microversion: 2.1 time: 0.043905 Sep 21 16:30:35.005777 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 530/969] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Sep 21 16:30:34 2022] DELETE /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 16:30:35.018152 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-3e5d6ed2-2d15-4f5a-bb10-326bd55810fc tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:35.019734 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-3e5d6ed2-2d15-4f5a-bb10-326bd55810fc tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] [instance: 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:35.027240 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3e5d6ed2-2d15-4f5a-bb10-326bd55810fc tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:35.028306 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3e5d6ed2-2d15-4f5a-bb10-326bd55810fc tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:35.029080 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3e5d6ed2-2d15-4f5a-bb10-326bd55810fc tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:35.030195 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3e5d6ed2-2d15-4f5a-bb10-326bd55810fc tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:35.031009 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3e5d6ed2-2d15-4f5a-bb10-326bd55810fc tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:35.031661 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3e5d6ed2-2d15-4f5a-bb10-326bd55810fc tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:35.049107 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.wsgi [None req-3e5d6ed2-2d15-4f5a-bb10-326bd55810fc tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] HTTP exception thrown: Instance 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 could not be found. Sep 21 16:30:35.051055 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-3e5d6ed2-2d15-4f5a-bb10-326bd55810fc tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Request method failure captured: Sep 21 16:30:35.051055 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: request: GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 HTTP/1.1 Sep 21 16:30:35.051055 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept: application/json Sep 21 16:30:35.051055 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept-Encoding: identity Sep 21 16:30:35.051055 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Connection: close Sep 21 16:30:35.051055 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Length: 0 Sep 21 16:30:35.051055 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Type: application/json Sep 21 16:30:35.051055 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Host: 10.222.0.64 Sep 21 16:30:35.051055 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Openstack-System-Scope: None Sep 21 16:30:35.051055 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: User-Agent: python-urllib3/1.26.12 Sep 21 16:30:35.051055 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Auth-Token: gAAAAABjKzptDl5Jwme7JQaRL3V8XsiXvjsgkfXKC5CR9zEf_XxPd1NsWodDna8_dBwDJyu9_lHil_M0vLPPzmX177kcKqWx5X8mqOmQSrRLHHx1LRIv3gdLEkJSUiwMVF6fR-kEaNic5IQ5zuSAZa0555zHli7HQ0zguOZ1COKKRN-ARxj0HyM Sep 21 16:30:35.051055 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Id: None Sep 21 16:30:35.051055 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Name: None Sep 21 16:30:35.051055 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Identity-Status: Confirmed Sep 21 16:30:35.051055 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Is-Admin-Project: True Sep 21 16:30:35.051055 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Id: default Sep 21 16:30:35.051055 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Name: Default Sep 21 16:30:35.051055 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Id: ce7a3e77ddf14b48986752434dda6d33 Sep 21 16:30:35.051055 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Name: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:30:35.051055 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Role: member,reader Sep 21 16:30:35.051055 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Roles: member,reader Sep 21 16:30:35.052398 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ce7a3e77ddf14b48986752434dda6d33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce7a3e77ddf14b48986752434dda6d33"}]}] Sep 21 16:30:35.052398 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:30:35.052398 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Id: ce7a3e77ddf14b48986752434dda6d33 Sep 21 16:30:35.052398 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-67026365 Sep 21 16:30:35.052398 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User: tempest-AttachVolumeNegativeTest-67026365-project Sep 21 16:30:35.052398 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Id: default Sep 21 16:30:35.052398 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Name: Default Sep 21 16:30:35.052398 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Id: b917d84a650f4355a676e315ea039f0e Sep 21 16:30:35.052398 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Name: tempest-AttachVolumeNegativeTest-67026365-project Sep 21 16:30:35.052398 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: method: > Sep 21 16:30:35.052398 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: exception: Instance 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 could not be found. Sep 21 16:30:35.052398 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: action_args: {'id': '72c89a30-cc9f-472e-9fa3-8ad2f7c36b77'} Sep 21 16:30:35.053149 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:30:35.053149 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:30:35.053149 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 16:30:35.053149 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 16:30:35.053149 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 16:30:35.053149 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 16:30:35.053149 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 16:30:35.053149 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 16:30:35.053149 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 16:30:35.053149 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 16:30:35.053149 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 could not be found. Sep 21 16:30:35.053149 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:30:35.053149 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:30:35.053149 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:30:35.053149 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:30:35.053149 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:30:35.053149 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:30:35.053149 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:30:35.053149 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:30:35.053149 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:30:35.054393 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:30:35.054393 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 16:30:35.054393 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 16:30:35.054393 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 16:30:35.054393 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 16:30:35.054393 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 16:30:35.054393 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:30:35.054393 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 could not be found. Sep 21 16:30:35.054393 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:30:35.054393 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:30:35.054393 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:30:35.054393 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:30:35.054393 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:30:35.054393 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:30:35.054393 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:30:35.054393 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:30:35.054393 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 could not be found. Sep 21 16:30:35.054393 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:30:35.056603 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-3e5d6ed2-2d15-4f5a-bb10-326bd55810fc tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] Returning 404 to user: Instance 72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 could not be found. {{(pid=120531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:30:35.057468 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-3e5d6ed2-2d15-4f5a-bb10-326bd55810fc tempest-AttachVolumeNegativeTest-67026365 tempest-AttachVolumeNegativeTest-67026365-project] 10.222.0.64 "GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77" status: 404 len: 111 microversion: 2.1 time: 0.046583 Sep 21 16:30:35.066188 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 440/970] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:30:35 2022] GET /compute/v2.1/servers/72c89a30-cc9f-472e-9fa3-8ad2f7c36b77 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 16:30:59.471154 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-5dba5522-7448-4749-aa14-c4502639acdd tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:59.473429 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-5dba5522-7448-4749-aa14-c4502639acdd tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:59.475742 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_api:SELECT=41 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:30:59.476404 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=91 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:30:59.481801 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5dba5522-7448-4749-aa14-c4502639acdd tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:59.483079 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5dba5522-7448-4749-aa14-c4502639acdd tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:59.483079 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5dba5522-7448-4749-aa14-c4502639acdd tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:59.483723 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5dba5522-7448-4749-aa14-c4502639acdd tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:59.483983 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5dba5522-7448-4749-aa14-c4502639acdd tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:59.484317 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5dba5522-7448-4749-aa14-c4502639acdd tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:59.516583 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-5dba5522-7448-4749-aa14-c4502639acdd tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049350 Sep 21 16:30:59.517160 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 531/971] 10.222.0.64 () {60 vars in 1343 bytes} [Wed Sep 21 16:30:59 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:30:59.581073 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-8f280f32-0ae1-4835-8afa-992a7326b165 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:59.581959 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-8f280f32-0ae1-4835-8afa-992a7326b165 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:59.584325 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:30:59.584978 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=85,nova_cell1:INSERT=3 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:30:59.592709 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8f280f32-0ae1-4835-8afa-992a7326b165 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:59.593304 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8f280f32-0ae1-4835-8afa-992a7326b165 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:59.593741 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8f280f32-0ae1-4835-8afa-992a7326b165 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:59.594479 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8f280f32-0ae1-4835-8afa-992a7326b165 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:59.594950 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8f280f32-0ae1-4835-8afa-992a7326b165 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:59.595432 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8f280f32-0ae1-4835-8afa-992a7326b165 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:59.624628 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-8f280f32-0ae1-4835-8afa-992a7326b165 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Going to try to terminate instance {{(pid=120531) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 16:30:59.708320 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-8f280f32-0ae1-4835-8afa-992a7326b165 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "DELETE /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 204 len: 0 microversion: 2.20 time: 0.130737 Sep 21 16:30:59.708841 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 441/972] 10.222.0.64 () {60 vars in 1280 bytes} [Wed Sep 21 16:30:59 2022] DELETE /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 21 16:30:59.717958 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-482c7eb2-1dc0-4e66-aebd-98d052a17836 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:30:59.718881 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-482c7eb2-1dc0-4e66-aebd-98d052a17836 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:30:59.727047 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-482c7eb2-1dc0-4e66-aebd-98d052a17836 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:59.727536 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-482c7eb2-1dc0-4e66-aebd-98d052a17836 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:59.727987 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-482c7eb2-1dc0-4e66-aebd-98d052a17836 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:59.728701 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-482c7eb2-1dc0-4e66-aebd-98d052a17836 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:30:59.729156 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-482c7eb2-1dc0-4e66-aebd-98d052a17836 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:30:59.729577 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-482c7eb2-1dc0-4e66-aebd-98d052a17836 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:30:59.871778 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-482c7eb2-1dc0-4e66-aebd-98d052a17836 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:59.880517 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-482c7eb2-1dc0-4e66-aebd-98d052a17836 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:59.882018 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-482c7eb2-1dc0-4e66-aebd-98d052a17836 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:30:59.883272 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-482c7eb2-1dc0-4e66-aebd-98d052a17836 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1722 microversion: 2.20 time: 0.169873 Sep 21 16:30:59.884098 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 532/973] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:30:59 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 21 16:31:00.911559 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-f1a06df7-21e3-4ff7-a100-a3225549c1cc tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:31:00.912653 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-f1a06df7-21e3-4ff7-a100-a3225549c1cc tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:31:00.919576 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f1a06df7-21e3-4ff7-a100-a3225549c1cc tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:31:00.919728 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f1a06df7-21e3-4ff7-a100-a3225549c1cc tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:31:00.920132 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f1a06df7-21e3-4ff7-a100-a3225549c1cc tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:31:00.920835 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f1a06df7-21e3-4ff7-a100-a3225549c1cc tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:31:00.921285 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f1a06df7-21e3-4ff7-a100-a3225549c1cc tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:31:00.921697 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f1a06df7-21e3-4ff7-a100-a3225549c1cc tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:31:01.095107 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-f1a06df7-21e3-4ff7-a100-a3225549c1cc tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:31:01.104114 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-f1a06df7-21e3-4ff7-a100-a3225549c1cc tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:31:01.105754 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-f1a06df7-21e3-4ff7-a100-a3225549c1cc tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:31:01.107622 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-f1a06df7-21e3-4ff7-a100-a3225549c1cc tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1722 microversion: 2.20 time: 0.200337 Sep 21 16:31:01.108286 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 442/974] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:31:00 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:31:02.140428 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-39af192f-22dd-4a63-91e0-e0abe100ebb3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:31:02.141759 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-39af192f-22dd-4a63-91e0-e0abe100ebb3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:31:02.152862 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-39af192f-22dd-4a63-91e0-e0abe100ebb3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:31:02.153945 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-39af192f-22dd-4a63-91e0-e0abe100ebb3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:31:02.155052 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-39af192f-22dd-4a63-91e0-e0abe100ebb3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:31:02.156745 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-39af192f-22dd-4a63-91e0-e0abe100ebb3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:31:02.157547 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-39af192f-22dd-4a63-91e0-e0abe100ebb3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:31:02.158592 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-39af192f-22dd-4a63-91e0-e0abe100ebb3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:31:02.288811 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-39af192f-22dd-4a63-91e0-e0abe100ebb3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:31:02.299392 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-39af192f-22dd-4a63-91e0-e0abe100ebb3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:31:02.302898 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-39af192f-22dd-4a63-91e0-e0abe100ebb3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '617ba5f9896b457f8182f760ed44aa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d61f0fe37cf4dc0ba6a2415ddf14518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:31:02.304610 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-39af192f-22dd-4a63-91e0-e0abe100ebb3 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 200 len: 1656 microversion: 2.20 time: 0.174272 Sep 21 16:31:02.305293 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 533/975] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:31:02 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 1656 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 21 16:31:02.705045 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-de9f6ffc-ba01-4693-ae0a-2e6ac2a64d46 req-fce32f35-c697-4415-a2e9-59f2fb347e86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce59fd53-2d4c-477e-8326-672737e561f5", "name": "network-vif-deleted", "tag": "5abd346c-df9c-4cb2-b976-8f9adc822383"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:31:02.737761 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-de9f6ffc-ba01-4693-ae0a-2e6ac2a64d46 req-fce32f35-c697-4415-a2e9-59f2fb347e86 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:31:02.749759 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-de9f6ffc-ba01-4693-ae0a-2e6ac2a64d46 req-fce32f35-c697-4415-a2e9-59f2fb347e86 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:31:02.750654 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-de9f6ffc-ba01-4693-ae0a-2e6ac2a64d46 req-fce32f35-c697-4415-a2e9-59f2fb347e86 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:31:02.765615 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-de9f6ffc-ba01-4693-ae0a-2e6ac2a64d46 req-fce32f35-c697-4415-a2e9-59f2fb347e86 service nova] Creating event network-vif-deleted:5abd346c-df9c-4cb2-b976-8f9adc822383 for instance ce59fd53-2d4c-477e-8326-672737e561f5 on hv-cinder-85862 Sep 21 16:31:02.776184 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-de9f6ffc-ba01-4693-ae0a-2e6ac2a64d46 req-fce32f35-c697-4415-a2e9-59f2fb347e86 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074226 Sep 21 16:31:02.789230 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 443/976] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:31:03.334951 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-4ba4dd79-4c12-467a-898f-688141e1863a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:31:03.336313 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-4ba4dd79-4c12-467a-898f-688141e1863a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:31:03.343417 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4ba4dd79-4c12-467a-898f-688141e1863a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:31:03.344239 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4ba4dd79-4c12-467a-898f-688141e1863a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:31:03.345090 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4ba4dd79-4c12-467a-898f-688141e1863a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:31:03.346093 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4ba4dd79-4c12-467a-898f-688141e1863a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:31:03.346801 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4ba4dd79-4c12-467a-898f-688141e1863a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:31:03.347484 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4ba4dd79-4c12-467a-898f-688141e1863a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:31:03.365875 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.wsgi [None req-4ba4dd79-4c12-467a-898f-688141e1863a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] HTTP exception thrown: Instance ce59fd53-2d4c-477e-8326-672737e561f5 could not be found. Sep 21 16:31:03.367770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-4ba4dd79-4c12-467a-898f-688141e1863a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Request method failure captured: Sep 21 16:31:03.367770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: request: GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 HTTP/1.1 Sep 21 16:31:03.367770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept: application/json Sep 21 16:31:03.367770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept-Encoding: identity Sep 21 16:31:03.367770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Connection: close Sep 21 16:31:03.367770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Length: 0 Sep 21 16:31:03.367770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Type: application/json Sep 21 16:31:03.367770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Host: 10.222.0.64 Sep 21 16:31:03.367770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Openstack-System-Scope: None Sep 21 16:31:03.367770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: User-Agent: python-urllib3/1.26.12 Sep 21 16:31:03.367770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Auth-Token: gAAAAABjKzpqPBT9879oc0XSJnJap7p41i_60pHiJENRMZl-PZirxwim_ebnw2XcMHKvSgxpcv31VHIVan9f1aCkt8BDYV4z0cBUUXoXF0uRY5nRP5uTVkq64HJZZEe_LwK2VKjDxMjCmXOPhdoJVam9hGiP6D01aY06753BFjDEdtusFimRGBw Sep 21 16:31:03.367770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Id: None Sep 21 16:31:03.367770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Name: None Sep 21 16:31:03.367770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Identity-Status: Confirmed Sep 21 16:31:03.367770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Is-Admin-Project: True Sep 21 16:31:03.367770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Openstack-Nova-Api-Version: 2.20 Sep 21 16:31:03.367770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Id: default Sep 21 16:31:03.367770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Name: Default Sep 21 16:31:03.367770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Id: 0d61f0fe37cf4dc0ba6a2415ddf14518 Sep 21 16:31:03.367770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1341530899 Sep 21 16:31:03.367770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Role: member,reader Sep 21 16:31:03.367770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Roles: member,reader Sep 21 16:31:03.370223 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0d61f0fe37cf4dc0ba6a2415ddf14518"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0d61f0fe37cf4dc0ba6a2415ddf14518"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0d61f0fe37cf4dc0ba6a2415ddf14518"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0d61f0fe37cf4dc0ba6a2415ddf14518"}]}] Sep 21 16:31:03.370223 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1341530899 Sep 21 16:31:03.370223 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Id: 0d61f0fe37cf4dc0ba6a2415ddf14518 Sep 21 16:31:03.370223 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1341530899 Sep 21 16:31:03.370223 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User: tempest-AttachVolumeShelveTestJSON-1341530899-project Sep 21 16:31:03.370223 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Id: default Sep 21 16:31:03.370223 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Name: Default Sep 21 16:31:03.370223 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Id: 617ba5f9896b457f8182f760ed44aa58 Sep 21 16:31:03.370223 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1341530899-project Sep 21 16:31:03.370223 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: method: > Sep 21 16:31:03.370223 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: exception: Instance ce59fd53-2d4c-477e-8326-672737e561f5 could not be found. Sep 21 16:31:03.370223 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: action_args: {'id': 'ce59fd53-2d4c-477e-8326-672737e561f5'} Sep 21 16:31:03.371060 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:31:03.371060 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:31:03.371060 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 16:31:03.371060 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 16:31:03.371060 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 16:31:03.371060 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 16:31:03.371060 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 16:31:03.371060 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 16:31:03.371060 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 16:31:03.371060 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 16:31:03.371060 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce59fd53-2d4c-477e-8326-672737e561f5 could not be found. Sep 21 16:31:03.371060 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:31:03.371060 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:31:03.371060 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:31:03.371060 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:31:03.371060 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:31:03.371060 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:31:03.371060 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:31:03.371060 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:31:03.371060 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:31:03.372630 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:31:03.372630 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 16:31:03.372630 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 16:31:03.372630 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 16:31:03.372630 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 16:31:03.372630 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 16:31:03.372630 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:31:03.372630 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce59fd53-2d4c-477e-8326-672737e561f5 could not be found. Sep 21 16:31:03.372630 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:31:03.372630 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:31:03.372630 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:31:03.372630 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:31:03.372630 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:31:03.372630 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:31:03.372630 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:31:03.372630 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:31:03.372630 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce59fd53-2d4c-477e-8326-672737e561f5 could not be found. Sep 21 16:31:03.372630 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:31:03.374193 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-4ba4dd79-4c12-467a-898f-688141e1863a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Returning 404 to user: Instance ce59fd53-2d4c-477e-8326-672737e561f5 could not be found. {{(pid=120532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:31:03.374193 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-4ba4dd79-4c12-467a-898f-688141e1863a tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 404 len: 111 microversion: 2.20 time: 0.038218 Sep 21 16:31:03.374374 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 534/977] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:31:03 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 21 16:31:03.384294 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-a764dfcb-88fe-4b75-8361-3c9e6231495d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '.version_select at 0x7fdb889b5d30>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:31:03.408892 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-a764dfcb-88fe-4b75-8361-3c9e6231495d tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1849809654" status: 204 len: 0 microversion: 2.20 time: 0.029082 Sep 21 16:31:03.410271 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 444/978] 10.222.0.64 () {60 vars in 1262 bytes} [Wed Sep 21 16:31:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1849809654 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 21 16:31:05.649296 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-b88a6ed4-68c7-417c-be86-3c8eca697e6f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:31:05.650269 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-b88a6ed4-68c7-417c-be86-3c8eca697e6f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:31:05.659639 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b88a6ed4-68c7-417c-be86-3c8eca697e6f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:31:05.660157 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b88a6ed4-68c7-417c-be86-3c8eca697e6f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:31:05.660603 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b88a6ed4-68c7-417c-be86-3c8eca697e6f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:31:05.661367 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b88a6ed4-68c7-417c-be86-3c8eca697e6f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:31:05.661808 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b88a6ed4-68c7-417c-be86-3c8eca697e6f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:31:05.662270 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b88a6ed4-68c7-417c-be86-3c8eca697e6f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:31:05.681411 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.wsgi [None req-b88a6ed4-68c7-417c-be86-3c8eca697e6f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] HTTP exception thrown: Instance ce59fd53-2d4c-477e-8326-672737e561f5 could not be found. Sep 21 16:31:05.683702 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-b88a6ed4-68c7-417c-be86-3c8eca697e6f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Request method failure captured: Sep 21 16:31:05.683702 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: request: DELETE /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 HTTP/1.1 Sep 21 16:31:05.683702 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept: application/json Sep 21 16:31:05.683702 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept-Encoding: identity Sep 21 16:31:05.683702 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Connection: close Sep 21 16:31:05.683702 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Length: 0 Sep 21 16:31:05.683702 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Type: application/json Sep 21 16:31:05.683702 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Host: 10.222.0.64 Sep 21 16:31:05.683702 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Openstack-System-Scope: None Sep 21 16:31:05.683702 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: User-Agent: python-urllib3/1.26.12 Sep 21 16:31:05.683702 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Auth-Token: gAAAAABjKzpqPBT9879oc0XSJnJap7p41i_60pHiJENRMZl-PZirxwim_ebnw2XcMHKvSgxpcv31VHIVan9f1aCkt8BDYV4z0cBUUXoXF0uRY5nRP5uTVkq64HJZZEe_LwK2VKjDxMjCmXOPhdoJVam9hGiP6D01aY06753BFjDEdtusFimRGBw Sep 21 16:31:05.683702 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Id: None Sep 21 16:31:05.683702 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Name: None Sep 21 16:31:05.683702 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Identity-Status: Confirmed Sep 21 16:31:05.683702 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Is-Admin-Project: True Sep 21 16:31:05.683702 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Openstack-Nova-Api-Version: 2.20 Sep 21 16:31:05.683702 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Id: default Sep 21 16:31:05.683702 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Name: Default Sep 21 16:31:05.683702 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Id: 0d61f0fe37cf4dc0ba6a2415ddf14518 Sep 21 16:31:05.683702 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1341530899 Sep 21 16:31:05.683702 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Role: member,reader Sep 21 16:31:05.683702 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Roles: member,reader Sep 21 16:31:05.685390 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0d61f0fe37cf4dc0ba6a2415ddf14518"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0d61f0fe37cf4dc0ba6a2415ddf14518"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0d61f0fe37cf4dc0ba6a2415ddf14518"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0d61f0fe37cf4dc0ba6a2415ddf14518"}]}] Sep 21 16:31:05.685390 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1341530899 Sep 21 16:31:05.685390 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Id: 0d61f0fe37cf4dc0ba6a2415ddf14518 Sep 21 16:31:05.685390 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1341530899 Sep 21 16:31:05.685390 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User: tempest-AttachVolumeShelveTestJSON-1341530899-project Sep 21 16:31:05.685390 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Id: default Sep 21 16:31:05.685390 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Name: Default Sep 21 16:31:05.685390 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Id: 617ba5f9896b457f8182f760ed44aa58 Sep 21 16:31:05.685390 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1341530899-project Sep 21 16:31:05.685390 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: method: > Sep 21 16:31:05.685390 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: exception: Instance ce59fd53-2d4c-477e-8326-672737e561f5 could not be found. Sep 21 16:31:05.685390 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: action_args: {'id': 'ce59fd53-2d4c-477e-8326-672737e561f5'} Sep 21 16:31:05.686448 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:31:05.686448 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:31:05.686448 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 16:31:05.686448 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 16:31:05.686448 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 16:31:05.686448 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 16:31:05.686448 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 16:31:05.686448 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 16:31:05.686448 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 16:31:05.686448 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 16:31:05.686448 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce59fd53-2d4c-477e-8326-672737e561f5 could not be found. Sep 21 16:31:05.686448 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:31:05.686448 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:31:05.686448 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:31:05.686448 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:31:05.686448 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:31:05.686448 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:31:05.686448 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:31:05.686448 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:31:05.686448 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:31:05.687883 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:31:05.687883 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 21 16:31:05.687883 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 21 16:31:05.687883 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 21 16:31:05.687883 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 21 16:31:05.687883 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 16:31:05.687883 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 16:31:05.687883 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 16:31:05.687883 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:31:05.687883 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce59fd53-2d4c-477e-8326-672737e561f5 could not be found. Sep 21 16:31:05.687883 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:31:05.687883 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:31:05.687883 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:31:05.687883 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:31:05.687883 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:31:05.687883 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:31:05.687883 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:31:05.687883 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:31:05.687883 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce59fd53-2d4c-477e-8326-672737e561f5 could not be found. Sep 21 16:31:05.687883 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:31:05.689299 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-b88a6ed4-68c7-417c-be86-3c8eca697e6f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Returning 404 to user: Instance ce59fd53-2d4c-477e-8326-672737e561f5 could not be found. {{(pid=120532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:31:05.689299 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-b88a6ed4-68c7-417c-be86-3c8eca697e6f tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "DELETE /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 404 len: 111 microversion: 2.20 time: 0.045525 Sep 21 16:31:05.689728 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 535/979] 10.222.0.64 () {60 vars in 1280 bytes} [Wed Sep 21 16:31:05 2022] DELETE /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 21 16:31:05.694585 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-b3ad80d1-d838-40ed-a35c-5eeb24320859 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:31:05.695734 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-b3ad80d1-d838-40ed-a35c-5eeb24320859 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: ce59fd53-2d4c-477e-8326-672737e561f5] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:31:05.704387 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b3ad80d1-d838-40ed-a35c-5eeb24320859 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:31:05.704913 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b3ad80d1-d838-40ed-a35c-5eeb24320859 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:31:05.705627 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b3ad80d1-d838-40ed-a35c-5eeb24320859 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:31:05.706648 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b3ad80d1-d838-40ed-a35c-5eeb24320859 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:31:05.707116 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b3ad80d1-d838-40ed-a35c-5eeb24320859 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:31:05.707545 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b3ad80d1-d838-40ed-a35c-5eeb24320859 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:31:05.723400 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.wsgi [None req-b3ad80d1-d838-40ed-a35c-5eeb24320859 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] HTTP exception thrown: Instance ce59fd53-2d4c-477e-8326-672737e561f5 could not be found. Sep 21 16:31:05.725546 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-b3ad80d1-d838-40ed-a35c-5eeb24320859 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Request method failure captured: Sep 21 16:31:05.725546 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: request: GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 HTTP/1.1 Sep 21 16:31:05.725546 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept: application/json Sep 21 16:31:05.725546 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept-Encoding: identity Sep 21 16:31:05.725546 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Connection: close Sep 21 16:31:05.725546 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Length: 0 Sep 21 16:31:05.725546 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Type: application/json Sep 21 16:31:05.725546 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Host: 10.222.0.64 Sep 21 16:31:05.725546 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Openstack-System-Scope: None Sep 21 16:31:05.725546 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: User-Agent: python-urllib3/1.26.12 Sep 21 16:31:05.725546 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Auth-Token: gAAAAABjKzpqPBT9879oc0XSJnJap7p41i_60pHiJENRMZl-PZirxwim_ebnw2XcMHKvSgxpcv31VHIVan9f1aCkt8BDYV4z0cBUUXoXF0uRY5nRP5uTVkq64HJZZEe_LwK2VKjDxMjCmXOPhdoJVam9hGiP6D01aY06753BFjDEdtusFimRGBw Sep 21 16:31:05.725546 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Id: None Sep 21 16:31:05.725546 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Name: None Sep 21 16:31:05.725546 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Identity-Status: Confirmed Sep 21 16:31:05.725546 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Is-Admin-Project: True Sep 21 16:31:05.725546 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Openstack-Nova-Api-Version: 2.20 Sep 21 16:31:05.725546 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Id: default Sep 21 16:31:05.725546 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Name: Default Sep 21 16:31:05.725546 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Id: 0d61f0fe37cf4dc0ba6a2415ddf14518 Sep 21 16:31:05.725546 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1341530899 Sep 21 16:31:05.725546 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Role: member,reader Sep 21 16:31:05.725546 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Roles: member,reader Sep 21 16:31:05.727585 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0d61f0fe37cf4dc0ba6a2415ddf14518"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0d61f0fe37cf4dc0ba6a2415ddf14518"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0d61f0fe37cf4dc0ba6a2415ddf14518"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0d61f0fe37cf4dc0ba6a2415ddf14518"}]}] Sep 21 16:31:05.727585 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1341530899 Sep 21 16:31:05.727585 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Id: 0d61f0fe37cf4dc0ba6a2415ddf14518 Sep 21 16:31:05.727585 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1341530899 Sep 21 16:31:05.727585 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User: tempest-AttachVolumeShelveTestJSON-1341530899-project Sep 21 16:31:05.727585 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Id: default Sep 21 16:31:05.727585 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Name: Default Sep 21 16:31:05.727585 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Id: 617ba5f9896b457f8182f760ed44aa58 Sep 21 16:31:05.727585 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1341530899-project Sep 21 16:31:05.727585 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: method: > Sep 21 16:31:05.727585 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: exception: Instance ce59fd53-2d4c-477e-8326-672737e561f5 could not be found. Sep 21 16:31:05.727585 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: action_args: {'id': 'ce59fd53-2d4c-477e-8326-672737e561f5'} Sep 21 16:31:05.728663 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:31:05.728663 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:31:05.728663 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 16:31:05.728663 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 16:31:05.728663 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 16:31:05.728663 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 16:31:05.728663 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 16:31:05.728663 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 16:31:05.728663 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 16:31:05.728663 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 16:31:05.728663 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce59fd53-2d4c-477e-8326-672737e561f5 could not be found. Sep 21 16:31:05.728663 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:31:05.728663 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:31:05.728663 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:31:05.728663 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:31:05.728663 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:31:05.728663 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:31:05.728663 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:31:05.728663 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:31:05.728663 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:31:05.730230 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:31:05.730230 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 16:31:05.730230 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 16:31:05.730230 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 16:31:05.730230 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 16:31:05.730230 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 16:31:05.730230 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:31:05.730230 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce59fd53-2d4c-477e-8326-672737e561f5 could not be found. Sep 21 16:31:05.730230 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:31:05.730230 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:31:05.730230 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:31:05.730230 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:31:05.730230 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:31:05.730230 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:31:05.730230 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:31:05.730230 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:31:05.730230 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce59fd53-2d4c-477e-8326-672737e561f5 could not be found. Sep 21 16:31:05.730230 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:31:05.732485 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-b3ad80d1-d838-40ed-a35c-5eeb24320859 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Returning 404 to user: Instance ce59fd53-2d4c-477e-8326-672737e561f5 could not be found. {{(pid=120531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:31:05.733377 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-b3ad80d1-d838-40ed-a35c-5eeb24320859 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5" status: 404 len: 111 microversion: 2.20 time: 0.042912 Sep 21 16:31:05.733963 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 445/980] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:31:05 2022] GET /compute/v2.1/servers/ce59fd53-2d4c-477e-8326-672737e561f5 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 21 16:31:06.913519 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-2de28127-5213-4177-840e-8fa47bd79c60 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:31:06.915126 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-2de28127-5213-4177-840e-8fa47bd79c60 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:31:06.928885 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2de28127-5213-4177-840e-8fa47bd79c60 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:31:06.931042 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2de28127-5213-4177-840e-8fa47bd79c60 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:31:06.931871 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2de28127-5213-4177-840e-8fa47bd79c60 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:31:06.933389 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2de28127-5213-4177-840e-8fa47bd79c60 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:31:06.934163 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2de28127-5213-4177-840e-8fa47bd79c60 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:31:06.934899 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2de28127-5213-4177-840e-8fa47bd79c60 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:31:06.950957 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.wsgi [None req-2de28127-5213-4177-840e-8fa47bd79c60 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] HTTP exception thrown: Instance 5f563aac-6055-4b77-b3bb-894ed14c1f64 could not be found. Sep 21 16:31:06.952574 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-2de28127-5213-4177-840e-8fa47bd79c60 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Request method failure captured: Sep 21 16:31:06.952574 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: request: DELETE /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 HTTP/1.1 Sep 21 16:31:06.952574 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept: application/json Sep 21 16:31:06.952574 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept-Encoding: identity Sep 21 16:31:06.952574 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Connection: close Sep 21 16:31:06.952574 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Length: 0 Sep 21 16:31:06.952574 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Type: application/json Sep 21 16:31:06.952574 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Host: 10.222.0.64 Sep 21 16:31:06.952574 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Openstack-System-Scope: None Sep 21 16:31:06.952574 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: User-Agent: python-urllib3/1.26.12 Sep 21 16:31:06.952574 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Auth-Token: gAAAAABjKzpqPBT9879oc0XSJnJap7p41i_60pHiJENRMZl-PZirxwim_ebnw2XcMHKvSgxpcv31VHIVan9f1aCkt8BDYV4z0cBUUXoXF0uRY5nRP5uTVkq64HJZZEe_LwK2VKjDxMjCmXOPhdoJVam9hGiP6D01aY06753BFjDEdtusFimRGBw Sep 21 16:31:06.952574 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Id: None Sep 21 16:31:06.952574 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Name: None Sep 21 16:31:06.952574 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Identity-Status: Confirmed Sep 21 16:31:06.952574 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Is-Admin-Project: True Sep 21 16:31:06.952574 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Openstack-Nova-Api-Version: 2.20 Sep 21 16:31:06.952574 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Id: default Sep 21 16:31:06.952574 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Name: Default Sep 21 16:31:06.952574 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Id: 0d61f0fe37cf4dc0ba6a2415ddf14518 Sep 21 16:31:06.952574 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1341530899 Sep 21 16:31:06.952574 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Role: member,reader Sep 21 16:31:06.952574 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Roles: member,reader Sep 21 16:31:06.954400 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0d61f0fe37cf4dc0ba6a2415ddf14518"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0d61f0fe37cf4dc0ba6a2415ddf14518"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0d61f0fe37cf4dc0ba6a2415ddf14518"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0d61f0fe37cf4dc0ba6a2415ddf14518"}]}] Sep 21 16:31:06.954400 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1341530899 Sep 21 16:31:06.954400 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Id: 0d61f0fe37cf4dc0ba6a2415ddf14518 Sep 21 16:31:06.954400 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1341530899 Sep 21 16:31:06.954400 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User: tempest-AttachVolumeShelveTestJSON-1341530899-project Sep 21 16:31:06.954400 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Id: default Sep 21 16:31:06.954400 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Name: Default Sep 21 16:31:06.954400 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Id: 617ba5f9896b457f8182f760ed44aa58 Sep 21 16:31:06.954400 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1341530899-project Sep 21 16:31:06.954400 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: method: > Sep 21 16:31:06.954400 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: exception: Instance 5f563aac-6055-4b77-b3bb-894ed14c1f64 could not be found. Sep 21 16:31:06.954400 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: action_args: {'id': '5f563aac-6055-4b77-b3bb-894ed14c1f64'} Sep 21 16:31:06.955211 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:31:06.955211 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:31:06.955211 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 16:31:06.955211 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 16:31:06.955211 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 16:31:06.955211 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 16:31:06.955211 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 16:31:06.955211 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 16:31:06.955211 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 16:31:06.955211 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 16:31:06.955211 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f563aac-6055-4b77-b3bb-894ed14c1f64 could not be found. Sep 21 16:31:06.955211 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:31:06.955211 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:31:06.955211 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:31:06.955211 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:31:06.955211 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:31:06.955211 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:31:06.955211 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:31:06.955211 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:31:06.955211 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:31:06.956509 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:31:06.956509 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 21 16:31:06.956509 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 21 16:31:06.956509 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 21 16:31:06.956509 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 21 16:31:06.956509 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 16:31:06.956509 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 16:31:06.956509 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 16:31:06.956509 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:31:06.956509 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f563aac-6055-4b77-b3bb-894ed14c1f64 could not be found. Sep 21 16:31:06.956509 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:31:06.956509 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:31:06.956509 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:31:06.956509 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:31:06.956509 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:31:06.956509 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:31:06.956509 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:31:06.956509 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:31:06.956509 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f563aac-6055-4b77-b3bb-894ed14c1f64 could not be found. Sep 21 16:31:06.956509 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:31:06.958685 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-2de28127-5213-4177-840e-8fa47bd79c60 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Returning 404 to user: Instance 5f563aac-6055-4b77-b3bb-894ed14c1f64 could not be found. {{(pid=120532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:31:06.958685 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-2de28127-5213-4177-840e-8fa47bd79c60 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "DELETE /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 404 len: 111 microversion: 2.20 time: 0.046355 Sep 21 16:31:06.958685 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 536/981] 10.222.0.64 () {60 vars in 1280 bytes} [Wed Sep 21 16:31:06 2022] DELETE /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 21 16:31:06.966017 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-43271e97-5a68-4e3d-91ba-56be0c13f9f9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:31:06.967370 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-43271e97-5a68-4e3d-91ba-56be0c13f9f9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] [instance: 5f563aac-6055-4b77-b3bb-894ed14c1f64] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:31:06.979105 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-43271e97-5a68-4e3d-91ba-56be0c13f9f9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:31:06.980026 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-43271e97-5a68-4e3d-91ba-56be0c13f9f9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:31:06.981108 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-43271e97-5a68-4e3d-91ba-56be0c13f9f9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:31:06.982326 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-43271e97-5a68-4e3d-91ba-56be0c13f9f9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:31:06.983575 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-43271e97-5a68-4e3d-91ba-56be0c13f9f9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:31:06.983823 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-43271e97-5a68-4e3d-91ba-56be0c13f9f9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:31:07.020580 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.wsgi [None req-43271e97-5a68-4e3d-91ba-56be0c13f9f9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] HTTP exception thrown: Instance 5f563aac-6055-4b77-b3bb-894ed14c1f64 could not be found. Sep 21 16:31:07.023105 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-43271e97-5a68-4e3d-91ba-56be0c13f9f9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Request method failure captured: Sep 21 16:31:07.023105 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: request: GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 HTTP/1.1 Sep 21 16:31:07.023105 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept: application/json Sep 21 16:31:07.023105 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept-Encoding: identity Sep 21 16:31:07.023105 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Connection: close Sep 21 16:31:07.023105 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Length: 0 Sep 21 16:31:07.023105 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Type: application/json Sep 21 16:31:07.023105 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Host: 10.222.0.64 Sep 21 16:31:07.023105 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Openstack-System-Scope: None Sep 21 16:31:07.023105 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: User-Agent: python-urllib3/1.26.12 Sep 21 16:31:07.023105 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Auth-Token: gAAAAABjKzpqPBT9879oc0XSJnJap7p41i_60pHiJENRMZl-PZirxwim_ebnw2XcMHKvSgxpcv31VHIVan9f1aCkt8BDYV4z0cBUUXoXF0uRY5nRP5uTVkq64HJZZEe_LwK2VKjDxMjCmXOPhdoJVam9hGiP6D01aY06753BFjDEdtusFimRGBw Sep 21 16:31:07.023105 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Id: None Sep 21 16:31:07.023105 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Name: None Sep 21 16:31:07.023105 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Identity-Status: Confirmed Sep 21 16:31:07.023105 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Is-Admin-Project: True Sep 21 16:31:07.023105 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Openstack-Nova-Api-Version: 2.20 Sep 21 16:31:07.023105 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Id: default Sep 21 16:31:07.023105 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Name: Default Sep 21 16:31:07.023105 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Id: 0d61f0fe37cf4dc0ba6a2415ddf14518 Sep 21 16:31:07.023105 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1341530899 Sep 21 16:31:07.023105 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Role: member,reader Sep 21 16:31:07.023105 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Roles: member,reader Sep 21 16:31:07.026315 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0d61f0fe37cf4dc0ba6a2415ddf14518"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0d61f0fe37cf4dc0ba6a2415ddf14518"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0d61f0fe37cf4dc0ba6a2415ddf14518"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0d61f0fe37cf4dc0ba6a2415ddf14518"}]}] Sep 21 16:31:07.026315 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1341530899 Sep 21 16:31:07.026315 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Id: 0d61f0fe37cf4dc0ba6a2415ddf14518 Sep 21 16:31:07.026315 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1341530899 Sep 21 16:31:07.026315 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User: tempest-AttachVolumeShelveTestJSON-1341530899-project Sep 21 16:31:07.026315 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Id: default Sep 21 16:31:07.026315 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Name: Default Sep 21 16:31:07.026315 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Id: 617ba5f9896b457f8182f760ed44aa58 Sep 21 16:31:07.026315 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1341530899-project Sep 21 16:31:07.026315 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: method: > Sep 21 16:31:07.026315 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: exception: Instance 5f563aac-6055-4b77-b3bb-894ed14c1f64 could not be found. Sep 21 16:31:07.026315 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: action_args: {'id': '5f563aac-6055-4b77-b3bb-894ed14c1f64'} Sep 21 16:31:07.029064 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:31:07.029064 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:31:07.029064 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 16:31:07.029064 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 16:31:07.029064 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 16:31:07.029064 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 16:31:07.029064 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 16:31:07.029064 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 16:31:07.029064 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 16:31:07.029064 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 16:31:07.029064 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f563aac-6055-4b77-b3bb-894ed14c1f64 could not be found. Sep 21 16:31:07.029064 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:31:07.029064 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:31:07.029064 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:31:07.029064 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:31:07.029064 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:31:07.029064 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:31:07.029064 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:31:07.029064 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:31:07.029064 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:31:07.033000 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:31:07.033000 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 16:31:07.033000 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 16:31:07.033000 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 16:31:07.033000 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 16:31:07.033000 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 16:31:07.033000 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:31:07.033000 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f563aac-6055-4b77-b3bb-894ed14c1f64 could not be found. Sep 21 16:31:07.033000 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:31:07.033000 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:31:07.033000 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:31:07.033000 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:31:07.033000 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:31:07.033000 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:31:07.033000 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:31:07.033000 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:31:07.033000 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f563aac-6055-4b77-b3bb-894ed14c1f64 could not be found. Sep 21 16:31:07.033000 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:31:07.036581 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-43271e97-5a68-4e3d-91ba-56be0c13f9f9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] Returning 404 to user: Instance 5f563aac-6055-4b77-b3bb-894ed14c1f64 could not be found. {{(pid=120531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:31:07.036581 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-43271e97-5a68-4e3d-91ba-56be0c13f9f9 tempest-AttachVolumeShelveTestJSON-1341530899 tempest-AttachVolumeShelveTestJSON-1341530899-project] 10.222.0.64 "GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64" status: 404 len: 111 microversion: 2.20 time: 0.068001 Sep 21 16:31:07.036581 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 446/982] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Sep 21 16:31:06 2022] GET /compute/v2.1/servers/5f563aac-6055-4b77-b3bb-894ed14c1f64 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 21 16:31:12.685277 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-686b410c-90c0-463f-a380-d2162b6b9763 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] Action: 'create', calling method: .version_select at 0x7fdb88d23430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1247744412"}} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:31:13.023844 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-686b410c-90c0-463f-a380-d2162b6b9763 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.645772 Sep 21 16:31:13.024583 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 537/983] 10.222.0.64 () {60 vars in 1155 bytes} [Wed Sep 21 16:31:12 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 647 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 21 16:31:13.038469 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-bc14cc30-97df-4b9c-abf6-c29443f9338c tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] Calling method '.version_select at 0x7fdb88a06670>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:31:13.096459 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-bc14cc30-97df-4b9c-abf6-c29443f9338c tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e" status: 200 len: 345 microversion: 2.1 time: 0.061974 Sep 21 16:31:13.097835 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 447/984] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Sep 21 16:31:13 2022] GET /compute/v2.1/os-volumes/60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:31:14.111490 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-735113bb-f332-4360-bd88-cf1b2f2102fd tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] Calling method '.version_select at 0x7fdb88d04550>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:31:14.162721 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-735113bb-f332-4360-bd88-cf1b2f2102fd tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e" status: 200 len: 345 microversion: 2.1 time: 0.055479 Sep 21 16:31:14.163303 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 538/985] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Sep 21 16:31:14 2022] GET /compute/v2.1/os-volumes/60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:31:15.177795 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-96c43ab2-fa61-40b3-96cb-340156f298e4 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] Calling method '.version_select at 0x7fdb88a199d0>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:31:15.226297 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-96c43ab2-fa61-40b3-96cb-340156f298e4 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e" status: 200 len: 345 microversion: 2.1 time: 0.052892 Sep 21 16:31:15.226865 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 448/986] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Sep 21 16:31:15 2022] GET /compute/v2.1/os-volumes/60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:31:16.246830 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-7fe7fb55-44e7-422e-beff-942796dbe515 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] Calling method '.version_select at 0x7fdb88d23430>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:31:16.302490 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-7fe7fb55-44e7-422e-beff-942796dbe515 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e" status: 200 len: 345 microversion: 2.1 time: 0.064209 Sep 21 16:31:16.303539 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 539/987] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Sep 21 16:31:16 2022] GET /compute/v2.1/os-volumes/60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:31:17.315588 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:17.316276 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:17.321702 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-1aaf5e50-4cfd-4f4f-aadc-494a54b6d326 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] Calling method '.version_select at 0x7fdb88a19e50>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:31:17.371070 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-1aaf5e50-4cfd-4f4f-aadc-494a54b6d326 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e" status: 200 len: 346 microversion: 2.1 time: 0.057112 Sep 21 16:31:17.371647 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 449/988] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Sep 21 16:31:17 2022] GET /compute/v2.1/os-volumes/60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e => generated 346 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:31:17.382160 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_api:SELECT=12 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:17.382916 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=24 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:17.387402 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-e1c76884-3ceb-4c6c-b629-088f03b58a86 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] Action: 'create', calling method: .version_select at 0x7fdb88d2faf0>, body: {"snapshot": {"volume_id": "60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-58527568"}} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:31:17.547477 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-e1c76884-3ceb-4c6c-b629-088f03b58a86 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] 10.222.0.64 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.165915 Sep 21 16:31:17.548195 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 540/989] 10.222.0.64 () {60 vars in 1162 bytes} [Wed Sep 21 16:31:17 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:31:17.560511 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-3e3ec27d-91b2-42fc-9e6f-51b850aa791e tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] Calling method '.version_select at 0x7fdb88ce3280>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:31:17.592578 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-3e3ec27d-91b2-42fc-9e6f-51b850aa791e tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/bf02092a-57c0-4c66-ab59-ef8623939eef" status: 200 len: 285 microversion: 2.1 time: 0.036754 Sep 21 16:31:17.593209 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 450/990] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Sep 21 16:31:17 2022] GET /compute/v2.1/os-snapshots/bf02092a-57c0-4c66-ab59-ef8623939eef => generated 285 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:31:17.605865 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-4633b0bd-822b-4446-9005-d1c2a7be2a7a tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] Calling method '.version_select at 0x7fdb88cca790>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:31:17.637325 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-4633b0bd-822b-4446-9005-d1c2a7be2a7a tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.035597 Sep 21 16:31:17.637910 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 541/991] 10.222.0.64 () {58 vars in 1140 bytes} [Wed Sep 21 16:31:17 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:31:17.650178 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-1eaa005d-f6b5-47ac-bbbb-63a3a9182ddf tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] Calling method '.version_select at 0x7fdb88af5b80>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:31:17.680928 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-1eaa005d-f6b5-47ac-bbbb-63a3a9182ddf tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/bf02092a-57c0-4c66-ab59-ef8623939eef" status: 200 len: 285 microversion: 2.1 time: 0.035210 Sep 21 16:31:17.681433 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 451/992] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Sep 21 16:31:17 2022] GET /compute/v2.1/os-snapshots/bf02092a-57c0-4c66-ab59-ef8623939eef => generated 285 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:31:18.694120 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-36beb026-3b20-414b-92c7-0a91c7173811 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] Calling method '.version_select at 0x7fdb88d234c0>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:31:18.723846 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-36beb026-3b20-414b-92c7-0a91c7173811 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/bf02092a-57c0-4c66-ab59-ef8623939eef" status: 200 len: 285 microversion: 2.1 time: 0.034009 Sep 21 16:31:18.724413 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 542/993] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Sep 21 16:31:18 2022] GET /compute/v2.1/os-snapshots/bf02092a-57c0-4c66-ab59-ef8623939eef => generated 285 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:31:19.737502 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-4f0d8126-9f7a-4efb-8a38-fa88e0c99be2 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] Calling method '.version_select at 0x7fdb88aa14c0>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:31:19.775519 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-4f0d8126-9f7a-4efb-8a38-fa88e0c99be2 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/bf02092a-57c0-4c66-ab59-ef8623939eef" status: 200 len: 285 microversion: 2.1 time: 0.041943 Sep 21 16:31:19.776092 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 452/994] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Sep 21 16:31:19 2022] GET /compute/v2.1/os-snapshots/bf02092a-57c0-4c66-ab59-ef8623939eef => generated 285 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:31:20.789206 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-abcf4e98-8009-45cd-9663-0791855c70a2 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] Calling method '.version_select at 0x7fdb88f20dc0>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:31:20.819627 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-abcf4e98-8009-45cd-9663-0791855c70a2 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/bf02092a-57c0-4c66-ab59-ef8623939eef" status: 200 len: 286 microversion: 2.1 time: 0.034869 Sep 21 16:31:20.820216 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 543/995] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Sep 21 16:31:20 2022] GET /compute/v2.1/os-snapshots/bf02092a-57c0-4c66-ab59-ef8623939eef => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:31:20.834095 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-a4343f80-9519-488b-92e6-09948025ba18 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] Calling method '.version_select at 0x7fdb88979af0>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:31:20.904501 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-a4343f80-9519-488b-92e6-09948025ba18 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] 10.222.0.64 "DELETE /compute/v2.1/os-snapshots/bf02092a-57c0-4c66-ab59-ef8623939eef" status: 202 len: 0 microversion: 2.1 time: 0.075158 Sep 21 16:31:20.905081 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 453/996] 10.222.0.64 () {58 vars in 1254 bytes} [Wed Sep 21 16:31:20 2022] DELETE /compute/v2.1/os-snapshots/bf02092a-57c0-4c66-ab59-ef8623939eef => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 16:31:20.913302 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-8a8ec1ff-597a-4067-8b9e-1cd1f552e564 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] Calling method '.version_select at 0x7fdb88bc14c0>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:31:20.944582 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-8a8ec1ff-597a-4067-8b9e-1cd1f552e564 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/bf02092a-57c0-4c66-ab59-ef8623939eef" status: 200 len: 285 microversion: 2.1 time: 0.035058 Sep 21 16:31:20.945172 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 544/997] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Sep 21 16:31:20 2022] GET /compute/v2.1/os-snapshots/bf02092a-57c0-4c66-ab59-ef8623939eef => generated 285 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:31:21.958318 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-a1efcb01-51ee-48cc-bc08-abe05204af94 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] Calling method '.version_select at 0x7fdb889b9430>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:31:21.984975 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.wsgi [None req-a1efcb01-51ee-48cc-bc08-abe05204af94 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] HTTP exception thrown: Snapshot bf02092a-57c0-4c66-ab59-ef8623939eef could not be found. Sep 21 16:31:21.987536 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-a1efcb01-51ee-48cc-bc08-abe05204af94 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] Request method failure captured: Sep 21 16:31:21.987536 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: request: GET /compute/v2.1/os-snapshots/bf02092a-57c0-4c66-ab59-ef8623939eef HTTP/1.1 Sep 21 16:31:21.987536 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept: application/json Sep 21 16:31:21.987536 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept-Encoding: identity Sep 21 16:31:21.987536 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Connection: close Sep 21 16:31:21.987536 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Length: 0 Sep 21 16:31:21.987536 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Type: application/json Sep 21 16:31:21.987536 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Host: 10.222.0.64 Sep 21 16:31:21.987536 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Openstack-System-Scope: None Sep 21 16:31:21.987536 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: User-Agent: python-urllib3/1.26.12 Sep 21 16:31:21.987536 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Auth-Token: gAAAAABjKzxQ46-8leM3WhgzkijU8JVDtZePqjo69jE5YwwGkJc77GNsEbV8ejqENHLQjIQW4J-8En8nID9F3pbXfIfIMJUskYAy9lynvcpFczDXH-Y31uAPdCz9lcrLOGzeumQyYJPLkyi78tLnQLrgfx6cwuPP-Xg1BM_vy0z7AbzAS4e3b-w Sep 21 16:31:21.987536 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Id: None Sep 21 16:31:21.987536 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Name: None Sep 21 16:31:21.987536 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Identity-Status: Confirmed Sep 21 16:31:21.987536 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Is-Admin-Project: True Sep 21 16:31:21.987536 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Id: default Sep 21 16:31:21.987536 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Name: Default Sep 21 16:31:21.987536 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Id: 499e128cf94a416ab22578156360dfc4 Sep 21 16:31:21.987536 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-204695804 Sep 21 16:31:21.987536 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Role: member,reader Sep 21 16:31:21.987536 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Roles: member,reader Sep 21 16:31:21.989314 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/499e128cf94a416ab22578156360dfc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/499e128cf94a416ab22578156360dfc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_499e128cf94a416ab22578156360dfc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/499e128cf94a416ab22578156360dfc4"}]}] Sep 21 16:31:21.989314 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant: tempest-VolumesSnapshotsTestJSON-204695804 Sep 21 16:31:21.989314 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Id: 499e128cf94a416ab22578156360dfc4 Sep 21 16:31:21.989314 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-204695804 Sep 21 16:31:21.989314 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User: tempest-VolumesSnapshotsTestJSON-204695804-project Sep 21 16:31:21.989314 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Id: default Sep 21 16:31:21.989314 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Name: Default Sep 21 16:31:21.989314 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Id: ac85cd4dd183482c96fc7e5ea4003807 Sep 21 16:31:21.989314 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Name: tempest-VolumesSnapshotsTestJSON-204695804-project Sep 21 16:31:21.989314 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: method: Sep 21 16:31:21.989314 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: exception: Snapshot bf02092a-57c0-4c66-ab59-ef8623939eef could not be found. Sep 21 16:31:21.989314 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: action_args: {'id': 'bf02092a-57c0-4c66-ab59-ef8623939eef'} Sep 21 16:31:21.989314 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:31:21.990381 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:31:21.990381 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 21 16:31:21.990381 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 21 16:31:21.990381 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 21 16:31:21.990381 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 21 16:31:21.990381 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 21 16:31:21.990381 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 21 16:31:21.990381 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 21 16:31:21.990381 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 21 16:31:21.990381 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 21 16:31:21.990381 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 21 16:31:21.990381 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 21 16:31:21.990381 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 21 16:31:21.990381 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 21 16:31:21.990381 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 21 16:31:21.990381 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot bf02092a-57c0-4c66-ab59-ef8623939eef could not be found. (HTTP 404) (Request-ID: req-8bf913c4-a766-4418-8068-3f6a954dc582) Sep 21 16:31:21.990381 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:31:21.990381 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:31:21.991823 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:31:21.991823 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:31:21.991823 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 21 16:31:21.991823 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 21 16:31:21.991823 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 21 16:31:21.991823 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 21 16:31:21.991823 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 21 16:31:21.991823 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 21 16:31:21.991823 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 21 16:31:21.991823 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 21 16:31:21.991823 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 21 16:31:21.991823 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 21 16:31:21.991823 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 21 16:31:21.991823 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 21 16:31:21.991823 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 21 16:31:21.991823 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 21 16:31:21.991823 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 21 16:31:21.991823 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 21 16:31:21.991823 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 21 16:31:21.994380 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 21 16:31:21.994380 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 21 16:31:21.994380 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 21 16:31:21.994380 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 21 16:31:21.994380 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 21 16:31:21.994380 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot bf02092a-57c0-4c66-ab59-ef8623939eef could not be found. Sep 21 16:31:21.994380 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:31:21.994380 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:31:21.994380 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:31:21.994380 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:31:21.994380 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:31:21.994380 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:31:21.994380 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:31:21.994380 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:31:21.994380 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 21 16:31:21.994380 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 21 16:31:21.994380 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:31:21.994380 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:31:21.994380 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 21 16:31:21.994380 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:31:21.996739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot bf02092a-57c0-4c66-ab59-ef8623939eef could not be found. Sep 21 16:31:21.996739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:31:21.996739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:31:21.996739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:31:21.996739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:31:21.996739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:31:21.996739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:31:21.996739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:31:21.996739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:31:21.996739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot bf02092a-57c0-4c66-ab59-ef8623939eef could not be found. Sep 21 16:31:21.996739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:31:21.996739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-a1efcb01-51ee-48cc-bc08-abe05204af94 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] Returning 404 to user: Snapshot bf02092a-57c0-4c66-ab59-ef8623939eef could not be found. {{(pid=120531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:31:21.996739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-a1efcb01-51ee-48cc-bc08-abe05204af94 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/bf02092a-57c0-4c66-ab59-ef8623939eef" status: 404 len: 111 microversion: 2.1 time: 0.035406 Sep 21 16:31:21.996739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 454/998] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Sep 21 16:31:21 2022] GET /compute/v2.1/os-snapshots/bf02092a-57c0-4c66-ab59-ef8623939eef => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 16:31:21.999062 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-30af58a2-163f-41a2-aa97-037cfb56e5a7 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] Calling method '.version_select at 0x7fdb8a231dc0>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:31:22.063297 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-30af58a2-163f-41a2-aa97-037cfb56e5a7 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e" status: 202 len: 0 microversion: 2.1 time: 0.068617 Sep 21 16:31:22.063882 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 545/999] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Sep 21 16:31:21 2022] DELETE /compute/v2.1/os-volumes/60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 16:31:22.072696 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-caa5e723-9384-43e4-8ea7-21b1bdbecea1 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] Calling method '.version_select at 0x7fdb88a223a0>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:31:22.124462 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-caa5e723-9384-43e4-8ea7-21b1bdbecea1 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e" status: 200 len: 345 microversion: 2.1 time: 0.056139 Sep 21 16:31:22.125035 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 455/1000] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Sep 21 16:31:22 2022] GET /compute/v2.1/os-volumes/60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:31:23.139890 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-db76d2cb-1a17-4f21-8294-cead75b8aac5 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] Calling method '.version_select at 0x7fdb88ccad30>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:31:23.190017 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-db76d2cb-1a17-4f21-8294-cead75b8aac5 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e" status: 200 len: 345 microversion: 2.1 time: 0.054534 Sep 21 16:31:23.190747 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 546/1001] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Sep 21 16:31:23 2022] GET /compute/v2.1/os-volumes/60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:31:24.205407 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-36fd7a3c-40ce-4ca0-a077-1814bab8396e tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] Calling method '.version_select at 0x7fdb88af5af0>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:31:24.260762 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-36fd7a3c-40ce-4ca0-a077-1814bab8396e tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e" status: 200 len: 345 microversion: 2.1 time: 0.059541 Sep 21 16:31:24.261568 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 456/1002] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Sep 21 16:31:24 2022] GET /compute/v2.1/os-volumes/60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 16:31:25.277077 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-f1718ec4-2aec-4b62-96fc-3f55f9587c7e tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] Calling method '.version_select at 0x7fdb88d23670>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:31:25.305081 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.wsgi [None req-f1718ec4-2aec-4b62-96fc-3f55f9587c7e tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] HTTP exception thrown: Volume 60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e could not be found. Sep 21 16:31:25.308294 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-f1718ec4-2aec-4b62-96fc-3f55f9587c7e tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] Request method failure captured: Sep 21 16:31:25.308294 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: request: GET /compute/v2.1/os-volumes/60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e HTTP/1.1 Sep 21 16:31:25.308294 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept: application/json Sep 21 16:31:25.308294 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept-Encoding: identity Sep 21 16:31:25.308294 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Connection: close Sep 21 16:31:25.308294 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Length: 0 Sep 21 16:31:25.308294 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Type: application/json Sep 21 16:31:25.308294 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Host: 10.222.0.64 Sep 21 16:31:25.308294 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Openstack-System-Scope: None Sep 21 16:31:25.308294 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: User-Agent: python-urllib3/1.26.12 Sep 21 16:31:25.308294 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Auth-Token: gAAAAABjKzxQ46-8leM3WhgzkijU8JVDtZePqjo69jE5YwwGkJc77GNsEbV8ejqENHLQjIQW4J-8En8nID9F3pbXfIfIMJUskYAy9lynvcpFczDXH-Y31uAPdCz9lcrLOGzeumQyYJPLkyi78tLnQLrgfx6cwuPP-Xg1BM_vy0z7AbzAS4e3b-w Sep 21 16:31:25.308294 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Id: None Sep 21 16:31:25.308294 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Name: None Sep 21 16:31:25.308294 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Identity-Status: Confirmed Sep 21 16:31:25.308294 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Is-Admin-Project: True Sep 21 16:31:25.308294 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Id: default Sep 21 16:31:25.308294 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Name: Default Sep 21 16:31:25.308294 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Id: 499e128cf94a416ab22578156360dfc4 Sep 21 16:31:25.308294 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-204695804 Sep 21 16:31:25.308294 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Role: member,reader Sep 21 16:31:25.308294 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Roles: member,reader Sep 21 16:31:25.310018 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/499e128cf94a416ab22578156360dfc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/499e128cf94a416ab22578156360dfc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_499e128cf94a416ab22578156360dfc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/499e128cf94a416ab22578156360dfc4"}]}] Sep 21 16:31:25.310018 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant: tempest-VolumesSnapshotsTestJSON-204695804 Sep 21 16:31:25.310018 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Id: 499e128cf94a416ab22578156360dfc4 Sep 21 16:31:25.310018 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-204695804 Sep 21 16:31:25.310018 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User: tempest-VolumesSnapshotsTestJSON-204695804-project Sep 21 16:31:25.310018 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Id: default Sep 21 16:31:25.310018 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Name: Default Sep 21 16:31:25.310018 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Id: ac85cd4dd183482c96fc7e5ea4003807 Sep 21 16:31:25.310018 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Name: tempest-VolumesSnapshotsTestJSON-204695804-project Sep 21 16:31:25.310018 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: method: Sep 21 16:31:25.310018 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: exception: Volume 60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e could not be found. Sep 21 16:31:25.310018 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: action_args: {'id': '60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e'} Sep 21 16:31:25.310018 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:31:25.311145 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:31:25.311145 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 21 16:31:25.311145 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 21 16:31:25.311145 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 21 16:31:25.311145 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 21 16:31:25.311145 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 21 16:31:25.311145 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 21 16:31:25.311145 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 21 16:31:25.311145 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 21 16:31:25.311145 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 21 16:31:25.311145 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 21 16:31:25.311145 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 21 16:31:25.311145 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 21 16:31:25.311145 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 21 16:31:25.311145 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 21 16:31:25.311145 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e could not be found. (HTTP 404) (Request-ID: req-48ab2da1-fef8-4d51-8f14-446e9798a88a) Sep 21 16:31:25.311145 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:31:25.311145 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:31:25.311145 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:31:25.312622 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:31:25.312622 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 21 16:31:25.312622 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 21 16:31:25.312622 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 21 16:31:25.312622 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 21 16:31:25.312622 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 21 16:31:25.312622 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 21 16:31:25.312622 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 21 16:31:25.312622 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 21 16:31:25.312622 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 21 16:31:25.312622 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 21 16:31:25.312622 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 21 16:31:25.312622 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 21 16:31:25.312622 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 21 16:31:25.312622 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 21 16:31:25.312622 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 21 16:31:25.312622 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 21 16:31:25.312622 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 21 16:31:25.312622 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 21 16:31:25.315041 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 21 16:31:25.315041 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 21 16:31:25.315041 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 21 16:31:25.315041 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 21 16:31:25.315041 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e could not be found. Sep 21 16:31:25.315041 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:31:25.315041 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:31:25.315041 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:31:25.315041 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:31:25.315041 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:31:25.315041 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:31:25.315041 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:31:25.315041 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:31:25.315041 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 21 16:31:25.315041 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 21 16:31:25.315041 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:31:25.315041 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:31:25.315041 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 21 16:31:25.315041 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:31:25.316650 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e could not be found. Sep 21 16:31:25.316650 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:31:25.316650 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:31:25.316650 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:31:25.316650 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:31:25.316650 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:31:25.316650 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:31:25.316650 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:31:25.316650 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:31:25.316650 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e could not be found. Sep 21 16:31:25.316650 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:31:25.316650 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-f1718ec4-2aec-4b62-96fc-3f55f9587c7e tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] Returning 404 to user: Volume 60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e could not be found. {{(pid=120532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:31:25.316650 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-f1718ec4-2aec-4b62-96fc-3f55f9587c7e tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e" status: 404 len: 109 microversion: 2.1 time: 0.037754 Sep 21 16:31:25.316650 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 547/1003] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Sep 21 16:31:25 2022] GET /compute/v2.1/os-volumes/60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 16:31:25.325148 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-deb74734-f9dc-4e1f-a907-4023053af035 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] Calling method '.version_select at 0x7fdb88979c10>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:31:25.365786 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.wsgi [None req-deb74734-f9dc-4e1f-a907-4023053af035 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] HTTP exception thrown: Volume 60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e could not be found. Sep 21 16:31:25.367818 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-deb74734-f9dc-4e1f-a907-4023053af035 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] Request method failure captured: Sep 21 16:31:25.367818 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: request: DELETE /compute/v2.1/os-volumes/60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e HTTP/1.1 Sep 21 16:31:25.367818 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept: application/json Sep 21 16:31:25.367818 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept-Encoding: identity Sep 21 16:31:25.367818 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Connection: close Sep 21 16:31:25.367818 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Length: 0 Sep 21 16:31:25.367818 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Type: application/json Sep 21 16:31:25.367818 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Host: 10.222.0.64 Sep 21 16:31:25.367818 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Openstack-System-Scope: None Sep 21 16:31:25.367818 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: User-Agent: python-urllib3/1.26.12 Sep 21 16:31:25.367818 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Auth-Token: gAAAAABjKzxQ46-8leM3WhgzkijU8JVDtZePqjo69jE5YwwGkJc77GNsEbV8ejqENHLQjIQW4J-8En8nID9F3pbXfIfIMJUskYAy9lynvcpFczDXH-Y31uAPdCz9lcrLOGzeumQyYJPLkyi78tLnQLrgfx6cwuPP-Xg1BM_vy0z7AbzAS4e3b-w Sep 21 16:31:25.367818 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Id: None Sep 21 16:31:25.367818 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Name: None Sep 21 16:31:25.367818 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Identity-Status: Confirmed Sep 21 16:31:25.367818 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Is-Admin-Project: True Sep 21 16:31:25.367818 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Id: default Sep 21 16:31:25.367818 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Name: Default Sep 21 16:31:25.367818 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Id: 499e128cf94a416ab22578156360dfc4 Sep 21 16:31:25.367818 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-204695804 Sep 21 16:31:25.367818 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Role: member,reader Sep 21 16:31:25.367818 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Roles: member,reader Sep 21 16:31:25.370401 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/499e128cf94a416ab22578156360dfc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/499e128cf94a416ab22578156360dfc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_499e128cf94a416ab22578156360dfc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/499e128cf94a416ab22578156360dfc4"}]}] Sep 21 16:31:25.370401 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant: tempest-VolumesSnapshotsTestJSON-204695804 Sep 21 16:31:25.370401 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Id: 499e128cf94a416ab22578156360dfc4 Sep 21 16:31:25.370401 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-204695804 Sep 21 16:31:25.370401 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User: tempest-VolumesSnapshotsTestJSON-204695804-project Sep 21 16:31:25.370401 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Id: default Sep 21 16:31:25.370401 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Name: Default Sep 21 16:31:25.370401 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Id: ac85cd4dd183482c96fc7e5ea4003807 Sep 21 16:31:25.370401 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Name: tempest-VolumesSnapshotsTestJSON-204695804-project Sep 21 16:31:25.370401 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: method: Sep 21 16:31:25.370401 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: exception: Volume 60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e could not be found. Sep 21 16:31:25.370401 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: action_args: {'id': '60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e'} Sep 21 16:31:25.370401 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:31:25.371955 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:31:25.371955 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 21 16:31:25.371955 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 21 16:31:25.371955 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 21 16:31:25.371955 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 21 16:31:25.371955 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 21 16:31:25.371955 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 21 16:31:25.371955 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 21 16:31:25.371955 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 21 16:31:25.371955 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 21 16:31:25.371955 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 21 16:31:25.371955 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 21 16:31:25.371955 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 21 16:31:25.371955 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 21 16:31:25.371955 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 21 16:31:25.371955 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e could not be found. (HTTP 404) (Request-ID: req-b5108483-6c84-4a2f-9428-7eb238aa5a6f) Sep 21 16:31:25.371955 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:31:25.371955 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:31:25.371955 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:31:25.374037 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:31:25.374037 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 21 16:31:25.374037 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 21 16:31:25.374037 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 21 16:31:25.374037 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 21 16:31:25.374037 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 21 16:31:25.374037 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 21 16:31:25.374037 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 21 16:31:25.374037 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 21 16:31:25.374037 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 21 16:31:25.374037 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 21 16:31:25.374037 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 21 16:31:25.374037 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 21 16:31:25.374037 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 21 16:31:25.374037 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 21 16:31:25.374037 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 21 16:31:25.374037 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 21 16:31:25.374037 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 21 16:31:25.374037 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 21 16:31:25.376094 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 21 16:31:25.376094 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 21 16:31:25.376094 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 21 16:31:25.376094 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 21 16:31:25.376094 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e could not be found. Sep 21 16:31:25.376094 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:31:25.376094 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:31:25.376094 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:31:25.376094 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:31:25.376094 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:31:25.376094 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:31:25.376094 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:31:25.376094 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:31:25.376094 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 21 16:31:25.376094 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 21 16:31:25.376094 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:31:25.376094 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:31:25.376094 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 21 16:31:25.376094 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:31:25.377567 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e could not be found. Sep 21 16:31:25.377567 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:31:25.377567 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:31:25.377567 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:31:25.377567 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:31:25.377567 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:31:25.377567 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:31:25.377567 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:31:25.377567 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:31:25.377567 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e could not be found. Sep 21 16:31:25.377567 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:31:25.377567 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-deb74734-f9dc-4e1f-a907-4023053af035 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] Returning 404 to user: Volume 60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e could not be found. {{(pid=120531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:31:25.377567 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-deb74734-f9dc-4e1f-a907-4023053af035 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e" status: 404 len: 109 microversion: 2.1 time: 0.049170 Sep 21 16:31:25.377567 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 457/1004] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Sep 21 16:31:25 2022] DELETE /compute/v2.1/os-volumes/60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 21 16:31:25.381001 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-11a4e4b5-0d47-4a96-ab9e-7e4365f2fab7 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] Calling method '.version_select at 0x7fdb88cca280>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:31:25.411809 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.wsgi [None req-11a4e4b5-0d47-4a96-ab9e-7e4365f2fab7 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] HTTP exception thrown: Volume 60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e could not be found. Sep 21 16:31:25.413847 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-11a4e4b5-0d47-4a96-ab9e-7e4365f2fab7 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] Request method failure captured: Sep 21 16:31:25.413847 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: request: GET /compute/v2.1/os-volumes/60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e HTTP/1.1 Sep 21 16:31:25.413847 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept: application/json Sep 21 16:31:25.413847 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept-Encoding: identity Sep 21 16:31:25.413847 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Connection: close Sep 21 16:31:25.413847 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Length: 0 Sep 21 16:31:25.413847 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Type: application/json Sep 21 16:31:25.413847 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Host: 10.222.0.64 Sep 21 16:31:25.413847 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Openstack-System-Scope: None Sep 21 16:31:25.413847 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: User-Agent: python-urllib3/1.26.12 Sep 21 16:31:25.413847 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Auth-Token: gAAAAABjKzxQ46-8leM3WhgzkijU8JVDtZePqjo69jE5YwwGkJc77GNsEbV8ejqENHLQjIQW4J-8En8nID9F3pbXfIfIMJUskYAy9lynvcpFczDXH-Y31uAPdCz9lcrLOGzeumQyYJPLkyi78tLnQLrgfx6cwuPP-Xg1BM_vy0z7AbzAS4e3b-w Sep 21 16:31:25.413847 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Id: None Sep 21 16:31:25.413847 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Name: None Sep 21 16:31:25.413847 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Identity-Status: Confirmed Sep 21 16:31:25.413847 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Is-Admin-Project: True Sep 21 16:31:25.413847 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Id: default Sep 21 16:31:25.413847 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Name: Default Sep 21 16:31:25.413847 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Id: 499e128cf94a416ab22578156360dfc4 Sep 21 16:31:25.413847 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-204695804 Sep 21 16:31:25.413847 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Role: member,reader Sep 21 16:31:25.413847 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Roles: member,reader Sep 21 16:31:25.416272 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/499e128cf94a416ab22578156360dfc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/499e128cf94a416ab22578156360dfc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_499e128cf94a416ab22578156360dfc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/499e128cf94a416ab22578156360dfc4"}]}] Sep 21 16:31:25.416272 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant: tempest-VolumesSnapshotsTestJSON-204695804 Sep 21 16:31:25.416272 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Id: 499e128cf94a416ab22578156360dfc4 Sep 21 16:31:25.416272 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-204695804 Sep 21 16:31:25.416272 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User: tempest-VolumesSnapshotsTestJSON-204695804-project Sep 21 16:31:25.416272 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Id: default Sep 21 16:31:25.416272 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Name: Default Sep 21 16:31:25.416272 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Id: ac85cd4dd183482c96fc7e5ea4003807 Sep 21 16:31:25.416272 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Name: tempest-VolumesSnapshotsTestJSON-204695804-project Sep 21 16:31:25.416272 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: method: Sep 21 16:31:25.416272 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: exception: Volume 60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e could not be found. Sep 21 16:31:25.416272 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: action_args: {'id': '60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e'} Sep 21 16:31:25.416272 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:31:25.418475 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:31:25.418475 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 21 16:31:25.418475 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 21 16:31:25.418475 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 21 16:31:25.418475 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 21 16:31:25.418475 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 21 16:31:25.418475 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 21 16:31:25.418475 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 21 16:31:25.418475 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 21 16:31:25.418475 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 21 16:31:25.418475 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 21 16:31:25.418475 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 21 16:31:25.418475 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 21 16:31:25.418475 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 21 16:31:25.418475 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 21 16:31:25.418475 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e could not be found. (HTTP 404) (Request-ID: req-c8370288-df0a-4b83-b71f-6a0c2ca4fb88) Sep 21 16:31:25.418475 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:31:25.418475 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:31:25.418475 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:31:25.420605 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:31:25.420605 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 21 16:31:25.420605 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 21 16:31:25.420605 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 21 16:31:25.420605 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 21 16:31:25.420605 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 21 16:31:25.420605 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 21 16:31:25.420605 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 21 16:31:25.420605 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 21 16:31:25.420605 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 21 16:31:25.420605 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 21 16:31:25.420605 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 21 16:31:25.420605 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 21 16:31:25.420605 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 21 16:31:25.420605 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 21 16:31:25.420605 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 21 16:31:25.420605 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 21 16:31:25.420605 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 21 16:31:25.420605 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 21 16:31:25.422845 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 21 16:31:25.422845 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 21 16:31:25.422845 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 21 16:31:25.422845 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 21 16:31:25.422845 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e could not be found. Sep 21 16:31:25.422845 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:31:25.422845 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:31:25.422845 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:31:25.422845 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:31:25.422845 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:31:25.422845 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:31:25.422845 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:31:25.422845 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:31:25.422845 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 21 16:31:25.422845 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 21 16:31:25.422845 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:31:25.422845 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:31:25.422845 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 21 16:31:25.422845 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:31:25.425268 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e could not be found. Sep 21 16:31:25.425268 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:31:25.425268 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:31:25.425268 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:31:25.425268 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:31:25.425268 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:31:25.425268 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:31:25.425268 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:31:25.425268 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:31:25.425268 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e could not be found. Sep 21 16:31:25.425268 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:31:25.425268 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-11a4e4b5-0d47-4a96-ab9e-7e4365f2fab7 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] Returning 404 to user: Volume 60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e could not be found. {{(pid=120532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:31:25.425268 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-11a4e4b5-0d47-4a96-ab9e-7e4365f2fab7 tempest-VolumesSnapshotsTestJSON-204695804 tempest-VolumesSnapshotsTestJSON-204695804-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e" status: 404 len: 109 microversion: 2.1 time: 0.040384 Sep 21 16:31:25.425268 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 548/1005] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Sep 21 16:31:25 2022] GET /compute/v2.1/os-volumes/60f3f8dd-aef4-4c20-b25b-6c4e9f254c8e => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 21 16:31:35.161061 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-c2c50552-6161-4758-871a-8e60a8109d64 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-47125437", "imageRef": "600db436-ed6c-41b7-89f7-7dd31852a1a7", "flavorRef": "452", "networks": [{"uuid": "80abbf7f-d658-47d0-bdcc-452a6546b53d"}]}} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:31:35.245944 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.network.neutron [None req-c2c50552-6161-4758-871a-8e60a8109d64 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] validate_networks() for [('80abbf7f-d658-47d0-bdcc-452a6546b53d', None, None, None, None, None)] {{(pid=120531) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 16:31:35.706365 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-c2c50552-6161-4758-871a-8e60a8109d64 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Flavor limits 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 16:31:35.706365 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-c2c50552-6161-4758-871a-8e60a8109d64 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Image limits 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 16:31:35.706365 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-c2c50552-6161-4758-871a-8e60a8109d64 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Flavor pref 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 16:31:35.706365 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-c2c50552-6161-4758-871a-8e60a8109d64 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Image pref 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 16:31:35.706942 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-c2c50552-6161-4758-871a-8e60a8109d64 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 16:31:35.717798 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c2c50552-6161-4758-871a-8e60a8109d64 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:31:35.718569 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c2c50552-6161-4758-871a-8e60a8109d64 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:31:35.719045 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c2c50552-6161-4758-871a-8e60a8109d64 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:31:35.719780 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c2c50552-6161-4758-871a-8e60a8109d64 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:31:35.720234 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c2c50552-6161-4758-871a-8e60a8109d64 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:31:35.720654 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c2c50552-6161-4758-871a-8e60a8109d64 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:31:35.738832 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.quota [None req-c2c50552-6161-4758-871a-8e60a8109d64 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Getting quotas for project 5eb1e42761a74d7eb8509ac0f4d1c1db. Resources: {'cores', 'ram', 'instances'} {{(pid=120531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 16:31:35.743702 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.quota [None req-c2c50552-6161-4758-871a-8e60a8109d64 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Getting quotas for user 10f2730695454358bc1707dd0815d880 and project 5eb1e42761a74d7eb8509ac0f4d1c1db. Resources: {'cores', 'ram', 'instances'} {{(pid=120531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 16:31:35.755205 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-c2c50552-6161-4758-871a-8e60a8109d64 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Going to run 1 instances... {{(pid=120531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 16:31:35.757605 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-c2c50552-6161-4758-871a-8e60a8109d64 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='600db436-ed6c-41b7-89f7-7dd31852a1a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 16:31:35.808462 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-c2c50552-6161-4758-871a-8e60a8109d64 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.654757 Sep 21 16:31:35.814548 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 458/1006] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Sep 21 16:31:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 21 16:31:35.829107 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-9350e996-34ca-4e8d-bd01-8f36508701c2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:31:35.829739 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-9350e996-34ca-4e8d-bd01-8f36508701c2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:31:35.897067 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-9350e996-34ca-4e8d-bd01-8f36508701c2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:31:35.905757 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-9350e996-34ca-4e8d-bd01-8f36508701c2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1217 microversion: 2.1 time: 0.084283 Sep 21 16:31:35.906384 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 549/1007] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:31:35 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:31:36.941242 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-7004947d-cb0a-4455-8a29-c367fccd33c1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:31:36.941918 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-7004947d-cb0a-4455-8a29-c367fccd33c1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:31:36.948997 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7004947d-cb0a-4455-8a29-c367fccd33c1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:31:36.949416 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7004947d-cb0a-4455-8a29-c367fccd33c1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:31:36.951313 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7004947d-cb0a-4455-8a29-c367fccd33c1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:31:36.952227 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7004947d-cb0a-4455-8a29-c367fccd33c1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:31:36.953025 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7004947d-cb0a-4455-8a29-c367fccd33c1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:31:36.953758 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7004947d-cb0a-4455-8a29-c367fccd33c1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:31:37.034752 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-7004947d-cb0a-4455-8a29-c367fccd33c1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:31:37.043947 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-7004947d-cb0a-4455-8a29-c367fccd33c1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1269 microversion: 2.1 time: 0.106813 Sep 21 16:31:37.045155 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 459/1008] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:31:36 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1269 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:31:38.067061 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-2d13646f-0c87-4391-b39a-1737848e2906 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:31:38.068336 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-2d13646f-0c87-4391-b39a-1737848e2906 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:31:38.075925 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2d13646f-0c87-4391-b39a-1737848e2906 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:31:38.077220 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2d13646f-0c87-4391-b39a-1737848e2906 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:31:38.077839 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2d13646f-0c87-4391-b39a-1737848e2906 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:31:38.078770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2d13646f-0c87-4391-b39a-1737848e2906 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:31:38.079395 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2d13646f-0c87-4391-b39a-1737848e2906 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:31:38.079985 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2d13646f-0c87-4391-b39a-1737848e2906 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:31:38.249994 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-2d13646f-0c87-4391-b39a-1737848e2906 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:31:38.258451 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-2d13646f-0c87-4391-b39a-1737848e2906 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1317 microversion: 2.1 time: 0.195209 Sep 21 16:31:38.274073 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 550/1009] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:31:38 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:31:38.472383 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-07ee112c-66ce-4b63-9cdb-73bc4c70c6de req-47b9aeb5-5798-463b-8123-984d1796d30a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0026951-8625-4521-a6fa-7583577348db", "tag": "54ef679b-81ed-4fd8-a6cf-2aa173c9cb98"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:31:38.489623 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-07ee112c-66ce-4b63-9cdb-73bc4c70c6de req-47b9aeb5-5798-463b-8123-984d1796d30a service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:31:38.490339 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-07ee112c-66ce-4b63-9cdb-73bc4c70c6de req-47b9aeb5-5798-463b-8123-984d1796d30a service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:31:38.490773 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-07ee112c-66ce-4b63-9cdb-73bc4c70c6de req-47b9aeb5-5798-463b-8123-984d1796d30a service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:31:38.502829 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-07ee112c-66ce-4b63-9cdb-73bc4c70c6de req-47b9aeb5-5798-463b-8123-984d1796d30a service nova] Creating event network-changed:54ef679b-81ed-4fd8-a6cf-2aa173c9cb98 for instance f0026951-8625-4521-a6fa-7583577348db on hv-cinder-85862 Sep 21 16:31:38.508191 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-07ee112c-66ce-4b63-9cdb-73bc4c70c6de req-47b9aeb5-5798-463b-8123-984d1796d30a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039413 Sep 21 16:31:38.509106 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 460/1010] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:31:39.283494 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-d0dfa31b-e551-4ed0-b12e-dfdd30ed19bc tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:31:39.284108 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-d0dfa31b-e551-4ed0-b12e-dfdd30ed19bc tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:31:39.290756 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d0dfa31b-e551-4ed0-b12e-dfdd30ed19bc tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:31:39.291170 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d0dfa31b-e551-4ed0-b12e-dfdd30ed19bc tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:31:39.291603 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d0dfa31b-e551-4ed0-b12e-dfdd30ed19bc tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:31:39.292297 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d0dfa31b-e551-4ed0-b12e-dfdd30ed19bc tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:31:39.292755 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d0dfa31b-e551-4ed0-b12e-dfdd30ed19bc tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:31:39.293176 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d0dfa31b-e551-4ed0-b12e-dfdd30ed19bc tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:31:39.443164 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d0dfa31b-e551-4ed0-b12e-dfdd30ed19bc tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:31:39.460373 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-d0dfa31b-e551-4ed0-b12e-dfdd30ed19bc tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1317 microversion: 2.1 time: 0.180709 Sep 21 16:31:39.469929 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 551/1011] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:31:39 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:31:40.485788 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-9adfb780-4019-4430-84ee-c10cc6f65329 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:31:40.486445 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-9adfb780-4019-4430-84ee-c10cc6f65329 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:31:40.493221 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9adfb780-4019-4430-84ee-c10cc6f65329 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:31:40.493756 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9adfb780-4019-4430-84ee-c10cc6f65329 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:31:40.494235 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9adfb780-4019-4430-84ee-c10cc6f65329 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:31:40.495027 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9adfb780-4019-4430-84ee-c10cc6f65329 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:31:40.495488 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9adfb780-4019-4430-84ee-c10cc6f65329 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:31:40.495917 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9adfb780-4019-4430-84ee-c10cc6f65329 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:31:40.651982 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-9adfb780-4019-4430-84ee-c10cc6f65329 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:31:40.660619 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-9adfb780-4019-4430-84ee-c10cc6f65329 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1317 microversion: 2.1 time: 0.180224 Sep 21 16:31:40.661216 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 461/1012] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:31:40 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:31:41.686251 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-0f814dc2-4833-478b-a400-187ca892529a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:31:41.686928 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-0f814dc2-4833-478b-a400-187ca892529a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:31:41.694321 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0f814dc2-4833-478b-a400-187ca892529a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:31:41.694810 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0f814dc2-4833-478b-a400-187ca892529a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:31:41.695240 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0f814dc2-4833-478b-a400-187ca892529a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:31:41.695962 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0f814dc2-4833-478b-a400-187ca892529a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:31:41.696413 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0f814dc2-4833-478b-a400-187ca892529a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:31:41.696829 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0f814dc2-4833-478b-a400-187ca892529a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:31:41.842027 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-0f814dc2-4833-478b-a400-187ca892529a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:31:41.850734 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-0f814dc2-4833-478b-a400-187ca892529a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1317 microversion: 2.1 time: 0.168436 Sep 21 16:31:41.851488 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 552/1013] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:31:41 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:31:42.659083 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-4d87d17d-0d88-483a-9365-6f1794546841 req-22ea2f9f-2bcd-4dac-9ed8-e31b9823b06e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0026951-8625-4521-a6fa-7583577348db", "name": "network-vif-plugged", "status": "completed", "tag": "54ef679b-81ed-4fd8-a6cf-2aa173c9cb98"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:31:42.676431 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-4d87d17d-0d88-483a-9365-6f1794546841 req-22ea2f9f-2bcd-4dac-9ed8-e31b9823b06e service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:31:42.676907 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-4d87d17d-0d88-483a-9365-6f1794546841 req-22ea2f9f-2bcd-4dac-9ed8-e31b9823b06e service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:31:42.677835 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-4d87d17d-0d88-483a-9365-6f1794546841 req-22ea2f9f-2bcd-4dac-9ed8-e31b9823b06e service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:31:42.694111 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-4d87d17d-0d88-483a-9365-6f1794546841 req-22ea2f9f-2bcd-4dac-9ed8-e31b9823b06e service nova] Creating event network-vif-plugged:54ef679b-81ed-4fd8-a6cf-2aa173c9cb98 for instance f0026951-8625-4521-a6fa-7583577348db on hv-cinder-85862 Sep 21 16:31:42.702700 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-4d87d17d-0d88-483a-9365-6f1794546841 req-22ea2f9f-2bcd-4dac-9ed8-e31b9823b06e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049421 Sep 21 16:31:42.704112 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 462/1014] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:31:42.883728 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-9a59884d-3e86-484f-8c9c-a1b446fc9d2d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:31:42.884376 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-9a59884d-3e86-484f-8c9c-a1b446fc9d2d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:31:42.891579 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9a59884d-3e86-484f-8c9c-a1b446fc9d2d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:31:42.891777 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9a59884d-3e86-484f-8c9c-a1b446fc9d2d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:31:42.892224 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9a59884d-3e86-484f-8c9c-a1b446fc9d2d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:31:42.892924 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9a59884d-3e86-484f-8c9c-a1b446fc9d2d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:31:42.893381 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9a59884d-3e86-484f-8c9c-a1b446fc9d2d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:31:42.893811 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9a59884d-3e86-484f-8c9c-a1b446fc9d2d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:31:43.039301 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-9a59884d-3e86-484f-8c9c-a1b446fc9d2d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:31:43.047295 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-9a59884d-3e86-484f-8c9c-a1b446fc9d2d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1317 microversion: 2.1 time: 0.167506 Sep 21 16:31:43.047895 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 553/1015] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:31:42 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:31:44.072648 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-dd91a2d7-553f-4a04-98ee-9c6d700517bd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:31:44.073250 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-dd91a2d7-553f-4a04-98ee-9c6d700517bd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:31:44.079751 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dd91a2d7-553f-4a04-98ee-9c6d700517bd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:31:44.080242 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dd91a2d7-553f-4a04-98ee-9c6d700517bd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:31:44.080681 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dd91a2d7-553f-4a04-98ee-9c6d700517bd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:31:44.081389 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dd91a2d7-553f-4a04-98ee-9c6d700517bd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:31:44.081845 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dd91a2d7-553f-4a04-98ee-9c6d700517bd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:31:44.082412 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dd91a2d7-553f-4a04-98ee-9c6d700517bd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:31:44.224755 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-dd91a2d7-553f-4a04-98ee-9c6d700517bd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:31:44.232883 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-dd91a2d7-553f-4a04-98ee-9c6d700517bd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1506 microversion: 2.1 time: 0.164955 Sep 21 16:31:44.234095 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 463/1016] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:31:44 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:31:59.599851 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-e34f4812-d2ed-4edd-877a-1d44bab35a5b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5aecdc52-b270-4eed-acac-bca5e851bc2b", "device": "/dev/sdb"}} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:31:59.602873 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-e34f4812-d2ed-4edd-877a-1d44bab35a5b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:31:59.604765 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell0:SELECT=2 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:59.605450 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_api:SELECT=12 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:59.606341 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=24 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:31:59.613271 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e34f4812-d2ed-4edd-877a-1d44bab35a5b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:31:59.613755 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e34f4812-d2ed-4edd-877a-1d44bab35a5b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:31:59.614223 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e34f4812-d2ed-4edd-877a-1d44bab35a5b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:31:59.614926 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e34f4812-d2ed-4edd-877a-1d44bab35a5b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:31:59.615383 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e34f4812-d2ed-4edd-877a-1d44bab35a5b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:31:59.615810 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e34f4812-d2ed-4edd-877a-1d44bab35a5b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:31:59.861930 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-e34f4812-d2ed-4edd-877a-1d44bab35a5b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "POST /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266185 Sep 21 16:31:59.862584 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 554/1017] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Sep 21 16:31:59 2022] POST /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:38:54.957265 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR oslo.messaging._drivers.impl_rabbit [-] [553ea9c1-57dc-451e-b10a-7e2f64159847] AMQP server on 10.222.0.64:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 21 16:38:54.957806 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell0:SELECT=2 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:38:54.958546 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell0:SELECT=6 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:38:54.959057 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:38:54.959668 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=24 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:38:54.960967 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 21 16:38:54.961099 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Wed Sep 21 16:38:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db/os-volume_attachments/5aecdc52-b270-4eed-acac-bca5e851bc2b (ip 10.222.0.64) !!! Sep 21 16:38:54.962308 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 21 16:38:54.962534 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Wed Sep 21 16:38:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db/os-volume_attachments/5aecdc52-b270-4eed-acac-bca5e851bc2b (ip 10.222.0.64) !!! Sep 21 16:38:54.963639 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 21 16:38:54.963759 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Wed Sep 21 16:38:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db/os-volume_attachments/5aecdc52-b270-4eed-acac-bca5e851bc2b (ip 10.222.0.64) !!! Sep 21 16:38:54.969905 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-ddcf180c-5be3-41f3-b7be-2fe80d7e2f32 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:38:54.970417 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-ddcf180c-5be3-41f3-b7be-2fe80d7e2f32 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:38:54.986455 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ddcf180c-5be3-41f3-b7be-2fe80d7e2f32 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:38:54.986935 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ddcf180c-5be3-41f3-b7be-2fe80d7e2f32 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:38:54.987359 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ddcf180c-5be3-41f3-b7be-2fe80d7e2f32 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:38:54.988046 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ddcf180c-5be3-41f3-b7be-2fe80d7e2f32 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:38:54.988489 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ddcf180c-5be3-41f3-b7be-2fe80d7e2f32 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:38:54.988905 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ddcf180c-5be3-41f3-b7be-2fe80d7e2f32 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:38:55.230887 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.objects.instance [None req-ddcf180c-5be3-41f3-b7be-2fe80d7e2f32 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lazy-loading 'services' on Instance uuid f0026951-8625-4521-a6fa-7583577348db {{(pid=120531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 16:38:55.305420 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-ddcf180c-5be3-41f3-b7be-2fe80d7e2f32 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "DELETE /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db/os-volume_attachments/5aecdc52-b270-4eed-acac-bca5e851bc2b" status: 202 len: 0 microversion: 2.1 time: 0.350138 Sep 21 16:38:55.306119 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 464/1018] 10.222.0.64 () {58 vars in 1416 bytes} [Wed Sep 21 16:38:54 2022] DELETE /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db/os-volume_attachments/5aecdc52-b270-4eed-acac-bca5e851bc2b => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 21 16:44:07.185976 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5869e334-ec9b-4aec-be58-31127dba4f24] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 21 16:44:07.187022 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 21 16:44:07.187194 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Wed Sep 21 16:44:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 (ip 10.222.0.64) !!! Sep 21 16:44:07.189069 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_api:SELECT=2 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:44:07.190532 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_api:SELECT=2 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:44:07.191053 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:44:07.191418 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:44:07.192753 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 21 16:44:07.192901 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Wed Sep 21 16:44:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 (ip 10.222.0.64) !!! Sep 21 16:44:07.193118 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 21 16:44:07.193516 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Wed Sep 21 16:44:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.64) !!! Sep 21 16:44:07.194988 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 21 16:44:07.195334 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Wed Sep 21 16:44:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.64) !!! Sep 21 16:44:07.197048 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 21 16:44:07.197235 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 21 16:44:07.197235 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Wed Sep 21 16:44:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 (ip 10.222.0.64) !!! Sep 21 16:44:07.197811 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Wed Sep 21 16:44:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.64) !!! Sep 21 16:44:07.218770 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO oslo.messaging._drivers.impl_rabbit [-] [553ea9c1-57dc-451e-b10a-7e2f64159847] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 35876. Sep 21 16:44:07.226301 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-806a32f7-d5b3-4a97-b6a0-fac174df213e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:07.227094 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-806a32f7-d5b3-4a97-b6a0-fac174df213e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:07.245779 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-806a32f7-d5b3-4a97-b6a0-fac174df213e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:07.246301 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-806a32f7-d5b3-4a97-b6a0-fac174df213e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:07.246741 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-806a32f7-d5b3-4a97-b6a0-fac174df213e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:07.247454 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-806a32f7-d5b3-4a97-b6a0-fac174df213e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:07.247912 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-806a32f7-d5b3-4a97-b6a0-fac174df213e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:07.248342 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-806a32f7-d5b3-4a97-b6a0-fac174df213e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:07.276420 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-806a32f7-d5b3-4a97-b6a0-fac174df213e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Going to try to terminate instance {{(pid=120532) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 16:44:07.312596 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-736416e2-2597-4c4b-9f87-58b4fe9446fe req-481a71ad-94d6-4b81-8160-860f1e127848 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15ec6390-e13e-4e88-8bdc-62507b36a9a6", "tag": "ce1a423d-237c-4ca8-8c26-29b613b76535"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:44:07.376104 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-806a32f7-d5b3-4a97-b6a0-fac174df213e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "DELETE /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 204 len: 0 microversion: 2.1 time: 0.190360 Sep 21 16:44:07.377688 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 555/1019] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Sep 21 16:44:07 2022] DELETE /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 21 16:44:07.389594 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-1ee2cc5a-9890-4b24-b055-4fa0e7f2f3a7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:07.390430 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-1ee2cc5a-9890-4b24-b055-4fa0e7f2f3a7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:07.398351 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1ee2cc5a-9890-4b24-b055-4fa0e7f2f3a7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:07.398823 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1ee2cc5a-9890-4b24-b055-4fa0e7f2f3a7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:07.399268 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1ee2cc5a-9890-4b24-b055-4fa0e7f2f3a7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:07.400001 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1ee2cc5a-9890-4b24-b055-4fa0e7f2f3a7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:07.400545 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1ee2cc5a-9890-4b24-b055-4fa0e7f2f3a7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:07.400981 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1ee2cc5a-9890-4b24-b055-4fa0e7f2f3a7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:07.530417 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-736416e2-2597-4c4b-9f87-58b4fe9446fe req-481a71ad-94d6-4b81-8160-860f1e127848 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:07.530759 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-736416e2-2597-4c4b-9f87-58b4fe9446fe req-481a71ad-94d6-4b81-8160-860f1e127848 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:07.531585 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-736416e2-2597-4c4b-9f87-58b4fe9446fe req-481a71ad-94d6-4b81-8160-860f1e127848 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:07.542717 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-736416e2-2597-4c4b-9f87-58b4fe9446fe req-481a71ad-94d6-4b81-8160-860f1e127848 service nova] Creating event network-changed:ce1a423d-237c-4ca8-8c26-29b613b76535 for instance 15ec6390-e13e-4e88-8bdc-62507b36a9a6 on hv-cinder-85862 Sep 21 16:44:07.548830 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-736416e2-2597-4c4b-9f87-58b4fe9446fe req-481a71ad-94d6-4b81-8160-860f1e127848 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.362205 Sep 21 16:44:07.549740 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 465/1020] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:44:07.683616 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-1ee2cc5a-9890-4b24-b055-4fa0e7f2f3a7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:07.692373 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-1ee2cc5a-9890-4b24-b055-4fa0e7f2f3a7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1578 microversion: 2.1 time: 0.309410 Sep 21 16:44:07.693369 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 556/1021] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:07 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1578 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:08.717061 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-1433c04b-473a-4235-a907-4067de18f3dd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:08.717927 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-1433c04b-473a-4235-a907-4067de18f3dd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:08.731390 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO oslo.messaging._drivers.impl_rabbit [-] [5869e334-ec9b-4aec-be58-31127dba4f24] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 35908. Sep 21 16:44:08.735516 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1433c04b-473a-4235-a907-4067de18f3dd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:08.736037 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1433c04b-473a-4235-a907-4067de18f3dd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:08.736655 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1433c04b-473a-4235-a907-4067de18f3dd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:08.737357 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1433c04b-473a-4235-a907-4067de18f3dd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:08.738220 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1433c04b-473a-4235-a907-4067de18f3dd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:08.738628 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1433c04b-473a-4235-a907-4067de18f3dd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:08.760857 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-7077b1b0-2c0e-45ed-8337-4921a5c78642 req-fa572a25-5097-4423-a1f3-27f5272eb073 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15ec6390-e13e-4e88-8bdc-62507b36a9a6", "name": "network-vif-deleted", "tag": "ce1a423d-237c-4ca8-8c26-29b613b76535"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:44:08.771572 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-7077b1b0-2c0e-45ed-8337-4921a5c78642 req-fa572a25-5097-4423-a1f3-27f5272eb073 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:08.772052 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-7077b1b0-2c0e-45ed-8337-4921a5c78642 req-fa572a25-5097-4423-a1f3-27f5272eb073 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:08.772470 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-7077b1b0-2c0e-45ed-8337-4921a5c78642 req-fa572a25-5097-4423-a1f3-27f5272eb073 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:08.783794 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-7077b1b0-2c0e-45ed-8337-4921a5c78642 req-fa572a25-5097-4423-a1f3-27f5272eb073 service nova] Creating event network-vif-deleted:ce1a423d-237c-4ca8-8c26-29b613b76535 for instance 15ec6390-e13e-4e88-8bdc-62507b36a9a6 on hv-cinder-85862 Sep 21 16:44:08.789007 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-7077b1b0-2c0e-45ed-8337-4921a5c78642 req-fa572a25-5097-4423-a1f3-27f5272eb073 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092597 Sep 21 16:44:08.789636 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 466/1022] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:44:08.811089 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-1433c04b-473a-4235-a907-4067de18f3dd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:08.818942 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-1433c04b-473a-4235-a907-4067de18f3dd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.106087 Sep 21 16:44:08.820035 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 557/1023] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:08 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:44:09.847873 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-10451138-cf9f-46df-8ee5-4f40d306168c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:09.848671 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-10451138-cf9f-46df-8ee5-4f40d306168c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:09.855020 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-10451138-cf9f-46df-8ee5-4f40d306168c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:09.855509 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-10451138-cf9f-46df-8ee5-4f40d306168c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:09.855941 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-10451138-cf9f-46df-8ee5-4f40d306168c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:09.856640 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-10451138-cf9f-46df-8ee5-4f40d306168c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:09.857093 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-10451138-cf9f-46df-8ee5-4f40d306168c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:09.857522 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-10451138-cf9f-46df-8ee5-4f40d306168c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:09.975374 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-10451138-cf9f-46df-8ee5-4f40d306168c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:09.983118 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-10451138-cf9f-46df-8ee5-4f40d306168c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.141274 Sep 21 16:44:09.983667 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 467/1024] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:09 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:11.004953 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-411ed4f2-721f-4fef-8c82-ee0dd1c0f0d0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:11.005604 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-411ed4f2-721f-4fef-8c82-ee0dd1c0f0d0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:11.011950 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-411ed4f2-721f-4fef-8c82-ee0dd1c0f0d0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:11.012474 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-411ed4f2-721f-4fef-8c82-ee0dd1c0f0d0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:11.012909 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-411ed4f2-721f-4fef-8c82-ee0dd1c0f0d0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:11.013595 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-411ed4f2-721f-4fef-8c82-ee0dd1c0f0d0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:11.014079 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-411ed4f2-721f-4fef-8c82-ee0dd1c0f0d0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:11.014484 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-411ed4f2-721f-4fef-8c82-ee0dd1c0f0d0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:11.075478 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-411ed4f2-721f-4fef-8c82-ee0dd1c0f0d0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:11.084414 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-411ed4f2-721f-4fef-8c82-ee0dd1c0f0d0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083384 Sep 21 16:44:11.085057 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 558/1025] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:10 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:12.108295 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-b300a42e-ed45-404f-8ff3-b1a1ecdc986d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:12.108901 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-b300a42e-ed45-404f-8ff3-b1a1ecdc986d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:12.115211 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b300a42e-ed45-404f-8ff3-b1a1ecdc986d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:12.115685 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b300a42e-ed45-404f-8ff3-b1a1ecdc986d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:12.116109 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b300a42e-ed45-404f-8ff3-b1a1ecdc986d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:12.116789 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b300a42e-ed45-404f-8ff3-b1a1ecdc986d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:12.117236 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b300a42e-ed45-404f-8ff3-b1a1ecdc986d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:12.117648 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b300a42e-ed45-404f-8ff3-b1a1ecdc986d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:12.182488 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-b300a42e-ed45-404f-8ff3-b1a1ecdc986d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:12.190955 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-b300a42e-ed45-404f-8ff3-b1a1ecdc986d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.086459 Sep 21 16:44:12.191519 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 468/1026] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:12 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:13.214458 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-4d25529a-9fb9-45d7-bbb7-0f73c0454649 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:13.215057 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-4d25529a-9fb9-45d7-bbb7-0f73c0454649 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:13.221437 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4d25529a-9fb9-45d7-bbb7-0f73c0454649 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:13.221917 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4d25529a-9fb9-45d7-bbb7-0f73c0454649 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:13.222385 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4d25529a-9fb9-45d7-bbb7-0f73c0454649 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:13.223075 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4d25529a-9fb9-45d7-bbb7-0f73c0454649 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:13.223537 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4d25529a-9fb9-45d7-bbb7-0f73c0454649 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:13.223956 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4d25529a-9fb9-45d7-bbb7-0f73c0454649 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:13.285549 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-4d25529a-9fb9-45d7-bbb7-0f73c0454649 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:13.293434 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-4d25529a-9fb9-45d7-bbb7-0f73c0454649 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082947 Sep 21 16:44:13.294005 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 559/1027] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:13 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:14.316145 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-bd47010f-f283-4ceb-bf6e-6f24cc696362 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:14.316749 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-bd47010f-f283-4ceb-bf6e-6f24cc696362 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:14.323379 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bd47010f-f283-4ceb-bf6e-6f24cc696362 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:14.323864 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bd47010f-f283-4ceb-bf6e-6f24cc696362 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:14.324300 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bd47010f-f283-4ceb-bf6e-6f24cc696362 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:14.325023 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bd47010f-f283-4ceb-bf6e-6f24cc696362 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:14.325480 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bd47010f-f283-4ceb-bf6e-6f24cc696362 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:14.325902 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bd47010f-f283-4ceb-bf6e-6f24cc696362 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:14.385622 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-bd47010f-f283-4ceb-bf6e-6f24cc696362 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:14.393223 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-bd47010f-f283-4ceb-bf6e-6f24cc696362 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081009 Sep 21 16:44:14.393815 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 469/1028] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:14 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:15.416470 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-7fda7690-9407-432a-a639-a997deac0411 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:15.417075 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-7fda7690-9407-432a-a639-a997deac0411 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:15.423496 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7fda7690-9407-432a-a639-a997deac0411 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:15.423996 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7fda7690-9407-432a-a639-a997deac0411 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:15.424429 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7fda7690-9407-432a-a639-a997deac0411 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:15.425122 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7fda7690-9407-432a-a639-a997deac0411 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:15.425579 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7fda7690-9407-432a-a639-a997deac0411 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:15.426003 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7fda7690-9407-432a-a639-a997deac0411 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:15.486662 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-7fda7690-9407-432a-a639-a997deac0411 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:15.494518 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-7fda7690-9407-432a-a639-a997deac0411 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081867 Sep 21 16:44:15.495089 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 560/1029] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:15 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:16.518147 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-094eeedd-a497-4256-8bfe-e36f4536c907 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:16.518762 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-094eeedd-a497-4256-8bfe-e36f4536c907 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:16.525306 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-094eeedd-a497-4256-8bfe-e36f4536c907 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:16.525791 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-094eeedd-a497-4256-8bfe-e36f4536c907 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:16.526256 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-094eeedd-a497-4256-8bfe-e36f4536c907 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:16.526945 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-094eeedd-a497-4256-8bfe-e36f4536c907 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:16.527398 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-094eeedd-a497-4256-8bfe-e36f4536c907 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:16.527823 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-094eeedd-a497-4256-8bfe-e36f4536c907 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:16.588231 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-094eeedd-a497-4256-8bfe-e36f4536c907 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:16.596497 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-094eeedd-a497-4256-8bfe-e36f4536c907 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082901 Sep 21 16:44:16.597049 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 470/1030] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:16 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:17.621393 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-a7cc52d5-e026-42dc-b90b-c4f089fee4a4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:17.622019 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-a7cc52d5-e026-42dc-b90b-c4f089fee4a4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:17.629151 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a7cc52d5-e026-42dc-b90b-c4f089fee4a4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:17.629640 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a7cc52d5-e026-42dc-b90b-c4f089fee4a4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:17.630105 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a7cc52d5-e026-42dc-b90b-c4f089fee4a4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:17.630802 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a7cc52d5-e026-42dc-b90b-c4f089fee4a4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:17.631260 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a7cc52d5-e026-42dc-b90b-c4f089fee4a4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:17.631686 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a7cc52d5-e026-42dc-b90b-c4f089fee4a4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:17.694872 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a7cc52d5-e026-42dc-b90b-c4f089fee4a4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:17.702677 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-a7cc52d5-e026-42dc-b90b-c4f089fee4a4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.086166 Sep 21 16:44:17.703246 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 561/1031] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:17 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:18.727507 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-792c3d21-ac68-4eaf-be98-e2d2e80f52dc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:18.728584 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-792c3d21-ac68-4eaf-be98-e2d2e80f52dc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:18.735326 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-792c3d21-ac68-4eaf-be98-e2d2e80f52dc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:18.736468 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-792c3d21-ac68-4eaf-be98-e2d2e80f52dc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:18.736946 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-792c3d21-ac68-4eaf-be98-e2d2e80f52dc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:18.737582 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-792c3d21-ac68-4eaf-be98-e2d2e80f52dc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:18.738028 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-792c3d21-ac68-4eaf-be98-e2d2e80f52dc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:18.738466 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-792c3d21-ac68-4eaf-be98-e2d2e80f52dc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:18.801395 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-792c3d21-ac68-4eaf-be98-e2d2e80f52dc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:18.809045 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-792c3d21-ac68-4eaf-be98-e2d2e80f52dc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.087018 Sep 21 16:44:18.809597 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 471/1032] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:18 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:19.833634 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-75b131d2-3820-42f6-8e4d-c2dcc4dff7a1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:19.834278 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-75b131d2-3820-42f6-8e4d-c2dcc4dff7a1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:19.841041 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-75b131d2-3820-42f6-8e4d-c2dcc4dff7a1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:19.841540 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-75b131d2-3820-42f6-8e4d-c2dcc4dff7a1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:19.841974 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-75b131d2-3820-42f6-8e4d-c2dcc4dff7a1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:19.842707 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-75b131d2-3820-42f6-8e4d-c2dcc4dff7a1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:19.843165 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-75b131d2-3820-42f6-8e4d-c2dcc4dff7a1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:19.843588 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-75b131d2-3820-42f6-8e4d-c2dcc4dff7a1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:19.912142 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-75b131d2-3820-42f6-8e4d-c2dcc4dff7a1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:19.920209 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-75b131d2-3820-42f6-8e4d-c2dcc4dff7a1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.091309 Sep 21 16:44:19.920805 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 562/1033] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:19 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:20.943709 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d609f6d9-9fde-4da3-9643-7b3531c5cc83 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:20.944305 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d609f6d9-9fde-4da3-9643-7b3531c5cc83 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:20.950651 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d609f6d9-9fde-4da3-9643-7b3531c5cc83 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:20.951127 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d609f6d9-9fde-4da3-9643-7b3531c5cc83 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:20.951554 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d609f6d9-9fde-4da3-9643-7b3531c5cc83 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:20.952240 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d609f6d9-9fde-4da3-9643-7b3531c5cc83 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:20.952688 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d609f6d9-9fde-4da3-9643-7b3531c5cc83 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:20.953104 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d609f6d9-9fde-4da3-9643-7b3531c5cc83 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:21.017898 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d609f6d9-9fde-4da3-9643-7b3531c5cc83 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:21.025697 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d609f6d9-9fde-4da3-9643-7b3531c5cc83 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.085829 Sep 21 16:44:21.026281 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 472/1034] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:20 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:22.048927 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-482f151f-5f88-4910-ac36-87762addb497 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:22.049585 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-482f151f-5f88-4910-ac36-87762addb497 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:22.056081 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-482f151f-5f88-4910-ac36-87762addb497 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:22.056560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-482f151f-5f88-4910-ac36-87762addb497 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:22.056991 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-482f151f-5f88-4910-ac36-87762addb497 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:22.057689 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-482f151f-5f88-4910-ac36-87762addb497 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:22.058174 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-482f151f-5f88-4910-ac36-87762addb497 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:22.058600 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-482f151f-5f88-4910-ac36-87762addb497 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:22.119694 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-482f151f-5f88-4910-ac36-87762addb497 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:22.128191 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-482f151f-5f88-4910-ac36-87762addb497 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083925 Sep 21 16:44:22.128780 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 563/1035] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:22 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:23.151628 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d83b4f25-ad0d-4af1-9b27-4349df133def tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:23.152227 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d83b4f25-ad0d-4af1-9b27-4349df133def tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:23.160174 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d83b4f25-ad0d-4af1-9b27-4349df133def tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:23.160652 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d83b4f25-ad0d-4af1-9b27-4349df133def tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:23.161081 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d83b4f25-ad0d-4af1-9b27-4349df133def tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:23.161769 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d83b4f25-ad0d-4af1-9b27-4349df133def tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:23.162247 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d83b4f25-ad0d-4af1-9b27-4349df133def tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:23.162668 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d83b4f25-ad0d-4af1-9b27-4349df133def tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:23.222713 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d83b4f25-ad0d-4af1-9b27-4349df133def tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:23.230340 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d83b4f25-ad0d-4af1-9b27-4349df133def tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082559 Sep 21 16:44:23.230901 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 473/1036] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:23 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:24.253414 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-bb231bdb-e160-43c5-86ee-cd25e7a55329 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:24.254004 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-bb231bdb-e160-43c5-86ee-cd25e7a55329 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:24.260339 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb231bdb-e160-43c5-86ee-cd25e7a55329 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:24.260811 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb231bdb-e160-43c5-86ee-cd25e7a55329 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:24.261239 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb231bdb-e160-43c5-86ee-cd25e7a55329 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:24.261940 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb231bdb-e160-43c5-86ee-cd25e7a55329 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:24.262398 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb231bdb-e160-43c5-86ee-cd25e7a55329 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:24.262818 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb231bdb-e160-43c5-86ee-cd25e7a55329 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:24.324874 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-bb231bdb-e160-43c5-86ee-cd25e7a55329 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:24.332918 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-bb231bdb-e160-43c5-86ee-cd25e7a55329 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083987 Sep 21 16:44:24.333489 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 564/1037] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:24 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:25.355503 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-fd59983f-8eb8-4062-89a7-f25733ae8a5e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:25.356119 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-fd59983f-8eb8-4062-89a7-f25733ae8a5e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:25.363068 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fd59983f-8eb8-4062-89a7-f25733ae8a5e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:25.363554 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fd59983f-8eb8-4062-89a7-f25733ae8a5e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:25.363993 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fd59983f-8eb8-4062-89a7-f25733ae8a5e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:25.364685 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fd59983f-8eb8-4062-89a7-f25733ae8a5e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:25.365142 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fd59983f-8eb8-4062-89a7-f25733ae8a5e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:25.365573 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fd59983f-8eb8-4062-89a7-f25733ae8a5e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:25.426678 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-fd59983f-8eb8-4062-89a7-f25733ae8a5e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:25.434252 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-fd59983f-8eb8-4062-89a7-f25733ae8a5e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082663 Sep 21 16:44:25.434821 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 474/1038] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:25 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:26.456747 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-5388ac18-e3f3-4825-9c01-d245b052b41a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:26.457386 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-5388ac18-e3f3-4825-9c01-d245b052b41a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:26.463884 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5388ac18-e3f3-4825-9c01-d245b052b41a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:26.464380 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5388ac18-e3f3-4825-9c01-d245b052b41a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:26.464800 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5388ac18-e3f3-4825-9c01-d245b052b41a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:26.465489 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5388ac18-e3f3-4825-9c01-d245b052b41a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:26.465944 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5388ac18-e3f3-4825-9c01-d245b052b41a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:26.466382 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5388ac18-e3f3-4825-9c01-d245b052b41a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:26.531105 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5388ac18-e3f3-4825-9c01-d245b052b41a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:26.539467 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-5388ac18-e3f3-4825-9c01-d245b052b41a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.086895 Sep 21 16:44:26.540035 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 565/1039] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:26 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:27.562450 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d06b413b-af0a-4555-80b7-accd35811844 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:27.563062 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d06b413b-af0a-4555-80b7-accd35811844 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:27.569493 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d06b413b-af0a-4555-80b7-accd35811844 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:27.569979 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d06b413b-af0a-4555-80b7-accd35811844 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:27.570470 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d06b413b-af0a-4555-80b7-accd35811844 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:27.571158 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d06b413b-af0a-4555-80b7-accd35811844 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:27.571615 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d06b413b-af0a-4555-80b7-accd35811844 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:27.572036 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d06b413b-af0a-4555-80b7-accd35811844 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:27.632262 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d06b413b-af0a-4555-80b7-accd35811844 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:27.639923 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d06b413b-af0a-4555-80b7-accd35811844 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081322 Sep 21 16:44:27.640485 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 475/1040] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:27 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:28.663067 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-8f656b5f-d941-4a61-8210-646c0d954742 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:28.663657 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-8f656b5f-d941-4a61-8210-646c0d954742 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:28.670534 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8f656b5f-d941-4a61-8210-646c0d954742 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:28.671017 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8f656b5f-d941-4a61-8210-646c0d954742 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:28.671449 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8f656b5f-d941-4a61-8210-646c0d954742 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:28.672140 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8f656b5f-d941-4a61-8210-646c0d954742 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:28.672592 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8f656b5f-d941-4a61-8210-646c0d954742 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:28.673614 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8f656b5f-d941-4a61-8210-646c0d954742 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:28.735456 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-8f656b5f-d941-4a61-8210-646c0d954742 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:28.743263 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-8f656b5f-d941-4a61-8210-646c0d954742 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.084055 Sep 21 16:44:28.743776 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 566/1041] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:28 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:29.765663 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-5270bd2e-bc03-42cf-abab-7abf767df743 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:29.766272 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-5270bd2e-bc03-42cf-abab-7abf767df743 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:29.773253 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5270bd2e-bc03-42cf-abab-7abf767df743 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:29.773742 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5270bd2e-bc03-42cf-abab-7abf767df743 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:29.774212 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5270bd2e-bc03-42cf-abab-7abf767df743 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:29.774915 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5270bd2e-bc03-42cf-abab-7abf767df743 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:29.775404 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5270bd2e-bc03-42cf-abab-7abf767df743 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:29.775832 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5270bd2e-bc03-42cf-abab-7abf767df743 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:29.839129 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-5270bd2e-bc03-42cf-abab-7abf767df743 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:29.847156 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-5270bd2e-bc03-42cf-abab-7abf767df743 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.085406 Sep 21 16:44:29.848050 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 476/1042] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:29 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:30.876365 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-2bf4fcdc-9162-46b4-8783-08e589c381a3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:30.876924 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-2bf4fcdc-9162-46b4-8783-08e589c381a3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:30.883477 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2bf4fcdc-9162-46b4-8783-08e589c381a3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:30.883974 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2bf4fcdc-9162-46b4-8783-08e589c381a3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:30.884408 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2bf4fcdc-9162-46b4-8783-08e589c381a3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:30.885101 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2bf4fcdc-9162-46b4-8783-08e589c381a3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:30.885559 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2bf4fcdc-9162-46b4-8783-08e589c381a3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:30.885997 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2bf4fcdc-9162-46b4-8783-08e589c381a3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:30.946368 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-2bf4fcdc-9162-46b4-8783-08e589c381a3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:30.954369 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-2bf4fcdc-9162-46b4-8783-08e589c381a3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081966 Sep 21 16:44:30.954943 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 567/1043] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:30 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:31.977178 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-a3260aff-7a21-43ca-b3e3-cff0da3634a2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:31.977819 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-a3260aff-7a21-43ca-b3e3-cff0da3634a2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:31.984295 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a3260aff-7a21-43ca-b3e3-cff0da3634a2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:31.984781 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a3260aff-7a21-43ca-b3e3-cff0da3634a2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:31.985215 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a3260aff-7a21-43ca-b3e3-cff0da3634a2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:31.985988 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a3260aff-7a21-43ca-b3e3-cff0da3634a2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:31.986466 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a3260aff-7a21-43ca-b3e3-cff0da3634a2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:31.986889 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a3260aff-7a21-43ca-b3e3-cff0da3634a2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:32.049264 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-a3260aff-7a21-43ca-b3e3-cff0da3634a2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:32.056870 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-a3260aff-7a21-43ca-b3e3-cff0da3634a2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083659 Sep 21 16:44:32.057429 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 477/1044] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:31 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:33.080654 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-a1904f62-ab72-4963-b75f-c84f05705b94 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:33.081212 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-a1904f62-ab72-4963-b75f-c84f05705b94 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:33.087609 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a1904f62-ab72-4963-b75f-c84f05705b94 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:33.088090 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a1904f62-ab72-4963-b75f-c84f05705b94 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:33.088523 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a1904f62-ab72-4963-b75f-c84f05705b94 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:33.089210 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a1904f62-ab72-4963-b75f-c84f05705b94 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:33.089662 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a1904f62-ab72-4963-b75f-c84f05705b94 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:33.090143 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a1904f62-ab72-4963-b75f-c84f05705b94 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:33.154247 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a1904f62-ab72-4963-b75f-c84f05705b94 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:33.162458 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-a1904f62-ab72-4963-b75f-c84f05705b94 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.086737 Sep 21 16:44:33.163036 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 568/1045] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:33 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:34.185682 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-fc3f3fcf-a750-44dc-8a23-67f503cf9b79 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:34.186324 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-fc3f3fcf-a750-44dc-8a23-67f503cf9b79 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:34.193223 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fc3f3fcf-a750-44dc-8a23-67f503cf9b79 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:34.193710 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fc3f3fcf-a750-44dc-8a23-67f503cf9b79 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:34.194179 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fc3f3fcf-a750-44dc-8a23-67f503cf9b79 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:34.194892 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fc3f3fcf-a750-44dc-8a23-67f503cf9b79 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:34.195346 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fc3f3fcf-a750-44dc-8a23-67f503cf9b79 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:34.195769 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fc3f3fcf-a750-44dc-8a23-67f503cf9b79 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:34.257932 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-fc3f3fcf-a750-44dc-8a23-67f503cf9b79 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:34.265608 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-fc3f3fcf-a750-44dc-8a23-67f503cf9b79 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083828 Sep 21 16:44:34.266188 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 478/1046] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:34 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:35.289224 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-4c1de96c-c7ac-4bcd-9890-006df20413ae tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:35.289776 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-4c1de96c-c7ac-4bcd-9890-006df20413ae tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:35.296095 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4c1de96c-c7ac-4bcd-9890-006df20413ae tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:35.296574 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4c1de96c-c7ac-4bcd-9890-006df20413ae tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:35.297000 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4c1de96c-c7ac-4bcd-9890-006df20413ae tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:35.297693 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4c1de96c-c7ac-4bcd-9890-006df20413ae tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:35.298169 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4c1de96c-c7ac-4bcd-9890-006df20413ae tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:35.298589 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4c1de96c-c7ac-4bcd-9890-006df20413ae tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:35.364248 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-4c1de96c-c7ac-4bcd-9890-006df20413ae tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:35.367617 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:44:35.372601 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-4c1de96c-c7ac-4bcd-9890-006df20413ae tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.087529 Sep 21 16:44:35.373165 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 569/1047] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:35 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:36.396188 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-700fea29-22e1-4110-bf55-7e7dbf0e8605 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:36.396834 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-700fea29-22e1-4110-bf55-7e7dbf0e8605 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:36.403176 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-700fea29-22e1-4110-bf55-7e7dbf0e8605 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:36.403653 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-700fea29-22e1-4110-bf55-7e7dbf0e8605 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:36.404080 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-700fea29-22e1-4110-bf55-7e7dbf0e8605 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:36.404790 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-700fea29-22e1-4110-bf55-7e7dbf0e8605 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:36.405241 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-700fea29-22e1-4110-bf55-7e7dbf0e8605 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:36.405653 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-700fea29-22e1-4110-bf55-7e7dbf0e8605 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:36.471778 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-700fea29-22e1-4110-bf55-7e7dbf0e8605 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:36.479759 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-700fea29-22e1-4110-bf55-7e7dbf0e8605 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.087463 Sep 21 16:44:36.480357 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 479/1048] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:36 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:37.503362 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ecc499d8-d618-4eef-9740-8207e280d538 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:37.503967 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ecc499d8-d618-4eef-9740-8207e280d538 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:37.506216 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:44:37.512845 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ecc499d8-d618-4eef-9740-8207e280d538 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:37.513321 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ecc499d8-d618-4eef-9740-8207e280d538 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:37.513748 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ecc499d8-d618-4eef-9740-8207e280d538 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:37.514467 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ecc499d8-d618-4eef-9740-8207e280d538 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:37.514918 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ecc499d8-d618-4eef-9740-8207e280d538 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:37.515336 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ecc499d8-d618-4eef-9740-8207e280d538 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:37.577464 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ecc499d8-d618-4eef-9740-8207e280d538 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:37.585467 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ecc499d8-d618-4eef-9740-8207e280d538 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.086472 Sep 21 16:44:37.585975 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 570/1049] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:37 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:38.608639 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-b52b23b4-2890-480c-948c-b9a3ab705136 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:38.609288 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-b52b23b4-2890-480c-948c-b9a3ab705136 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:38.611483 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_api:SELECT=31 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:44:38.617022 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b52b23b4-2890-480c-948c-b9a3ab705136 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:38.617504 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b52b23b4-2890-480c-948c-b9a3ab705136 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:38.617938 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b52b23b4-2890-480c-948c-b9a3ab705136 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:38.618651 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b52b23b4-2890-480c-948c-b9a3ab705136 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:38.619106 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b52b23b4-2890-480c-948c-b9a3ab705136 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:38.619531 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b52b23b4-2890-480c-948c-b9a3ab705136 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:38.622227 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=83 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:44:38.685125 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-b52b23b4-2890-480c-948c-b9a3ab705136 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:38.692825 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-b52b23b4-2890-480c-948c-b9a3ab705136 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.088180 Sep 21 16:44:38.693401 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 480/1050] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:38 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:39.717612 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-9743314b-5bc3-473e-8c70-ac1ea15b678c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:39.718258 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-9743314b-5bc3-473e-8c70-ac1ea15b678c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:39.724623 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9743314b-5bc3-473e-8c70-ac1ea15b678c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:39.725107 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9743314b-5bc3-473e-8c70-ac1ea15b678c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:39.725542 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9743314b-5bc3-473e-8c70-ac1ea15b678c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:39.726265 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9743314b-5bc3-473e-8c70-ac1ea15b678c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:39.726726 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9743314b-5bc3-473e-8c70-ac1ea15b678c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:39.727153 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9743314b-5bc3-473e-8c70-ac1ea15b678c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:39.789685 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-9743314b-5bc3-473e-8c70-ac1ea15b678c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:39.797593 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-9743314b-5bc3-473e-8c70-ac1ea15b678c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.084191 Sep 21 16:44:39.798197 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 571/1051] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:39 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:40.820197 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-bc76473a-0c9a-41be-9223-52aa33a60a14 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:40.820818 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-bc76473a-0c9a-41be-9223-52aa33a60a14 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:40.827417 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bc76473a-0c9a-41be-9223-52aa33a60a14 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:40.827908 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bc76473a-0c9a-41be-9223-52aa33a60a14 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:40.828340 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bc76473a-0c9a-41be-9223-52aa33a60a14 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:40.829357 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bc76473a-0c9a-41be-9223-52aa33a60a14 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:40.829821 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bc76473a-0c9a-41be-9223-52aa33a60a14 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:40.830276 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bc76473a-0c9a-41be-9223-52aa33a60a14 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:40.892499 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-bc76473a-0c9a-41be-9223-52aa33a60a14 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:40.900223 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-bc76473a-0c9a-41be-9223-52aa33a60a14 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083909 Sep 21 16:44:40.900786 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 481/1052] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:40 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:41.924247 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-a60fe00b-76ed-4955-8ed6-ded8c371b092 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:41.924813 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-a60fe00b-76ed-4955-8ed6-ded8c371b092 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:41.931255 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a60fe00b-76ed-4955-8ed6-ded8c371b092 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:41.931765 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a60fe00b-76ed-4955-8ed6-ded8c371b092 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:41.932195 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a60fe00b-76ed-4955-8ed6-ded8c371b092 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:41.932886 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a60fe00b-76ed-4955-8ed6-ded8c371b092 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:41.933338 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a60fe00b-76ed-4955-8ed6-ded8c371b092 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:41.933764 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a60fe00b-76ed-4955-8ed6-ded8c371b092 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:41.994801 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a60fe00b-76ed-4955-8ed6-ded8c371b092 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:42.002938 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-a60fe00b-76ed-4955-8ed6-ded8c371b092 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083284 Sep 21 16:44:42.003512 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 572/1053] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:41 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:43.026284 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-ebe5a6db-99b6-43c8-a928-b6df96f92a37 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:43.026919 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-ebe5a6db-99b6-43c8-a928-b6df96f92a37 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:43.033934 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ebe5a6db-99b6-43c8-a928-b6df96f92a37 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:43.034444 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ebe5a6db-99b6-43c8-a928-b6df96f92a37 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:43.034874 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ebe5a6db-99b6-43c8-a928-b6df96f92a37 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:43.035567 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ebe5a6db-99b6-43c8-a928-b6df96f92a37 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:43.036014 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ebe5a6db-99b6-43c8-a928-b6df96f92a37 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:43.036429 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ebe5a6db-99b6-43c8-a928-b6df96f92a37 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:43.097998 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-ebe5a6db-99b6-43c8-a928-b6df96f92a37 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:43.105681 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-ebe5a6db-99b6-43c8-a928-b6df96f92a37 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083402 Sep 21 16:44:43.106289 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 482/1054] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:43 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:44.129852 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-680ebb1b-20bf-4877-99f8-7d5d8ef5642d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:44.130934 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-680ebb1b-20bf-4877-99f8-7d5d8ef5642d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:44.137813 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-680ebb1b-20bf-4877-99f8-7d5d8ef5642d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:44.138366 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-680ebb1b-20bf-4877-99f8-7d5d8ef5642d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:44.138809 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-680ebb1b-20bf-4877-99f8-7d5d8ef5642d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:44.139525 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-680ebb1b-20bf-4877-99f8-7d5d8ef5642d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:44.139987 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-680ebb1b-20bf-4877-99f8-7d5d8ef5642d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:44.140420 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-680ebb1b-20bf-4877-99f8-7d5d8ef5642d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:44.207602 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-680ebb1b-20bf-4877-99f8-7d5d8ef5642d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:44.215423 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-680ebb1b-20bf-4877-99f8-7d5d8ef5642d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.090371 Sep 21 16:44:44.216071 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 573/1055] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:44 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:45.239445 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d6602cd1-71d0-4160-9ab2-baa17f0115fc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:45.240042 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d6602cd1-71d0-4160-9ab2-baa17f0115fc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:45.246578 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d6602cd1-71d0-4160-9ab2-baa17f0115fc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:45.247066 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d6602cd1-71d0-4160-9ab2-baa17f0115fc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:45.247502 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d6602cd1-71d0-4160-9ab2-baa17f0115fc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:45.248194 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d6602cd1-71d0-4160-9ab2-baa17f0115fc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:45.248674 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d6602cd1-71d0-4160-9ab2-baa17f0115fc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:45.249076 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d6602cd1-71d0-4160-9ab2-baa17f0115fc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:45.309472 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d6602cd1-71d0-4160-9ab2-baa17f0115fc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:45.317193 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d6602cd1-71d0-4160-9ab2-baa17f0115fc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082385 Sep 21 16:44:45.317749 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 483/1056] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:45 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:46.340745 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ab74082c-ef58-447b-ac55-5035b231f481 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:46.341362 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ab74082c-ef58-447b-ac55-5035b231f481 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:46.348545 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ab74082c-ef58-447b-ac55-5035b231f481 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:46.349027 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ab74082c-ef58-447b-ac55-5035b231f481 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:46.349461 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ab74082c-ef58-447b-ac55-5035b231f481 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:46.350176 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ab74082c-ef58-447b-ac55-5035b231f481 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:46.350633 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ab74082c-ef58-447b-ac55-5035b231f481 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:46.351053 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ab74082c-ef58-447b-ac55-5035b231f481 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:46.410959 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ab74082c-ef58-447b-ac55-5035b231f481 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:46.419044 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ab74082c-ef58-447b-ac55-5035b231f481 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082244 Sep 21 16:44:46.419618 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 574/1057] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:46 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:44:47.442340 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-fba68272-1e33-481f-bcdd-e51f36b78d40 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:47.442969 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-fba68272-1e33-481f-bcdd-e51f36b78d40 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:47.449402 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fba68272-1e33-481f-bcdd-e51f36b78d40 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:47.449878 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fba68272-1e33-481f-bcdd-e51f36b78d40 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:47.450345 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fba68272-1e33-481f-bcdd-e51f36b78d40 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:47.451143 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fba68272-1e33-481f-bcdd-e51f36b78d40 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:47.451594 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fba68272-1e33-481f-bcdd-e51f36b78d40 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:47.452010 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fba68272-1e33-481f-bcdd-e51f36b78d40 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:47.521509 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-fba68272-1e33-481f-bcdd-e51f36b78d40 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:47.529723 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-fba68272-1e33-481f-bcdd-e51f36b78d40 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.091806 Sep 21 16:44:47.530336 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 484/1058] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:47 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:48.552587 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-fd8b29b9-b0e1-4809-8e1c-6ef219769f60 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:48.553198 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-fd8b29b9-b0e1-4809-8e1c-6ef219769f60 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:48.559633 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fd8b29b9-b0e1-4809-8e1c-6ef219769f60 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:48.560104 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fd8b29b9-b0e1-4809-8e1c-6ef219769f60 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:48.560543 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fd8b29b9-b0e1-4809-8e1c-6ef219769f60 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:48.561229 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fd8b29b9-b0e1-4809-8e1c-6ef219769f60 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:48.561676 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fd8b29b9-b0e1-4809-8e1c-6ef219769f60 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:48.562122 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fd8b29b9-b0e1-4809-8e1c-6ef219769f60 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:48.624697 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-fd8b29b9-b0e1-4809-8e1c-6ef219769f60 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:48.633054 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-fd8b29b9-b0e1-4809-8e1c-6ef219769f60 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.084591 Sep 21 16:44:48.633677 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 575/1059] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:48 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:49.657298 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-8421c741-04aa-4ce5-8f14-d5f3a303ec59 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:49.657991 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-8421c741-04aa-4ce5-8f14-d5f3a303ec59 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:49.664592 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8421c741-04aa-4ce5-8f14-d5f3a303ec59 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:49.665074 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8421c741-04aa-4ce5-8f14-d5f3a303ec59 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:49.665509 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8421c741-04aa-4ce5-8f14-d5f3a303ec59 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:49.666235 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8421c741-04aa-4ce5-8f14-d5f3a303ec59 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:49.666692 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8421c741-04aa-4ce5-8f14-d5f3a303ec59 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:49.667113 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8421c741-04aa-4ce5-8f14-d5f3a303ec59 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:49.731286 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-8421c741-04aa-4ce5-8f14-d5f3a303ec59 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:49.740555 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-8421c741-04aa-4ce5-8f14-d5f3a303ec59 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.087628 Sep 21 16:44:49.741130 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 485/1060] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:49 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:50.763647 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-e4312266-8bc8-4dea-b18d-041bd3eb2fdc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:50.764194 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-e4312266-8bc8-4dea-b18d-041bd3eb2fdc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:50.771513 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e4312266-8bc8-4dea-b18d-041bd3eb2fdc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:50.772033 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e4312266-8bc8-4dea-b18d-041bd3eb2fdc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:50.772469 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e4312266-8bc8-4dea-b18d-041bd3eb2fdc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:50.773172 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e4312266-8bc8-4dea-b18d-041bd3eb2fdc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:50.773627 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e4312266-8bc8-4dea-b18d-041bd3eb2fdc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:50.774072 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e4312266-8bc8-4dea-b18d-041bd3eb2fdc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:50.835849 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-e4312266-8bc8-4dea-b18d-041bd3eb2fdc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:50.843953 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-e4312266-8bc8-4dea-b18d-041bd3eb2fdc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.084326 Sep 21 16:44:50.845193 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 576/1061] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:50 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:51.866970 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-08cb79e4-9298-4d58-a9d6-3e8f3f38c874 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:51.867613 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-08cb79e4-9298-4d58-a9d6-3e8f3f38c874 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:51.874302 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-08cb79e4-9298-4d58-a9d6-3e8f3f38c874 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:51.874791 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-08cb79e4-9298-4d58-a9d6-3e8f3f38c874 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:51.875227 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-08cb79e4-9298-4d58-a9d6-3e8f3f38c874 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:51.876515 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-08cb79e4-9298-4d58-a9d6-3e8f3f38c874 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:51.876973 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-08cb79e4-9298-4d58-a9d6-3e8f3f38c874 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:51.877400 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-08cb79e4-9298-4d58-a9d6-3e8f3f38c874 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:51.938916 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-08cb79e4-9298-4d58-a9d6-3e8f3f38c874 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:51.946676 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-08cb79e4-9298-4d58-a9d6-3e8f3f38c874 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083607 Sep 21 16:44:51.947258 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 486/1062] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:51 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:52.969067 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-de47988b-3472-4cf4-a7cb-eeedb5ebd2c3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:52.970325 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-de47988b-3472-4cf4-a7cb-eeedb5ebd2c3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:52.976800 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-de47988b-3472-4cf4-a7cb-eeedb5ebd2c3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:52.977287 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-de47988b-3472-4cf4-a7cb-eeedb5ebd2c3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:52.977724 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-de47988b-3472-4cf4-a7cb-eeedb5ebd2c3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:52.978451 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-de47988b-3472-4cf4-a7cb-eeedb5ebd2c3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:52.978913 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-de47988b-3472-4cf4-a7cb-eeedb5ebd2c3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:52.979341 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-de47988b-3472-4cf4-a7cb-eeedb5ebd2c3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:53.043727 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-de47988b-3472-4cf4-a7cb-eeedb5ebd2c3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:53.052177 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-de47988b-3472-4cf4-a7cb-eeedb5ebd2c3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.087032 Sep 21 16:44:53.052757 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 577/1063] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:52 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:54.075981 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-23509875-8694-49d1-91f9-c0d9261d2a98 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:54.076637 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-23509875-8694-49d1-91f9-c0d9261d2a98 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:54.083706 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-23509875-8694-49d1-91f9-c0d9261d2a98 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:54.084192 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-23509875-8694-49d1-91f9-c0d9261d2a98 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:54.084624 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-23509875-8694-49d1-91f9-c0d9261d2a98 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:54.085321 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-23509875-8694-49d1-91f9-c0d9261d2a98 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:54.085777 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-23509875-8694-49d1-91f9-c0d9261d2a98 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:54.086234 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-23509875-8694-49d1-91f9-c0d9261d2a98 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:54.157005 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-23509875-8694-49d1-91f9-c0d9261d2a98 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:54.165616 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-23509875-8694-49d1-91f9-c0d9261d2a98 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.093495 Sep 21 16:44:54.166225 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 487/1064] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:54 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:55.188164 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-808650db-cd90-4152-bb5a-203d68de312b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:55.188755 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-808650db-cd90-4152-bb5a-203d68de312b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:55.195217 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-808650db-cd90-4152-bb5a-203d68de312b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:55.195696 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-808650db-cd90-4152-bb5a-203d68de312b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:55.196125 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-808650db-cd90-4152-bb5a-203d68de312b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:55.196810 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-808650db-cd90-4152-bb5a-203d68de312b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:55.197261 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-808650db-cd90-4152-bb5a-203d68de312b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:55.197719 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-808650db-cd90-4152-bb5a-203d68de312b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:55.258503 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-808650db-cd90-4152-bb5a-203d68de312b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:55.266936 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-808650db-cd90-4152-bb5a-203d68de312b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082693 Sep 21 16:44:55.267498 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 578/1065] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:55 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:56.117093 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-01d20d49-5a58-4664-9904-3b6444366be4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:56.118792 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-01d20d49-5a58-4664-9904-3b6444366be4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:56.125354 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-01d20d49-5a58-4664-9904-3b6444366be4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:56.125849 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-01d20d49-5a58-4664-9904-3b6444366be4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:56.126319 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-01d20d49-5a58-4664-9904-3b6444366be4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:56.127080 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-01d20d49-5a58-4664-9904-3b6444366be4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:56.127527 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-01d20d49-5a58-4664-9904-3b6444366be4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:56.127943 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-01d20d49-5a58-4664-9904-3b6444366be4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:56.160118 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-01d20d49-5a58-4664-9904-3b6444366be4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Going to try to terminate instance {{(pid=120531) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 16:44:56.238853 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-01d20d49-5a58-4664-9904-3b6444366be4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "DELETE /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 204 len: 0 microversion: 2.1 time: 0.125544 Sep 21 16:44:56.239451 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 488/1066] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Sep 21 16:44:56 2022] DELETE /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 21 16:44:56.248343 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-3525e4dc-7f40-4d29-8edd-43c472946032 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:56.248900 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-3525e4dc-7f40-4d29-8edd-43c472946032 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:56.255847 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3525e4dc-7f40-4d29-8edd-43c472946032 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:56.256332 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3525e4dc-7f40-4d29-8edd-43c472946032 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:56.256764 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3525e4dc-7f40-4d29-8edd-43c472946032 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:56.257459 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3525e4dc-7f40-4d29-8edd-43c472946032 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:56.257914 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3525e4dc-7f40-4d29-8edd-43c472946032 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:56.258397 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3525e4dc-7f40-4d29-8edd-43c472946032 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:56.290373 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-9368ea0f-0cec-4e98-aad8-562974eb5f92 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:56.291073 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-9368ea0f-0cec-4e98-aad8-562974eb5f92 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:56.297358 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9368ea0f-0cec-4e98-aad8-562974eb5f92 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:56.297866 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9368ea0f-0cec-4e98-aad8-562974eb5f92 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:56.298321 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9368ea0f-0cec-4e98-aad8-562974eb5f92 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:56.299015 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9368ea0f-0cec-4e98-aad8-562974eb5f92 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:56.299462 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9368ea0f-0cec-4e98-aad8-562974eb5f92 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:56.299884 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9368ea0f-0cec-4e98-aad8-562974eb5f92 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:56.364592 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-9368ea0f-0cec-4e98-aad8-562974eb5f92 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:56.372248 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-9368ea0f-0cec-4e98-aad8-562974eb5f92 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.086159 Sep 21 16:44:56.373001 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 489/1067] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:56 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:44:56.391806 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-3525e4dc-7f40-4d29-8edd-43c472946032 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:56.400334 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-3525e4dc-7f40-4d29-8edd-43c472946032 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.155886 Sep 21 16:44:56.400912 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 579/1068] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:56 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:44:57.395757 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-7280ad08-5ae4-4f73-8372-cbd1a52c0776 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:57.396303 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-7280ad08-5ae4-4f73-8372-cbd1a52c0776 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:57.402728 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7280ad08-5ae4-4f73-8372-cbd1a52c0776 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:57.403209 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7280ad08-5ae4-4f73-8372-cbd1a52c0776 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:57.403648 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7280ad08-5ae4-4f73-8372-cbd1a52c0776 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:57.404345 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7280ad08-5ae4-4f73-8372-cbd1a52c0776 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:57.404805 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7280ad08-5ae4-4f73-8372-cbd1a52c0776 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:57.405225 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7280ad08-5ae4-4f73-8372-cbd1a52c0776 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:57.427555 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-a879ec1d-7e58-48c7-b5db-d2ed120905d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:57.428173 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-a879ec1d-7e58-48c7-b5db-d2ed120905d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:57.434695 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a879ec1d-7e58-48c7-b5db-d2ed120905d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:57.435182 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a879ec1d-7e58-48c7-b5db-d2ed120905d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:57.435621 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a879ec1d-7e58-48c7-b5db-d2ed120905d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:57.436332 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a879ec1d-7e58-48c7-b5db-d2ed120905d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:57.436792 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a879ec1d-7e58-48c7-b5db-d2ed120905d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:57.437335 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a879ec1d-7e58-48c7-b5db-d2ed120905d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:57.586393 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a879ec1d-7e58-48c7-b5db-d2ed120905d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:57.596069 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-a879ec1d-7e58-48c7-b5db-d2ed120905d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.172306 Sep 21 16:44:57.596673 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 580/1069] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:57 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:44:57.721467 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-7280ad08-5ae4-4f73-8372-cbd1a52c0776 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:57.731066 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-7280ad08-5ae4-4f73-8372-cbd1a52c0776 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.339676 Sep 21 16:44:57.731658 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 490/1070] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:57 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:58.620239 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-872f414e-2209-4af0-b126-63a1ed945274 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:58.620853 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-872f414e-2209-4af0-b126-63a1ed945274 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:58.627915 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-872f414e-2209-4af0-b126-63a1ed945274 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:58.628390 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-872f414e-2209-4af0-b126-63a1ed945274 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:58.628820 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-872f414e-2209-4af0-b126-63a1ed945274 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:58.629503 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-872f414e-2209-4af0-b126-63a1ed945274 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:58.629953 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-872f414e-2209-4af0-b126-63a1ed945274 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:58.630408 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-872f414e-2209-4af0-b126-63a1ed945274 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:58.754750 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-7212fa5d-51df-440d-a3fb-f0198e67f9f9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:58.755299 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-7212fa5d-51df-440d-a3fb-f0198e67f9f9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:58.761487 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-872f414e-2209-4af0-b126-63a1ed945274 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:58.761826 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7212fa5d-51df-440d-a3fb-f0198e67f9f9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:58.762347 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7212fa5d-51df-440d-a3fb-f0198e67f9f9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:58.762774 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7212fa5d-51df-440d-a3fb-f0198e67f9f9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:58.763472 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7212fa5d-51df-440d-a3fb-f0198e67f9f9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:58.763915 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7212fa5d-51df-440d-a3fb-f0198e67f9f9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:58.764327 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7212fa5d-51df-440d-a3fb-f0198e67f9f9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:58.770931 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-872f414e-2209-4af0-b126-63a1ed945274 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.154712 Sep 21 16:44:58.771527 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 581/1071] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:58 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:44:58.827311 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-7212fa5d-51df-440d-a3fb-f0198e67f9f9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:58.835328 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-7212fa5d-51df-440d-a3fb-f0198e67f9f9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.085116 Sep 21 16:44:58.835887 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 491/1072] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:58 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:44:59.794405 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-15052019-5591-46c5-9884-9c023b87d278 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:59.795291 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-15052019-5591-46c5-9884-9c023b87d278 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:59.802330 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-15052019-5591-46c5-9884-9c023b87d278 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:59.802811 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-15052019-5591-46c5-9884-9c023b87d278 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:59.803242 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-15052019-5591-46c5-9884-9c023b87d278 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:59.803940 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-15052019-5591-46c5-9884-9c023b87d278 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:59.804396 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-15052019-5591-46c5-9884-9c023b87d278 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:59.804816 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-15052019-5591-46c5-9884-9c023b87d278 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:59.857934 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-175641ba-093c-4c5d-b6ad-0e8c5c84fd75 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:44:59.858567 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-175641ba-093c-4c5d-b6ad-0e8c5c84fd75 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:44:59.865726 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-175641ba-093c-4c5d-b6ad-0e8c5c84fd75 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:59.866257 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-175641ba-093c-4c5d-b6ad-0e8c5c84fd75 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:59.866696 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-175641ba-093c-4c5d-b6ad-0e8c5c84fd75 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:59.867414 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-175641ba-093c-4c5d-b6ad-0e8c5c84fd75 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:44:59.867874 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-175641ba-093c-4c5d-b6ad-0e8c5c84fd75 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:44:59.868296 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-175641ba-093c-4c5d-b6ad-0e8c5c84fd75 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:44:59.931376 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-175641ba-093c-4c5d-b6ad-0e8c5c84fd75 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:59.939674 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-175641ba-093c-4c5d-b6ad-0e8c5c84fd75 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.085690 Sep 21 16:44:59.940255 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 492/1073] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:59 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:44:59.940423 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-15052019-5591-46c5-9884-9c023b87d278 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:44:59.948663 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-15052019-5591-46c5-9884-9c023b87d278 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.158120 Sep 21 16:44:59.949250 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 582/1074] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:44:59 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:00.962929 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-ead5ffdb-ca22-41c8-8dc3-ce9b77a8cd33 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:00.963527 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-ead5ffdb-ca22-41c8-8dc3-ce9b77a8cd33 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:00.970548 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ead5ffdb-ca22-41c8-8dc3-ce9b77a8cd33 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:00.971031 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ead5ffdb-ca22-41c8-8dc3-ce9b77a8cd33 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:00.971458 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ead5ffdb-ca22-41c8-8dc3-ce9b77a8cd33 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:00.972146 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ead5ffdb-ca22-41c8-8dc3-ce9b77a8cd33 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:00.972593 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ead5ffdb-ca22-41c8-8dc3-ce9b77a8cd33 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:00.973006 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-defe1c83-b261-407e-94ae-aae2298d188d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:00.973427 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ead5ffdb-ca22-41c8-8dc3-ce9b77a8cd33 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:00.973622 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-defe1c83-b261-407e-94ae-aae2298d188d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:00.980197 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-defe1c83-b261-407e-94ae-aae2298d188d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:00.980674 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-defe1c83-b261-407e-94ae-aae2298d188d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:00.981112 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-defe1c83-b261-407e-94ae-aae2298d188d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:00.981810 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-defe1c83-b261-407e-94ae-aae2298d188d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:00.982296 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-defe1c83-b261-407e-94ae-aae2298d188d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:00.982718 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-defe1c83-b261-407e-94ae-aae2298d188d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:01.034614 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-ead5ffdb-ca22-41c8-8dc3-ce9b77a8cd33 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:01.042437 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-ead5ffdb-ca22-41c8-8dc3-ce9b77a8cd33 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083260 Sep 21 16:45:01.043041 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 493/1075] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:00 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:01.115095 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-defe1c83-b261-407e-94ae-aae2298d188d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:01.123350 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-defe1c83-b261-407e-94ae-aae2298d188d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.154751 Sep 21 16:45:01.123926 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 583/1076] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:00 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:45:02.065684 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-8968a828-66a1-498f-b835-2c40080cfaae tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:02.066312 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-8968a828-66a1-498f-b835-2c40080cfaae tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:02.072829 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8968a828-66a1-498f-b835-2c40080cfaae tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:02.073311 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8968a828-66a1-498f-b835-2c40080cfaae tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:02.073732 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8968a828-66a1-498f-b835-2c40080cfaae tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:02.074439 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8968a828-66a1-498f-b835-2c40080cfaae tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:02.074885 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8968a828-66a1-498f-b835-2c40080cfaae tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:02.075303 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8968a828-66a1-498f-b835-2c40080cfaae tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:02.138473 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-8968a828-66a1-498f-b835-2c40080cfaae tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:02.146619 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-9d851887-6f7e-406c-927b-f2bc188f08aa tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:02.147181 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-8968a828-66a1-498f-b835-2c40080cfaae tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.084907 Sep 21 16:45:02.147314 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-9d851887-6f7e-406c-927b-f2bc188f08aa tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:02.147499 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 494/1077] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:02 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:02.154422 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9d851887-6f7e-406c-927b-f2bc188f08aa tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:02.154894 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9d851887-6f7e-406c-927b-f2bc188f08aa tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:02.155318 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9d851887-6f7e-406c-927b-f2bc188f08aa tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:02.156003 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9d851887-6f7e-406c-927b-f2bc188f08aa tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:02.157104 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9d851887-6f7e-406c-927b-f2bc188f08aa tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:02.157455 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9d851887-6f7e-406c-927b-f2bc188f08aa tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:02.284480 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-9d851887-6f7e-406c-927b-f2bc188f08aa tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:02.292662 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-9d851887-6f7e-406c-927b-f2bc188f08aa tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.149838 Sep 21 16:45:02.293225 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 584/1078] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:02 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:45:03.170020 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-573610ff-0e8e-4770-8892-71dd10722f65 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:03.171016 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-573610ff-0e8e-4770-8892-71dd10722f65 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:03.177658 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-573610ff-0e8e-4770-8892-71dd10722f65 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:03.178169 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-573610ff-0e8e-4770-8892-71dd10722f65 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:03.178602 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-573610ff-0e8e-4770-8892-71dd10722f65 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:03.179291 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-573610ff-0e8e-4770-8892-71dd10722f65 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:03.179741 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-573610ff-0e8e-4770-8892-71dd10722f65 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:03.180165 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-573610ff-0e8e-4770-8892-71dd10722f65 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:03.182843 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:45:03.244013 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-573610ff-0e8e-4770-8892-71dd10722f65 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:03.252164 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-573610ff-0e8e-4770-8892-71dd10722f65 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.086030 Sep 21 16:45:03.252833 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 495/1079] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:03 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:03.316820 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-020b120a-312b-41ec-9cfe-4663d6c494df tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:03.317405 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-020b120a-312b-41ec-9cfe-4663d6c494df tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:03.323825 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-020b120a-312b-41ec-9cfe-4663d6c494df tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:03.324293 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-020b120a-312b-41ec-9cfe-4663d6c494df tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:03.324725 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-020b120a-312b-41ec-9cfe-4663d6c494df tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:03.325407 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-020b120a-312b-41ec-9cfe-4663d6c494df tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:03.325851 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-020b120a-312b-41ec-9cfe-4663d6c494df tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:03.326289 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-020b120a-312b-41ec-9cfe-4663d6c494df tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:03.457414 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-020b120a-312b-41ec-9cfe-4663d6c494df tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:03.465964 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-020b120a-312b-41ec-9cfe-4663d6c494df tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.153718 Sep 21 16:45:03.466587 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 585/1080] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:03 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:04.275863 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-75fd9aaf-9532-4458-9b51-87e689b1debc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:04.276634 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-75fd9aaf-9532-4458-9b51-87e689b1debc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:04.284026 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-75fd9aaf-9532-4458-9b51-87e689b1debc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:04.284520 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-75fd9aaf-9532-4458-9b51-87e689b1debc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:04.284961 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-75fd9aaf-9532-4458-9b51-87e689b1debc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:04.285672 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-75fd9aaf-9532-4458-9b51-87e689b1debc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:04.286152 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-75fd9aaf-9532-4458-9b51-87e689b1debc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:04.286599 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-75fd9aaf-9532-4458-9b51-87e689b1debc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:04.348770 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-75fd9aaf-9532-4458-9b51-87e689b1debc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:04.356643 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-75fd9aaf-9532-4458-9b51-87e689b1debc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.084608 Sep 21 16:45:04.357219 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 496/1081] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:04 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:04.489782 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-40205934-8837-4501-aadb-7d466df254bf tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:04.490430 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-40205934-8837-4501-aadb-7d466df254bf tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:04.496889 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-40205934-8837-4501-aadb-7d466df254bf tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:04.497367 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-40205934-8837-4501-aadb-7d466df254bf tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:04.497801 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-40205934-8837-4501-aadb-7d466df254bf tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:04.498520 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-40205934-8837-4501-aadb-7d466df254bf tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:04.499156 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-40205934-8837-4501-aadb-7d466df254bf tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:04.499896 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-40205934-8837-4501-aadb-7d466df254bf tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:04.520359 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=100 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:45:04.634423 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-40205934-8837-4501-aadb-7d466df254bf tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:04.642847 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-40205934-8837-4501-aadb-7d466df254bf tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.157027 Sep 21 16:45:04.643425 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 586/1082] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:04 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:05.380031 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-67136e13-2844-4eed-9bed-a6ff40c484fa tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:05.380639 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-67136e13-2844-4eed-9bed-a6ff40c484fa tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:05.387053 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-67136e13-2844-4eed-9bed-a6ff40c484fa tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:05.387634 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-67136e13-2844-4eed-9bed-a6ff40c484fa tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:05.388070 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-67136e13-2844-4eed-9bed-a6ff40c484fa tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:05.388755 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-67136e13-2844-4eed-9bed-a6ff40c484fa tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:05.389204 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-67136e13-2844-4eed-9bed-a6ff40c484fa tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:05.389619 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-67136e13-2844-4eed-9bed-a6ff40c484fa tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:05.451477 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-67136e13-2844-4eed-9bed-a6ff40c484fa tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:05.460038 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-67136e13-2844-4eed-9bed-a6ff40c484fa tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083814 Sep 21 16:45:05.460610 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 497/1083] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:05 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:05.666178 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-e6566a60-8975-41fe-8d98-9f3dfcb57d8d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:05.666791 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-e6566a60-8975-41fe-8d98-9f3dfcb57d8d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:05.673278 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e6566a60-8975-41fe-8d98-9f3dfcb57d8d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:05.673766 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e6566a60-8975-41fe-8d98-9f3dfcb57d8d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:05.674238 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e6566a60-8975-41fe-8d98-9f3dfcb57d8d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:05.674927 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e6566a60-8975-41fe-8d98-9f3dfcb57d8d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:05.675378 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e6566a60-8975-41fe-8d98-9f3dfcb57d8d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:05.675801 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e6566a60-8975-41fe-8d98-9f3dfcb57d8d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:05.806718 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-e6566a60-8975-41fe-8d98-9f3dfcb57d8d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:05.815675 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-e6566a60-8975-41fe-8d98-9f3dfcb57d8d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.153353 Sep 21 16:45:05.816248 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 587/1084] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:05 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:06.483141 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-cdbed312-073e-4b45-81ac-c3f0ec95ac12 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:06.483694 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-cdbed312-073e-4b45-81ac-c3f0ec95ac12 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:06.490665 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cdbed312-073e-4b45-81ac-c3f0ec95ac12 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:06.491145 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cdbed312-073e-4b45-81ac-c3f0ec95ac12 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:06.491574 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cdbed312-073e-4b45-81ac-c3f0ec95ac12 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:06.492268 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cdbed312-073e-4b45-81ac-c3f0ec95ac12 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:06.492714 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cdbed312-073e-4b45-81ac-c3f0ec95ac12 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:06.493130 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cdbed312-073e-4b45-81ac-c3f0ec95ac12 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:06.555645 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-cdbed312-073e-4b45-81ac-c3f0ec95ac12 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:06.563969 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-cdbed312-073e-4b45-81ac-c3f0ec95ac12 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.084752 Sep 21 16:45:06.564534 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 498/1085] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:06 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:06.839883 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-1fc81e08-1986-4206-911c-27eaab3f39d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:06.840488 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-1fc81e08-1986-4206-911c-27eaab3f39d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:06.846995 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1fc81e08-1986-4206-911c-27eaab3f39d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:06.847480 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1fc81e08-1986-4206-911c-27eaab3f39d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:06.847911 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1fc81e08-1986-4206-911c-27eaab3f39d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:06.848601 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1fc81e08-1986-4206-911c-27eaab3f39d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:06.849050 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1fc81e08-1986-4206-911c-27eaab3f39d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:06.849468 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1fc81e08-1986-4206-911c-27eaab3f39d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:06.983182 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-1fc81e08-1986-4206-911c-27eaab3f39d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:06.991550 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-1fc81e08-1986-4206-911c-27eaab3f39d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.155495 Sep 21 16:45:06.992113 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 588/1086] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:06 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:07.588526 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-dce013f6-f297-4d4b-a5ab-be57fd328c1c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:07.589143 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-dce013f6-f297-4d4b-a5ab-be57fd328c1c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:07.595831 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dce013f6-f297-4d4b-a5ab-be57fd328c1c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:07.596307 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dce013f6-f297-4d4b-a5ab-be57fd328c1c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:07.596734 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dce013f6-f297-4d4b-a5ab-be57fd328c1c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:07.597423 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dce013f6-f297-4d4b-a5ab-be57fd328c1c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:07.597866 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dce013f6-f297-4d4b-a5ab-be57fd328c1c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:07.598305 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dce013f6-f297-4d4b-a5ab-be57fd328c1c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:07.660965 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-dce013f6-f297-4d4b-a5ab-be57fd328c1c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:07.668765 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-dce013f6-f297-4d4b-a5ab-be57fd328c1c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.084700 Sep 21 16:45:07.669328 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 499/1087] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:07 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:08.014933 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-0a494acc-256f-4cb5-976c-a7bc6d5d167e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:08.016097 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-0a494acc-256f-4cb5-976c-a7bc6d5d167e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:08.018424 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_api:SELECT=38 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:45:08.023916 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0a494acc-256f-4cb5-976c-a7bc6d5d167e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:08.024395 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0a494acc-256f-4cb5-976c-a7bc6d5d167e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:08.024827 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0a494acc-256f-4cb5-976c-a7bc6d5d167e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:08.025520 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0a494acc-256f-4cb5-976c-a7bc6d5d167e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:08.025974 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0a494acc-256f-4cb5-976c-a7bc6d5d167e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:08.026430 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0a494acc-256f-4cb5-976c-a7bc6d5d167e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:08.160151 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-0a494acc-256f-4cb5-976c-a7bc6d5d167e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:08.168376 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-0a494acc-256f-4cb5-976c-a7bc6d5d167e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.157284 Sep 21 16:45:08.168943 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 589/1088] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:08 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:08.692067 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-7d86bee4-7dd8-442c-8554-9b6cc971ba17 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:08.692658 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-7d86bee4-7dd8-442c-8554-9b6cc971ba17 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:08.695125 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:45:08.701281 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7d86bee4-7dd8-442c-8554-9b6cc971ba17 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:08.701768 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7d86bee4-7dd8-442c-8554-9b6cc971ba17 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:08.702241 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7d86bee4-7dd8-442c-8554-9b6cc971ba17 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:08.703510 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7d86bee4-7dd8-442c-8554-9b6cc971ba17 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:08.704210 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7d86bee4-7dd8-442c-8554-9b6cc971ba17 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:08.704632 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7d86bee4-7dd8-442c-8554-9b6cc971ba17 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:08.765469 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-7d86bee4-7dd8-442c-8554-9b6cc971ba17 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:08.773775 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-7d86bee4-7dd8-442c-8554-9b6cc971ba17 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.085620 Sep 21 16:45:08.774372 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 500/1089] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:08 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:09.192703 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ed02e78d-fdb8-49b8-a4df-9a915822c6d5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:09.193312 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ed02e78d-fdb8-49b8-a4df-9a915822c6d5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:09.199511 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ed02e78d-fdb8-49b8-a4df-9a915822c6d5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:09.199999 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ed02e78d-fdb8-49b8-a4df-9a915822c6d5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:09.200429 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ed02e78d-fdb8-49b8-a4df-9a915822c6d5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:09.201135 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ed02e78d-fdb8-49b8-a4df-9a915822c6d5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:09.201583 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ed02e78d-fdb8-49b8-a4df-9a915822c6d5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:09.202013 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ed02e78d-fdb8-49b8-a4df-9a915822c6d5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:09.336032 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ed02e78d-fdb8-49b8-a4df-9a915822c6d5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:09.345016 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ed02e78d-fdb8-49b8-a4df-9a915822c6d5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.156314 Sep 21 16:45:09.345603 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 590/1090] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:09 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:09.797074 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-b0e9e41f-5f6b-448c-bed2-883c20d25bbe tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:09.797909 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-b0e9e41f-5f6b-448c-bed2-883c20d25bbe tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:09.804280 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b0e9e41f-5f6b-448c-bed2-883c20d25bbe tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:09.804766 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b0e9e41f-5f6b-448c-bed2-883c20d25bbe tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:09.805200 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b0e9e41f-5f6b-448c-bed2-883c20d25bbe tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:09.805904 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b0e9e41f-5f6b-448c-bed2-883c20d25bbe tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:09.806392 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b0e9e41f-5f6b-448c-bed2-883c20d25bbe tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:09.806819 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b0e9e41f-5f6b-448c-bed2-883c20d25bbe tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:09.869436 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-b0e9e41f-5f6b-448c-bed2-883c20d25bbe tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:09.877552 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-b0e9e41f-5f6b-448c-bed2-883c20d25bbe tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.084384 Sep 21 16:45:09.878145 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 501/1091] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:09 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:10.368946 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-f322e842-ca52-426e-8567-1d28295fa081 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:10.369557 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-f322e842-ca52-426e-8567-1d28295fa081 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:10.377060 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f322e842-ca52-426e-8567-1d28295fa081 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:10.377537 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f322e842-ca52-426e-8567-1d28295fa081 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:10.377968 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f322e842-ca52-426e-8567-1d28295fa081 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:10.378716 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f322e842-ca52-426e-8567-1d28295fa081 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:10.379165 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f322e842-ca52-426e-8567-1d28295fa081 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:10.379583 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f322e842-ca52-426e-8567-1d28295fa081 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:10.507828 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-f322e842-ca52-426e-8567-1d28295fa081 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:10.516956 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-f322e842-ca52-426e-8567-1d28295fa081 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.151942 Sep 21 16:45:10.517628 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 591/1092] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:10 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:10.900996 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-3a7420b6-26e0-48c2-9d6a-ee10ce7b66a4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:10.901587 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-3a7420b6-26e0-48c2-9d6a-ee10ce7b66a4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:10.908306 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3a7420b6-26e0-48c2-9d6a-ee10ce7b66a4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:10.908791 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3a7420b6-26e0-48c2-9d6a-ee10ce7b66a4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:10.909223 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3a7420b6-26e0-48c2-9d6a-ee10ce7b66a4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:10.909927 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3a7420b6-26e0-48c2-9d6a-ee10ce7b66a4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:10.910417 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3a7420b6-26e0-48c2-9d6a-ee10ce7b66a4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:10.910841 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3a7420b6-26e0-48c2-9d6a-ee10ce7b66a4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:10.975669 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-3a7420b6-26e0-48c2-9d6a-ee10ce7b66a4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:10.983443 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-3a7420b6-26e0-48c2-9d6a-ee10ce7b66a4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.086344 Sep 21 16:45:10.983994 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 502/1093] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:10 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:11.539668 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-f62ab03a-c373-48b7-8a1e-a0e66395bf75 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:11.540314 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-f62ab03a-c373-48b7-8a1e-a0e66395bf75 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:11.547626 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f62ab03a-c373-48b7-8a1e-a0e66395bf75 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:11.548134 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f62ab03a-c373-48b7-8a1e-a0e66395bf75 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:11.548574 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f62ab03a-c373-48b7-8a1e-a0e66395bf75 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:11.549259 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f62ab03a-c373-48b7-8a1e-a0e66395bf75 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:11.549708 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f62ab03a-c373-48b7-8a1e-a0e66395bf75 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:11.550165 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f62ab03a-c373-48b7-8a1e-a0e66395bf75 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:11.681406 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-f62ab03a-c373-48b7-8a1e-a0e66395bf75 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:11.689658 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-f62ab03a-c373-48b7-8a1e-a0e66395bf75 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.153885 Sep 21 16:45:11.690263 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 592/1094] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:11 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:12.006821 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-f04d0127-f614-4f0f-80e2-09d1ceba5ad0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:12.007465 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-f04d0127-f614-4f0f-80e2-09d1ceba5ad0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:12.014319 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f04d0127-f614-4f0f-80e2-09d1ceba5ad0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:12.014994 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f04d0127-f614-4f0f-80e2-09d1ceba5ad0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:12.015342 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f04d0127-f614-4f0f-80e2-09d1ceba5ad0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:12.015956 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f04d0127-f614-4f0f-80e2-09d1ceba5ad0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:12.016447 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f04d0127-f614-4f0f-80e2-09d1ceba5ad0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:12.016866 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f04d0127-f614-4f0f-80e2-09d1ceba5ad0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:12.080424 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-f04d0127-f614-4f0f-80e2-09d1ceba5ad0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:12.088071 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-f04d0127-f614-4f0f-80e2-09d1ceba5ad0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.085402 Sep 21 16:45:12.088637 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 503/1095] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:12 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:12.713078 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-24eb48a8-00bd-4be5-b2fe-9857762ed574 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:12.713771 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-24eb48a8-00bd-4be5-b2fe-9857762ed574 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:12.720567 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-24eb48a8-00bd-4be5-b2fe-9857762ed574 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:12.721047 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-24eb48a8-00bd-4be5-b2fe-9857762ed574 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:12.721471 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-24eb48a8-00bd-4be5-b2fe-9857762ed574 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:12.722176 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-24eb48a8-00bd-4be5-b2fe-9857762ed574 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:12.722624 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-24eb48a8-00bd-4be5-b2fe-9857762ed574 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:12.723039 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-24eb48a8-00bd-4be5-b2fe-9857762ed574 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:12.851561 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-24eb48a8-00bd-4be5-b2fe-9857762ed574 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:12.860261 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-24eb48a8-00bd-4be5-b2fe-9857762ed574 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.150968 Sep 21 16:45:12.860905 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 593/1096] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:12 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:13.112102 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-a68f4cf5-713f-4598-98f5-57a62c6bdfca tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:13.112675 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-a68f4cf5-713f-4598-98f5-57a62c6bdfca tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:13.119280 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a68f4cf5-713f-4598-98f5-57a62c6bdfca tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:13.119764 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a68f4cf5-713f-4598-98f5-57a62c6bdfca tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:13.120198 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a68f4cf5-713f-4598-98f5-57a62c6bdfca tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:13.120907 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a68f4cf5-713f-4598-98f5-57a62c6bdfca tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:13.121363 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a68f4cf5-713f-4598-98f5-57a62c6bdfca tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:13.121783 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a68f4cf5-713f-4598-98f5-57a62c6bdfca tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:13.185178 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-a68f4cf5-713f-4598-98f5-57a62c6bdfca tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:13.193436 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-a68f4cf5-713f-4598-98f5-57a62c6bdfca tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.086003 Sep 21 16:45:13.193996 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 504/1097] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:13 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:13.884166 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-4707ef8c-d473-4744-b99b-02f27721dca5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:13.884724 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-4707ef8c-d473-4744-b99b-02f27721dca5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:13.891389 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4707ef8c-d473-4744-b99b-02f27721dca5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:13.891866 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4707ef8c-d473-4744-b99b-02f27721dca5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:13.892295 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4707ef8c-d473-4744-b99b-02f27721dca5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:13.892995 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4707ef8c-d473-4744-b99b-02f27721dca5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:13.893444 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4707ef8c-d473-4744-b99b-02f27721dca5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:13.893938 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4707ef8c-d473-4744-b99b-02f27721dca5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:14.025731 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-4707ef8c-d473-4744-b99b-02f27721dca5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:14.034487 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-4707ef8c-d473-4744-b99b-02f27721dca5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.154244 Sep 21 16:45:14.035053 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 594/1098] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:13 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:14.216713 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-565400e4-44f6-4809-8f57-4d356926ec85 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:14.217362 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-565400e4-44f6-4809-8f57-4d356926ec85 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:14.223854 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-565400e4-44f6-4809-8f57-4d356926ec85 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:14.224334 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-565400e4-44f6-4809-8f57-4d356926ec85 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:14.224767 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-565400e4-44f6-4809-8f57-4d356926ec85 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:14.225455 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-565400e4-44f6-4809-8f57-4d356926ec85 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:14.225909 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-565400e4-44f6-4809-8f57-4d356926ec85 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:14.226359 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-565400e4-44f6-4809-8f57-4d356926ec85 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:14.286166 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-565400e4-44f6-4809-8f57-4d356926ec85 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:14.293968 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-565400e4-44f6-4809-8f57-4d356926ec85 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081085 Sep 21 16:45:14.294563 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 505/1099] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:14 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:15.057681 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-2b59fde5-007c-48ad-aa10-68999f2963f8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:15.058312 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-2b59fde5-007c-48ad-aa10-68999f2963f8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:15.065279 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2b59fde5-007c-48ad-aa10-68999f2963f8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:15.065760 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2b59fde5-007c-48ad-aa10-68999f2963f8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:15.066225 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2b59fde5-007c-48ad-aa10-68999f2963f8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:15.066915 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2b59fde5-007c-48ad-aa10-68999f2963f8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:15.067368 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2b59fde5-007c-48ad-aa10-68999f2963f8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:15.067791 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2b59fde5-007c-48ad-aa10-68999f2963f8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:15.205046 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-2b59fde5-007c-48ad-aa10-68999f2963f8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:15.213195 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-2b59fde5-007c-48ad-aa10-68999f2963f8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.159411 Sep 21 16:45:15.213773 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 595/1100] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:15 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:15.316865 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-ed08ea85-9f64-4c8a-a150-3e354e9fb701 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:15.317507 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-ed08ea85-9f64-4c8a-a150-3e354e9fb701 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:15.324002 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ed08ea85-9f64-4c8a-a150-3e354e9fb701 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:15.324747 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ed08ea85-9f64-4c8a-a150-3e354e9fb701 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:15.325315 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ed08ea85-9f64-4c8a-a150-3e354e9fb701 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:15.326019 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ed08ea85-9f64-4c8a-a150-3e354e9fb701 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:15.326822 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ed08ea85-9f64-4c8a-a150-3e354e9fb701 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:15.327371 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ed08ea85-9f64-4c8a-a150-3e354e9fb701 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:15.392944 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-ed08ea85-9f64-4c8a-a150-3e354e9fb701 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:15.400603 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-ed08ea85-9f64-4c8a-a150-3e354e9fb701 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.088246 Sep 21 16:45:15.401159 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 506/1101] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:15 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:16.236262 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-078cd915-bf7f-44ad-8143-36abbc65bc25 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:16.236865 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-078cd915-bf7f-44ad-8143-36abbc65bc25 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:16.243309 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-078cd915-bf7f-44ad-8143-36abbc65bc25 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:16.243793 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-078cd915-bf7f-44ad-8143-36abbc65bc25 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:16.244221 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-078cd915-bf7f-44ad-8143-36abbc65bc25 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:16.244913 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-078cd915-bf7f-44ad-8143-36abbc65bc25 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:16.245365 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-078cd915-bf7f-44ad-8143-36abbc65bc25 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:16.245785 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-078cd915-bf7f-44ad-8143-36abbc65bc25 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:16.377951 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-078cd915-bf7f-44ad-8143-36abbc65bc25 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:16.386481 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-078cd915-bf7f-44ad-8143-36abbc65bc25 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.154256 Sep 21 16:45:16.387048 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 596/1102] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:16 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:16.423144 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-0cc9a008-d80d-4d26-8a17-da54f1310151 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:16.423751 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-0cc9a008-d80d-4d26-8a17-da54f1310151 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:16.430160 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0cc9a008-d80d-4d26-8a17-da54f1310151 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:16.430647 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0cc9a008-d80d-4d26-8a17-da54f1310151 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:16.431086 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0cc9a008-d80d-4d26-8a17-da54f1310151 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:16.431779 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0cc9a008-d80d-4d26-8a17-da54f1310151 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:16.432235 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0cc9a008-d80d-4d26-8a17-da54f1310151 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:16.432657 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0cc9a008-d80d-4d26-8a17-da54f1310151 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:16.495450 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-0cc9a008-d80d-4d26-8a17-da54f1310151 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:16.503829 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-0cc9a008-d80d-4d26-8a17-da54f1310151 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.084530 Sep 21 16:45:16.504410 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 507/1103] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:16 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:17.410489 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-f94f462a-d776-4be1-a7a1-bc2e6546a26c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:17.411141 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-f94f462a-d776-4be1-a7a1-bc2e6546a26c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:17.417477 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f94f462a-d776-4be1-a7a1-bc2e6546a26c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:17.417949 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f94f462a-d776-4be1-a7a1-bc2e6546a26c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:17.418419 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f94f462a-d776-4be1-a7a1-bc2e6546a26c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:17.419103 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f94f462a-d776-4be1-a7a1-bc2e6546a26c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:17.419545 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f94f462a-d776-4be1-a7a1-bc2e6546a26c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:17.420005 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f94f462a-d776-4be1-a7a1-bc2e6546a26c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:17.527065 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-2ba5d970-f99a-4fba-ad61-5aa2e75a05b3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:17.527939 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-2ba5d970-f99a-4fba-ad61-5aa2e75a05b3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:17.534409 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2ba5d970-f99a-4fba-ad61-5aa2e75a05b3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:17.534895 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2ba5d970-f99a-4fba-ad61-5aa2e75a05b3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:17.535327 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2ba5d970-f99a-4fba-ad61-5aa2e75a05b3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:17.536033 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2ba5d970-f99a-4fba-ad61-5aa2e75a05b3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:17.536482 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2ba5d970-f99a-4fba-ad61-5aa2e75a05b3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:17.536929 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2ba5d970-f99a-4fba-ad61-5aa2e75a05b3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:17.558090 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-f94f462a-d776-4be1-a7a1-bc2e6546a26c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:17.568939 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-f94f462a-d776-4be1-a7a1-bc2e6546a26c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.162243 Sep 21 16:45:17.569751 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 597/1104] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:17 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:17.600346 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-2ba5d970-f99a-4fba-ad61-5aa2e75a05b3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:17.608120 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-2ba5d970-f99a-4fba-ad61-5aa2e75a05b3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.084865 Sep 21 16:45:17.608612 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 508/1105] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:17 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:45:18.592531 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-a1f05920-9dd5-4d11-9d5a-895eef153033 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:18.593169 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-a1f05920-9dd5-4d11-9d5a-895eef153033 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:18.599940 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a1f05920-9dd5-4d11-9d5a-895eef153033 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:18.600413 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a1f05920-9dd5-4d11-9d5a-895eef153033 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:18.600844 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a1f05920-9dd5-4d11-9d5a-895eef153033 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:18.601534 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a1f05920-9dd5-4d11-9d5a-895eef153033 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:18.601985 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a1f05920-9dd5-4d11-9d5a-895eef153033 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:18.602435 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a1f05920-9dd5-4d11-9d5a-895eef153033 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:18.632795 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-9ef4ba88-d8af-467f-8c31-cb2d064449f9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:18.633498 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-9ef4ba88-d8af-467f-8c31-cb2d064449f9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:18.640084 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9ef4ba88-d8af-467f-8c31-cb2d064449f9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:18.640563 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9ef4ba88-d8af-467f-8c31-cb2d064449f9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:18.640996 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9ef4ba88-d8af-467f-8c31-cb2d064449f9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:18.641698 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9ef4ba88-d8af-467f-8c31-cb2d064449f9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:18.642180 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9ef4ba88-d8af-467f-8c31-cb2d064449f9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:18.642601 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9ef4ba88-d8af-467f-8c31-cb2d064449f9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:18.707127 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-9ef4ba88-d8af-467f-8c31-cb2d064449f9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:18.715188 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-9ef4ba88-d8af-467f-8c31-cb2d064449f9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.086117 Sep 21 16:45:18.715795 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 509/1106] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:18 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:45:18.750788 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a1f05920-9dd5-4d11-9d5a-895eef153033 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:18.759204 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-a1f05920-9dd5-4d11-9d5a-895eef153033 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.170540 Sep 21 16:45:18.759792 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 598/1107] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:18 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:19.739229 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-7364785b-fe84-411a-8bf7-7496080b4544 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:19.739852 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-7364785b-fe84-411a-8bf7-7496080b4544 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:19.746311 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7364785b-fe84-411a-8bf7-7496080b4544 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:19.746797 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7364785b-fe84-411a-8bf7-7496080b4544 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:19.747238 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7364785b-fe84-411a-8bf7-7496080b4544 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:19.747944 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7364785b-fe84-411a-8bf7-7496080b4544 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:19.748395 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7364785b-fe84-411a-8bf7-7496080b4544 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:19.748817 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7364785b-fe84-411a-8bf7-7496080b4544 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:19.782323 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-d15bf4d4-baec-4bdb-a031-d60c230c1a1a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:19.782951 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-d15bf4d4-baec-4bdb-a031-d60c230c1a1a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:19.789832 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d15bf4d4-baec-4bdb-a031-d60c230c1a1a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:19.790354 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d15bf4d4-baec-4bdb-a031-d60c230c1a1a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:19.790824 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d15bf4d4-baec-4bdb-a031-d60c230c1a1a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:19.791529 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d15bf4d4-baec-4bdb-a031-d60c230c1a1a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:19.791982 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d15bf4d4-baec-4bdb-a031-d60c230c1a1a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:19.792406 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d15bf4d4-baec-4bdb-a031-d60c230c1a1a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:19.815107 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-7364785b-fe84-411a-8bf7-7496080b4544 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:19.823522 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-7364785b-fe84-411a-8bf7-7496080b4544 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.088756 Sep 21 16:45:19.824133 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 510/1108] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:19 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:19.933725 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d15bf4d4-baec-4bdb-a031-d60c230c1a1a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:19.943518 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-d15bf4d4-baec-4bdb-a031-d60c230c1a1a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.165620 Sep 21 16:45:19.944103 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 599/1109] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:19 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:20.847653 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-60e9669b-ceff-485d-8d4e-b9da548c4ebf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:20.848261 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-60e9669b-ceff-485d-8d4e-b9da548c4ebf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:20.854596 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-60e9669b-ceff-485d-8d4e-b9da548c4ebf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:20.855076 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-60e9669b-ceff-485d-8d4e-b9da548c4ebf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:20.855507 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-60e9669b-ceff-485d-8d4e-b9da548c4ebf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:20.856190 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-60e9669b-ceff-485d-8d4e-b9da548c4ebf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:20.856637 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-60e9669b-ceff-485d-8d4e-b9da548c4ebf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:20.857052 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-60e9669b-ceff-485d-8d4e-b9da548c4ebf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:20.919245 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-60e9669b-ceff-485d-8d4e-b9da548c4ebf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:20.921413 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=100 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:45:20.928012 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-60e9669b-ceff-485d-8d4e-b9da548c4ebf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.084884 Sep 21 16:45:20.928578 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 511/1110] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:20 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:20.967222 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-6f95260f-eec6-473a-8003-2f2020cb0560 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:20.967840 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-6f95260f-eec6-473a-8003-2f2020cb0560 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:20.974564 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6f95260f-eec6-473a-8003-2f2020cb0560 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:20.975060 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6f95260f-eec6-473a-8003-2f2020cb0560 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:20.975498 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6f95260f-eec6-473a-8003-2f2020cb0560 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:20.976200 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6f95260f-eec6-473a-8003-2f2020cb0560 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:20.976657 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6f95260f-eec6-473a-8003-2f2020cb0560 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:20.977085 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6f95260f-eec6-473a-8003-2f2020cb0560 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:21.334765 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-6f95260f-eec6-473a-8003-2f2020cb0560 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:21.343030 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-6f95260f-eec6-473a-8003-2f2020cb0560 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.379739 Sep 21 16:45:21.343600 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 600/1111] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:20 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:21.951914 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-a2e0eceb-b795-4b65-ab83-e97795f7bc5a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:21.952483 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-a2e0eceb-b795-4b65-ab83-e97795f7bc5a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:21.959554 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a2e0eceb-b795-4b65-ab83-e97795f7bc5a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:21.960035 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a2e0eceb-b795-4b65-ab83-e97795f7bc5a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:21.960466 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a2e0eceb-b795-4b65-ab83-e97795f7bc5a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:21.961157 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a2e0eceb-b795-4b65-ab83-e97795f7bc5a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:21.961610 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a2e0eceb-b795-4b65-ab83-e97795f7bc5a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:21.962030 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a2e0eceb-b795-4b65-ab83-e97795f7bc5a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:22.023519 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-a2e0eceb-b795-4b65-ab83-e97795f7bc5a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:22.031196 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-a2e0eceb-b795-4b65-ab83-e97795f7bc5a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083495 Sep 21 16:45:22.031791 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 512/1112] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:21 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:22.366593 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-5659cd3a-e803-48ee-91fd-fa48d0baa99e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:22.367151 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-5659cd3a-e803-48ee-91fd-fa48d0baa99e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:22.373639 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5659cd3a-e803-48ee-91fd-fa48d0baa99e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:22.374150 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5659cd3a-e803-48ee-91fd-fa48d0baa99e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:22.374586 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5659cd3a-e803-48ee-91fd-fa48d0baa99e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:22.375935 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5659cd3a-e803-48ee-91fd-fa48d0baa99e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:22.376386 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5659cd3a-e803-48ee-91fd-fa48d0baa99e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:22.376808 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5659cd3a-e803-48ee-91fd-fa48d0baa99e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:22.502885 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5659cd3a-e803-48ee-91fd-fa48d0baa99e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:22.511313 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-5659cd3a-e803-48ee-91fd-fa48d0baa99e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.148631 Sep 21 16:45:22.511902 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 601/1113] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:22 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:23.053776 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-5fadab8c-7728-4428-a4e6-bdecc8f4ed50 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:23.054384 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-5fadab8c-7728-4428-a4e6-bdecc8f4ed50 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:23.060716 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5fadab8c-7728-4428-a4e6-bdecc8f4ed50 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:23.061194 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5fadab8c-7728-4428-a4e6-bdecc8f4ed50 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:23.061624 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5fadab8c-7728-4428-a4e6-bdecc8f4ed50 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:23.062333 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5fadab8c-7728-4428-a4e6-bdecc8f4ed50 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:23.062789 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5fadab8c-7728-4428-a4e6-bdecc8f4ed50 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:23.063209 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5fadab8c-7728-4428-a4e6-bdecc8f4ed50 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:23.126686 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-5fadab8c-7728-4428-a4e6-bdecc8f4ed50 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:23.136142 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-5fadab8c-7728-4428-a4e6-bdecc8f4ed50 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.086334 Sep 21 16:45:23.136712 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 513/1114] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:23 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:23.535098 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-e6e855bf-264f-4a31-9155-be32d600e056 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:23.535702 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-e6e855bf-264f-4a31-9155-be32d600e056 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:23.542009 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e6e855bf-264f-4a31-9155-be32d600e056 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:23.542507 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e6e855bf-264f-4a31-9155-be32d600e056 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:23.542932 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e6e855bf-264f-4a31-9155-be32d600e056 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:23.543615 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e6e855bf-264f-4a31-9155-be32d600e056 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:23.544061 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e6e855bf-264f-4a31-9155-be32d600e056 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:23.544471 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e6e855bf-264f-4a31-9155-be32d600e056 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:23.676760 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-e6e855bf-264f-4a31-9155-be32d600e056 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:23.685318 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-e6e855bf-264f-4a31-9155-be32d600e056 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.154581 Sep 21 16:45:23.685897 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 602/1115] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:23 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:24.158846 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d27d5893-e0d2-4ca7-a4a6-73a37869b746 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:24.159494 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d27d5893-e0d2-4ca7-a4a6-73a37869b746 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:24.165824 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d27d5893-e0d2-4ca7-a4a6-73a37869b746 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:24.166350 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d27d5893-e0d2-4ca7-a4a6-73a37869b746 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:24.166784 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d27d5893-e0d2-4ca7-a4a6-73a37869b746 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:24.167476 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d27d5893-e0d2-4ca7-a4a6-73a37869b746 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:24.167932 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d27d5893-e0d2-4ca7-a4a6-73a37869b746 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:24.168356 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d27d5893-e0d2-4ca7-a4a6-73a37869b746 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:24.233176 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d27d5893-e0d2-4ca7-a4a6-73a37869b746 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:24.241534 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d27d5893-e0d2-4ca7-a4a6-73a37869b746 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.086704 Sep 21 16:45:24.242126 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 514/1116] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:24 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:24.710242 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-5b49efe2-5226-4b2f-8348-d7e01ccbcf75 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:24.710859 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-5b49efe2-5226-4b2f-8348-d7e01ccbcf75 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:24.717218 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5b49efe2-5226-4b2f-8348-d7e01ccbcf75 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:24.717722 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5b49efe2-5226-4b2f-8348-d7e01ccbcf75 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:24.718189 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5b49efe2-5226-4b2f-8348-d7e01ccbcf75 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:24.718849 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5b49efe2-5226-4b2f-8348-d7e01ccbcf75 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:24.719297 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5b49efe2-5226-4b2f-8348-d7e01ccbcf75 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:24.720385 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5b49efe2-5226-4b2f-8348-d7e01ccbcf75 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:24.724230 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=100 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:45:24.848411 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5b49efe2-5226-4b2f-8348-d7e01ccbcf75 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:24.856648 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-5b49efe2-5226-4b2f-8348-d7e01ccbcf75 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.150281 Sep 21 16:45:24.857224 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 603/1117] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:24 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:25.263586 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-cbeab783-6d7a-444f-83b4-bc8a6dc6dc3c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:25.264198 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-cbeab783-6d7a-444f-83b4-bc8a6dc6dc3c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:25.270791 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cbeab783-6d7a-444f-83b4-bc8a6dc6dc3c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:25.271276 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cbeab783-6d7a-444f-83b4-bc8a6dc6dc3c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:25.271713 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cbeab783-6d7a-444f-83b4-bc8a6dc6dc3c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:25.272406 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cbeab783-6d7a-444f-83b4-bc8a6dc6dc3c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:25.272858 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cbeab783-6d7a-444f-83b4-bc8a6dc6dc3c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:25.273279 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cbeab783-6d7a-444f-83b4-bc8a6dc6dc3c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:25.335486 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-cbeab783-6d7a-444f-83b4-bc8a6dc6dc3c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:25.343227 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-cbeab783-6d7a-444f-83b4-bc8a6dc6dc3c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083534 Sep 21 16:45:25.343788 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 515/1118] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:25 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:25.882453 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-af818560-6eb8-437b-bc63-bcabfda22caf tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:25.883546 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-af818560-6eb8-437b-bc63-bcabfda22caf tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:25.890195 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-af818560-6eb8-437b-bc63-bcabfda22caf tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:25.890677 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-af818560-6eb8-437b-bc63-bcabfda22caf tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:25.891109 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-af818560-6eb8-437b-bc63-bcabfda22caf tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:25.892441 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-af818560-6eb8-437b-bc63-bcabfda22caf tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:25.892893 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-af818560-6eb8-437b-bc63-bcabfda22caf tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:25.893313 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-af818560-6eb8-437b-bc63-bcabfda22caf tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:26.021728 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-af818560-6eb8-437b-bc63-bcabfda22caf tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:26.029897 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-af818560-6eb8-437b-bc63-bcabfda22caf tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.153104 Sep 21 16:45:26.030491 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 604/1119] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:25 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:26.365420 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-c236fbca-2100-40fe-a42f-43579640cef4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:26.365982 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-c236fbca-2100-40fe-a42f-43579640cef4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:26.372357 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c236fbca-2100-40fe-a42f-43579640cef4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:26.372860 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c236fbca-2100-40fe-a42f-43579640cef4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:26.373269 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c236fbca-2100-40fe-a42f-43579640cef4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:26.373952 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c236fbca-2100-40fe-a42f-43579640cef4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:26.374510 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c236fbca-2100-40fe-a42f-43579640cef4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:26.374853 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c236fbca-2100-40fe-a42f-43579640cef4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:26.434740 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-c236fbca-2100-40fe-a42f-43579640cef4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:26.442367 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-c236fbca-2100-40fe-a42f-43579640cef4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.080899 Sep 21 16:45:26.442926 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 516/1120] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:26 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:27.054531 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-5253d1d5-d667-44d9-b718-1c2eea4e9402 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:27.055173 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-5253d1d5-d667-44d9-b718-1c2eea4e9402 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:27.061769 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5253d1d5-d667-44d9-b718-1c2eea4e9402 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:27.062278 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5253d1d5-d667-44d9-b718-1c2eea4e9402 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:27.062705 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5253d1d5-d667-44d9-b718-1c2eea4e9402 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:27.064021 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5253d1d5-d667-44d9-b718-1c2eea4e9402 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:27.064471 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5253d1d5-d667-44d9-b718-1c2eea4e9402 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:27.064890 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5253d1d5-d667-44d9-b718-1c2eea4e9402 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:27.193818 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5253d1d5-d667-44d9-b718-1c2eea4e9402 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:27.201951 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-5253d1d5-d667-44d9-b718-1c2eea4e9402 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.151313 Sep 21 16:45:27.202555 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 605/1121] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:27 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:27.466218 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-e007d1a9-d3d7-43a7-8fcc-0395ac609790 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:27.466849 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-e007d1a9-d3d7-43a7-8fcc-0395ac609790 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:27.473295 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e007d1a9-d3d7-43a7-8fcc-0395ac609790 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:27.473783 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e007d1a9-d3d7-43a7-8fcc-0395ac609790 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:27.474244 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e007d1a9-d3d7-43a7-8fcc-0395ac609790 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:27.474945 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e007d1a9-d3d7-43a7-8fcc-0395ac609790 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:27.475397 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e007d1a9-d3d7-43a7-8fcc-0395ac609790 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:27.475818 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e007d1a9-d3d7-43a7-8fcc-0395ac609790 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:27.539323 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-e007d1a9-d3d7-43a7-8fcc-0395ac609790 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:27.547074 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-e007d1a9-d3d7-43a7-8fcc-0395ac609790 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.085055 Sep 21 16:45:27.547672 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 517/1122] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:27 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:28.227015 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-86b3d5e2-9c38-44cf-9a97-07745d485640 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:28.227623 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-86b3d5e2-9c38-44cf-9a97-07745d485640 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:28.234141 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-86b3d5e2-9c38-44cf-9a97-07745d485640 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:28.234625 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-86b3d5e2-9c38-44cf-9a97-07745d485640 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:28.235052 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-86b3d5e2-9c38-44cf-9a97-07745d485640 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:28.236360 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-86b3d5e2-9c38-44cf-9a97-07745d485640 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:28.236806 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-86b3d5e2-9c38-44cf-9a97-07745d485640 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:28.237272 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-86b3d5e2-9c38-44cf-9a97-07745d485640 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:28.376460 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-86b3d5e2-9c38-44cf-9a97-07745d485640 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:28.384538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-86b3d5e2-9c38-44cf-9a97-07745d485640 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.161635 Sep 21 16:45:28.385112 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 606/1123] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:28 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:28.568899 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-e8bbd6e1-cfd8-4567-8850-d9141fd1b85b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:28.569516 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-e8bbd6e1-cfd8-4567-8850-d9141fd1b85b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:28.576171 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e8bbd6e1-cfd8-4567-8850-d9141fd1b85b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:28.576658 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e8bbd6e1-cfd8-4567-8850-d9141fd1b85b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:28.577089 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e8bbd6e1-cfd8-4567-8850-d9141fd1b85b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:28.577782 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e8bbd6e1-cfd8-4567-8850-d9141fd1b85b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:28.578271 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e8bbd6e1-cfd8-4567-8850-d9141fd1b85b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:28.578691 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e8bbd6e1-cfd8-4567-8850-d9141fd1b85b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:28.644402 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-e8bbd6e1-cfd8-4567-8850-d9141fd1b85b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:28.652112 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-e8bbd6e1-cfd8-4567-8850-d9141fd1b85b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.087068 Sep 21 16:45:28.652675 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 518/1124] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:28 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:45:29.407705 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ab43186f-240d-49a5-b285-1fe3749fec36 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:29.408316 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ab43186f-240d-49a5-b285-1fe3749fec36 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:29.414771 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ab43186f-240d-49a5-b285-1fe3749fec36 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:29.415242 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ab43186f-240d-49a5-b285-1fe3749fec36 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:29.415672 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ab43186f-240d-49a5-b285-1fe3749fec36 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:29.416353 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ab43186f-240d-49a5-b285-1fe3749fec36 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:29.416794 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ab43186f-240d-49a5-b285-1fe3749fec36 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:29.417208 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ab43186f-240d-49a5-b285-1fe3749fec36 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:29.544571 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ab43186f-240d-49a5-b285-1fe3749fec36 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:29.553681 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ab43186f-240d-49a5-b285-1fe3749fec36 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.149803 Sep 21 16:45:29.554305 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 607/1125] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:29 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:29.676959 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-b13f4e11-754a-4ab9-8787-e3975c5546fd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:29.677555 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-b13f4e11-754a-4ab9-8787-e3975c5546fd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:29.683958 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b13f4e11-754a-4ab9-8787-e3975c5546fd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:29.684432 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b13f4e11-754a-4ab9-8787-e3975c5546fd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:29.684862 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b13f4e11-754a-4ab9-8787-e3975c5546fd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:29.685548 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b13f4e11-754a-4ab9-8787-e3975c5546fd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:29.685993 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b13f4e11-754a-4ab9-8787-e3975c5546fd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:29.686434 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b13f4e11-754a-4ab9-8787-e3975c5546fd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:29.748573 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-b13f4e11-754a-4ab9-8787-e3975c5546fd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:29.756125 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-b13f4e11-754a-4ab9-8787-e3975c5546fd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083576 Sep 21 16:45:29.756682 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 519/1126] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:29 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:30.576838 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-8326948c-5426-4366-870f-306e4fda822f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:30.577449 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-8326948c-5426-4366-870f-306e4fda822f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:30.584808 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8326948c-5426-4366-870f-306e4fda822f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:30.585288 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8326948c-5426-4366-870f-306e4fda822f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:30.585724 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8326948c-5426-4366-870f-306e4fda822f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:30.586438 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8326948c-5426-4366-870f-306e4fda822f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:30.586894 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8326948c-5426-4366-870f-306e4fda822f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:30.587313 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8326948c-5426-4366-870f-306e4fda822f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:30.716543 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-8326948c-5426-4366-870f-306e4fda822f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:30.726799 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-8326948c-5426-4366-870f-306e4fda822f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.153828 Sep 21 16:45:30.727383 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 608/1127] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:30 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:30.778819 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-dbd50faa-6505-49c9-ada9-3cf72ff6869b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:30.779379 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-dbd50faa-6505-49c9-ada9-3cf72ff6869b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:30.786661 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dbd50faa-6505-49c9-ada9-3cf72ff6869b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:30.787152 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dbd50faa-6505-49c9-ada9-3cf72ff6869b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:30.787587 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dbd50faa-6505-49c9-ada9-3cf72ff6869b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:30.788285 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dbd50faa-6505-49c9-ada9-3cf72ff6869b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:30.788745 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dbd50faa-6505-49c9-ada9-3cf72ff6869b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:30.789165 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dbd50faa-6505-49c9-ada9-3cf72ff6869b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:30.849974 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-dbd50faa-6505-49c9-ada9-3cf72ff6869b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:30.857671 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-dbd50faa-6505-49c9-ada9-3cf72ff6869b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082836 Sep 21 16:45:30.858268 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 520/1128] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:30 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:31.749645 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-a4dc83f5-3107-4f2b-8093-08fcacd970d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:31.750283 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-a4dc83f5-3107-4f2b-8093-08fcacd970d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:31.756735 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a4dc83f5-3107-4f2b-8093-08fcacd970d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:31.757235 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a4dc83f5-3107-4f2b-8093-08fcacd970d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:31.757661 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a4dc83f5-3107-4f2b-8093-08fcacd970d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:31.758405 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a4dc83f5-3107-4f2b-8093-08fcacd970d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:31.758854 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a4dc83f5-3107-4f2b-8093-08fcacd970d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:31.759298 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a4dc83f5-3107-4f2b-8093-08fcacd970d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:31.880323 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-f3fe246a-866b-48b9-a501-b194c0eb0477 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:31.881070 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-f3fe246a-866b-48b9-a501-b194c0eb0477 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:31.887818 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f3fe246a-866b-48b9-a501-b194c0eb0477 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:31.888318 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f3fe246a-866b-48b9-a501-b194c0eb0477 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:31.888753 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f3fe246a-866b-48b9-a501-b194c0eb0477 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:31.889458 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f3fe246a-866b-48b9-a501-b194c0eb0477 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:31.889915 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f3fe246a-866b-48b9-a501-b194c0eb0477 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:31.890106 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a4dc83f5-3107-4f2b-8093-08fcacd970d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:31.890367 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f3fe246a-866b-48b9-a501-b194c0eb0477 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:31.899174 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-a4dc83f5-3107-4f2b-8093-08fcacd970d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.153342 Sep 21 16:45:31.899999 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 609/1129] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:31 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:31.954435 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-f3fe246a-866b-48b9-a501-b194c0eb0477 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:31.962562 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-f3fe246a-866b-48b9-a501-b194c0eb0477 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.086161 Sep 21 16:45:31.963171 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 521/1130] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:31 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:45:32.923294 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-758d1c2d-81e1-421c-90b3-7038a051c7df tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:32.924037 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-758d1c2d-81e1-421c-90b3-7038a051c7df tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:32.930401 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-758d1c2d-81e1-421c-90b3-7038a051c7df tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:32.930879 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-758d1c2d-81e1-421c-90b3-7038a051c7df tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:32.931309 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-758d1c2d-81e1-421c-90b3-7038a051c7df tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:32.931989 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-758d1c2d-81e1-421c-90b3-7038a051c7df tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:32.932436 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-758d1c2d-81e1-421c-90b3-7038a051c7df tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:32.932846 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-758d1c2d-81e1-421c-90b3-7038a051c7df tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:32.985002 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-377c93d0-f819-4ea2-8eff-1894713ee1b2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:32.985664 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-377c93d0-f819-4ea2-8eff-1894713ee1b2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:32.992210 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-377c93d0-f819-4ea2-8eff-1894713ee1b2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:32.992692 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-377c93d0-f819-4ea2-8eff-1894713ee1b2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:32.993131 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-377c93d0-f819-4ea2-8eff-1894713ee1b2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:32.993825 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-377c93d0-f819-4ea2-8eff-1894713ee1b2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:32.994316 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-377c93d0-f819-4ea2-8eff-1894713ee1b2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:32.994731 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-377c93d0-f819-4ea2-8eff-1894713ee1b2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:33.060313 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-377c93d0-f819-4ea2-8eff-1894713ee1b2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:33.062499 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-758d1c2d-81e1-421c-90b3-7038a051c7df tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:33.070148 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-377c93d0-f819-4ea2-8eff-1894713ee1b2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.089118 Sep 21 16:45:33.072201 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 522/1131] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:32 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:45:33.072741 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-758d1c2d-81e1-421c-90b3-7038a051c7df tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.153289 Sep 21 16:45:33.073555 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 610/1132] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:32 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:34.094150 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-c5e23877-1f35-4d20-89b9-dc79670b9398 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:34.094817 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-c5e23877-1f35-4d20-89b9-dc79670b9398 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:34.096220 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-7e57a5a6-81c4-45bb-9c99-1a6d176599ce tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:34.096838 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-7e57a5a6-81c4-45bb-9c99-1a6d176599ce tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:34.101413 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c5e23877-1f35-4d20-89b9-dc79670b9398 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:34.101898 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c5e23877-1f35-4d20-89b9-dc79670b9398 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:34.102358 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c5e23877-1f35-4d20-89b9-dc79670b9398 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:34.103054 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c5e23877-1f35-4d20-89b9-dc79670b9398 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:34.103502 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c5e23877-1f35-4d20-89b9-dc79670b9398 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:34.103922 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c5e23877-1f35-4d20-89b9-dc79670b9398 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:34.104029 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7e57a5a6-81c4-45bb-9c99-1a6d176599ce tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:34.104493 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7e57a5a6-81c4-45bb-9c99-1a6d176599ce tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:34.104925 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7e57a5a6-81c4-45bb-9c99-1a6d176599ce tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:34.105801 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7e57a5a6-81c4-45bb-9c99-1a6d176599ce tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:34.106371 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7e57a5a6-81c4-45bb-9c99-1a6d176599ce tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:34.106719 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7e57a5a6-81c4-45bb-9c99-1a6d176599ce tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:34.166328 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-c5e23877-1f35-4d20-89b9-dc79670b9398 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:34.174645 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-c5e23877-1f35-4d20-89b9-dc79670b9398 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.084407 Sep 21 16:45:34.175216 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 523/1133] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:34 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:34.240344 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-7e57a5a6-81c4-45bb-9c99-1a6d176599ce tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:34.248411 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-7e57a5a6-81c4-45bb-9c99-1a6d176599ce tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.155983 Sep 21 16:45:34.248972 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 611/1134] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:34 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:45:35.197744 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-0af9acaf-471c-4f21-938f-37d6e4081313 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:35.198374 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-0af9acaf-471c-4f21-938f-37d6e4081313 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:35.205255 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0af9acaf-471c-4f21-938f-37d6e4081313 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:35.205732 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0af9acaf-471c-4f21-938f-37d6e4081313 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:35.206182 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0af9acaf-471c-4f21-938f-37d6e4081313 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:35.206874 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0af9acaf-471c-4f21-938f-37d6e4081313 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:35.207326 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0af9acaf-471c-4f21-938f-37d6e4081313 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:35.207743 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0af9acaf-471c-4f21-938f-37d6e4081313 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:35.272226 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-fdcf8b4a-9164-433c-95b7-573eecb6e8be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:35.272871 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-fdcf8b4a-9164-433c-95b7-573eecb6e8be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:35.273005 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-0af9acaf-471c-4f21-938f-37d6e4081313 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:35.279383 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fdcf8b4a-9164-433c-95b7-573eecb6e8be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:35.279867 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fdcf8b4a-9164-433c-95b7-573eecb6e8be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:35.280398 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fdcf8b4a-9164-433c-95b7-573eecb6e8be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:35.281032 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-0af9acaf-471c-4f21-938f-37d6e4081313 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.087180 Sep 21 16:45:35.281575 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fdcf8b4a-9164-433c-95b7-573eecb6e8be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:35.281714 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 524/1135] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:35 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:35.282762 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fdcf8b4a-9164-433c-95b7-573eecb6e8be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:35.283287 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fdcf8b4a-9164-433c-95b7-573eecb6e8be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:35.413602 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-fdcf8b4a-9164-433c-95b7-573eecb6e8be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:35.421855 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-fdcf8b4a-9164-433c-95b7-573eecb6e8be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.153444 Sep 21 16:45:35.422386 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 612/1136] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:35 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:45:36.304542 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-93e9769c-bb20-424f-8cf3-9060a58437fc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:36.305151 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-93e9769c-bb20-424f-8cf3-9060a58437fc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:36.311716 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-93e9769c-bb20-424f-8cf3-9060a58437fc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:36.312191 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-93e9769c-bb20-424f-8cf3-9060a58437fc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:36.312618 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-93e9769c-bb20-424f-8cf3-9060a58437fc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:36.313299 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-93e9769c-bb20-424f-8cf3-9060a58437fc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:36.313746 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-93e9769c-bb20-424f-8cf3-9060a58437fc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:36.314195 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-93e9769c-bb20-424f-8cf3-9060a58437fc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:36.374428 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-93e9769c-bb20-424f-8cf3-9060a58437fc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:36.381963 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-93e9769c-bb20-424f-8cf3-9060a58437fc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081301 Sep 21 16:45:36.382542 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 525/1137] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:36 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:36.444760 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-101556cc-e44a-4f1f-b0ee-a9d3d1e0f54b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:36.445370 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-101556cc-e44a-4f1f-b0ee-a9d3d1e0f54b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:36.451805 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-101556cc-e44a-4f1f-b0ee-a9d3d1e0f54b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:36.452286 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-101556cc-e44a-4f1f-b0ee-a9d3d1e0f54b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:36.452716 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-101556cc-e44a-4f1f-b0ee-a9d3d1e0f54b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:36.453401 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-101556cc-e44a-4f1f-b0ee-a9d3d1e0f54b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:36.454188 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-101556cc-e44a-4f1f-b0ee-a9d3d1e0f54b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:36.454654 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-101556cc-e44a-4f1f-b0ee-a9d3d1e0f54b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:36.584385 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-101556cc-e44a-4f1f-b0ee-a9d3d1e0f54b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:36.592763 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-101556cc-e44a-4f1f-b0ee-a9d3d1e0f54b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.151827 Sep 21 16:45:36.593345 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 613/1138] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:36 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:37.404712 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-b1cee29f-839e-4036-9ac0-43d917a0c66f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:37.405316 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-b1cee29f-839e-4036-9ac0-43d917a0c66f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:37.412026 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b1cee29f-839e-4036-9ac0-43d917a0c66f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:37.412498 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b1cee29f-839e-4036-9ac0-43d917a0c66f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:37.412925 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b1cee29f-839e-4036-9ac0-43d917a0c66f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:37.413607 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b1cee29f-839e-4036-9ac0-43d917a0c66f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:37.414071 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b1cee29f-839e-4036-9ac0-43d917a0c66f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:37.414495 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b1cee29f-839e-4036-9ac0-43d917a0c66f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:37.477582 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-b1cee29f-839e-4036-9ac0-43d917a0c66f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:37.485900 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-b1cee29f-839e-4036-9ac0-43d917a0c66f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.084984 Sep 21 16:45:37.487145 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 526/1139] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:37 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:37.616740 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-974b1b7d-2b07-46bd-84d3-c3f9fcf20511 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:37.617374 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-974b1b7d-2b07-46bd-84d3-c3f9fcf20511 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:37.623853 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-974b1b7d-2b07-46bd-84d3-c3f9fcf20511 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:37.624327 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-974b1b7d-2b07-46bd-84d3-c3f9fcf20511 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:37.624759 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-974b1b7d-2b07-46bd-84d3-c3f9fcf20511 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:37.625596 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-974b1b7d-2b07-46bd-84d3-c3f9fcf20511 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:37.626614 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-974b1b7d-2b07-46bd-84d3-c3f9fcf20511 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:37.627039 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-974b1b7d-2b07-46bd-84d3-c3f9fcf20511 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:37.757505 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-974b1b7d-2b07-46bd-84d3-c3f9fcf20511 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:37.766166 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-974b1b7d-2b07-46bd-84d3-c3f9fcf20511 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.153337 Sep 21 16:45:37.766778 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 614/1140] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:37 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:38.508845 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-3de22f3f-bac7-4139-a245-d30338fd99c2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:38.509462 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-3de22f3f-bac7-4139-a245-d30338fd99c2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:38.515990 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3de22f3f-bac7-4139-a245-d30338fd99c2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:38.516977 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3de22f3f-bac7-4139-a245-d30338fd99c2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:38.517410 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3de22f3f-bac7-4139-a245-d30338fd99c2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:38.518124 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3de22f3f-bac7-4139-a245-d30338fd99c2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:38.518581 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3de22f3f-bac7-4139-a245-d30338fd99c2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:38.519007 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3de22f3f-bac7-4139-a245-d30338fd99c2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:38.580671 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-3de22f3f-bac7-4139-a245-d30338fd99c2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:38.588220 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-3de22f3f-bac7-4139-a245-d30338fd99c2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083259 Sep 21 16:45:38.588793 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 527/1141] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:38 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:38.789815 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-d468df0d-2b58-4041-a9ee-48f3251e2373 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:38.790397 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-d468df0d-2b58-4041-a9ee-48f3251e2373 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:38.792481 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_api:SELECT=52 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:45:38.797927 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d468df0d-2b58-4041-a9ee-48f3251e2373 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:38.798436 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d468df0d-2b58-4041-a9ee-48f3251e2373 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:38.798917 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d468df0d-2b58-4041-a9ee-48f3251e2373 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:38.799606 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d468df0d-2b58-4041-a9ee-48f3251e2373 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:38.800059 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d468df0d-2b58-4041-a9ee-48f3251e2373 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:38.800480 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d468df0d-2b58-4041-a9ee-48f3251e2373 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:38.928909 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d468df0d-2b58-4041-a9ee-48f3251e2373 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:38.937119 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-d468df0d-2b58-4041-a9ee-48f3251e2373 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.151245 Sep 21 16:45:38.937692 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 615/1142] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:38 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:39.612216 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-af95b58e-e792-404f-9dcd-993cb531fa0b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:39.612816 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-af95b58e-e792-404f-9dcd-993cb531fa0b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:39.615162 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_api:SELECT=56 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:45:39.620578 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-af95b58e-e792-404f-9dcd-993cb531fa0b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:39.620998 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-af95b58e-e792-404f-9dcd-993cb531fa0b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:39.621433 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-af95b58e-e792-404f-9dcd-993cb531fa0b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:39.622144 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-af95b58e-e792-404f-9dcd-993cb531fa0b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:39.622599 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-af95b58e-e792-404f-9dcd-993cb531fa0b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:39.623022 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-af95b58e-e792-404f-9dcd-993cb531fa0b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:39.637586 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=100 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:45:39.684079 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-af95b58e-e792-404f-9dcd-993cb531fa0b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:39.691667 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-af95b58e-e792-404f-9dcd-993cb531fa0b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083977 Sep 21 16:45:39.692244 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 528/1143] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:39 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:39.960790 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-451daa41-b365-4123-a204-d282b015cdea tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:39.961534 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-451daa41-b365-4123-a204-d282b015cdea tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:39.969135 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-451daa41-b365-4123-a204-d282b015cdea tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:39.969611 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-451daa41-b365-4123-a204-d282b015cdea tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:39.970125 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-451daa41-b365-4123-a204-d282b015cdea tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:39.970840 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-451daa41-b365-4123-a204-d282b015cdea tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:39.971221 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-451daa41-b365-4123-a204-d282b015cdea tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:39.971636 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-451daa41-b365-4123-a204-d282b015cdea tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:40.102859 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-451daa41-b365-4123-a204-d282b015cdea tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:40.111810 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-451daa41-b365-4123-a204-d282b015cdea tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.154887 Sep 21 16:45:40.112389 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 616/1144] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:39 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:40.715649 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-5c1ca907-a007-4c97-bb17-928501fa9655 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:40.716214 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-5c1ca907-a007-4c97-bb17-928501fa9655 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:40.723265 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5c1ca907-a007-4c97-bb17-928501fa9655 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:40.723749 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5c1ca907-a007-4c97-bb17-928501fa9655 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:40.724181 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5c1ca907-a007-4c97-bb17-928501fa9655 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:40.724893 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5c1ca907-a007-4c97-bb17-928501fa9655 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:40.725807 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5c1ca907-a007-4c97-bb17-928501fa9655 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:40.725807 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5c1ca907-a007-4c97-bb17-928501fa9655 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:40.789856 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-5c1ca907-a007-4c97-bb17-928501fa9655 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:40.798242 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-5c1ca907-a007-4c97-bb17-928501fa9655 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.086282 Sep 21 16:45:40.798808 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 529/1145] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:40 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:45:41.134098 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-8892f37e-aca1-4004-8b32-36b62a7ec64a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:41.134673 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-8892f37e-aca1-4004-8b32-36b62a7ec64a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:41.141587 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8892f37e-aca1-4004-8b32-36b62a7ec64a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:41.142111 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8892f37e-aca1-4004-8b32-36b62a7ec64a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:41.142612 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8892f37e-aca1-4004-8b32-36b62a7ec64a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:41.143306 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8892f37e-aca1-4004-8b32-36b62a7ec64a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:41.143787 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8892f37e-aca1-4004-8b32-36b62a7ec64a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:41.144260 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8892f37e-aca1-4004-8b32-36b62a7ec64a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:41.274235 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-8892f37e-aca1-4004-8b32-36b62a7ec64a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:41.283252 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-8892f37e-aca1-4004-8b32-36b62a7ec64a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.153070 Sep 21 16:45:41.283854 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 617/1146] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:41 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:41.820694 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-b7954992-0b54-45b0-afc8-eba7bca73ced tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:41.821250 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-b7954992-0b54-45b0-afc8-eba7bca73ced tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:41.827649 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b7954992-0b54-45b0-afc8-eba7bca73ced tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:41.828134 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b7954992-0b54-45b0-afc8-eba7bca73ced tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:41.829219 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b7954992-0b54-45b0-afc8-eba7bca73ced tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:41.829919 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b7954992-0b54-45b0-afc8-eba7bca73ced tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:41.830407 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b7954992-0b54-45b0-afc8-eba7bca73ced tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:41.830831 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b7954992-0b54-45b0-afc8-eba7bca73ced tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:41.895314 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-b7954992-0b54-45b0-afc8-eba7bca73ced tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:41.903054 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-b7954992-0b54-45b0-afc8-eba7bca73ced tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.086382 Sep 21 16:45:41.903611 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 530/1147] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:41 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:45:42.305844 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ace0d372-5c97-4708-8ab1-c560cbb9ded7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:42.306485 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ace0d372-5c97-4708-8ab1-c560cbb9ded7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:42.313397 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ace0d372-5c97-4708-8ab1-c560cbb9ded7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:42.313870 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ace0d372-5c97-4708-8ab1-c560cbb9ded7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:42.314327 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ace0d372-5c97-4708-8ab1-c560cbb9ded7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:42.315015 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ace0d372-5c97-4708-8ab1-c560cbb9ded7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:42.315465 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ace0d372-5c97-4708-8ab1-c560cbb9ded7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:42.315884 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ace0d372-5c97-4708-8ab1-c560cbb9ded7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:42.445724 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ace0d372-5c97-4708-8ab1-c560cbb9ded7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:42.454502 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ace0d372-5c97-4708-8ab1-c560cbb9ded7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.151980 Sep 21 16:45:42.455071 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 618/1148] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:42 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:42.927476 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-a6181977-457f-4c58-aa1a-b4e5635da3ae tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:42.928118 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-a6181977-457f-4c58-aa1a-b4e5635da3ae tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:42.934488 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a6181977-457f-4c58-aa1a-b4e5635da3ae tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:42.934974 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a6181977-457f-4c58-aa1a-b4e5635da3ae tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:42.935413 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a6181977-457f-4c58-aa1a-b4e5635da3ae tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:42.936107 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a6181977-457f-4c58-aa1a-b4e5635da3ae tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:42.936583 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a6181977-457f-4c58-aa1a-b4e5635da3ae tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:42.937007 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a6181977-457f-4c58-aa1a-b4e5635da3ae tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:43.001388 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-a6181977-457f-4c58-aa1a-b4e5635da3ae tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:43.009052 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-a6181977-457f-4c58-aa1a-b4e5635da3ae tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.085462 Sep 21 16:45:43.009604 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 531/1149] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:42 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:43.478355 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-018b32ac-35c9-48c1-b867-1e05a7711be2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:43.478965 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-018b32ac-35c9-48c1-b867-1e05a7711be2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:43.485629 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-018b32ac-35c9-48c1-b867-1e05a7711be2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:43.486147 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-018b32ac-35c9-48c1-b867-1e05a7711be2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:43.486665 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-018b32ac-35c9-48c1-b867-1e05a7711be2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:43.487387 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-018b32ac-35c9-48c1-b867-1e05a7711be2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:43.487838 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-018b32ac-35c9-48c1-b867-1e05a7711be2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:43.488258 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-018b32ac-35c9-48c1-b867-1e05a7711be2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:43.615369 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-018b32ac-35c9-48c1-b867-1e05a7711be2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:43.618768 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=100 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:45:43.624873 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-018b32ac-35c9-48c1-b867-1e05a7711be2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.150412 Sep 21 16:45:43.625490 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 619/1150] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:43 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:44.032184 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-80f2c74a-c5ab-46cf-8635-e25cdf43a9a3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:44.032780 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-80f2c74a-c5ab-46cf-8635-e25cdf43a9a3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:44.039815 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-80f2c74a-c5ab-46cf-8635-e25cdf43a9a3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:44.040293 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-80f2c74a-c5ab-46cf-8635-e25cdf43a9a3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:44.040720 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-80f2c74a-c5ab-46cf-8635-e25cdf43a9a3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:44.041412 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-80f2c74a-c5ab-46cf-8635-e25cdf43a9a3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:44.041861 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-80f2c74a-c5ab-46cf-8635-e25cdf43a9a3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:44.042305 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-80f2c74a-c5ab-46cf-8635-e25cdf43a9a3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:44.103039 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-80f2c74a-c5ab-46cf-8635-e25cdf43a9a3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:44.110767 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-80f2c74a-c5ab-46cf-8635-e25cdf43a9a3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082426 Sep 21 16:45:44.111362 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 532/1151] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:44 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:44.648830 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-34c47de0-c212-463d-8bbb-5fd29444d780 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:44.649450 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-34c47de0-c212-463d-8bbb-5fd29444d780 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:44.655778 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-34c47de0-c212-463d-8bbb-5fd29444d780 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:44.656252 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-34c47de0-c212-463d-8bbb-5fd29444d780 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:44.656677 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-34c47de0-c212-463d-8bbb-5fd29444d780 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:44.657355 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-34c47de0-c212-463d-8bbb-5fd29444d780 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:44.657799 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-34c47de0-c212-463d-8bbb-5fd29444d780 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:44.658295 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-34c47de0-c212-463d-8bbb-5fd29444d780 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:44.786228 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-34c47de0-c212-463d-8bbb-5fd29444d780 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:44.794525 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-34c47de0-c212-463d-8bbb-5fd29444d780 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.149870 Sep 21 16:45:44.795095 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 620/1152] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:44 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:45.135794 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-6cff0a18-a9af-4ece-aedc-03765ffa216c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:45.136741 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-6cff0a18-a9af-4ece-aedc-03765ffa216c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:45.144812 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6cff0a18-a9af-4ece-aedc-03765ffa216c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:45.145459 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6cff0a18-a9af-4ece-aedc-03765ffa216c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:45.146018 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6cff0a18-a9af-4ece-aedc-03765ffa216c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:45.146906 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6cff0a18-a9af-4ece-aedc-03765ffa216c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:45.147448 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6cff0a18-a9af-4ece-aedc-03765ffa216c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:45.148032 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6cff0a18-a9af-4ece-aedc-03765ffa216c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:45.212804 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-6cff0a18-a9af-4ece-aedc-03765ffa216c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:45.220636 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-6cff0a18-a9af-4ece-aedc-03765ffa216c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.089982 Sep 21 16:45:45.221254 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 533/1153] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:45 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:45.817349 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-62064ba9-3610-4734-affd-c7e76ccc5aa8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:45.817932 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-62064ba9-3610-4734-affd-c7e76ccc5aa8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:45.824344 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-62064ba9-3610-4734-affd-c7e76ccc5aa8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:45.824814 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-62064ba9-3610-4734-affd-c7e76ccc5aa8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:45.825237 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-62064ba9-3610-4734-affd-c7e76ccc5aa8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:45.825916 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-62064ba9-3610-4734-affd-c7e76ccc5aa8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:45.826398 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-62064ba9-3610-4734-affd-c7e76ccc5aa8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:45.826813 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-62064ba9-3610-4734-affd-c7e76ccc5aa8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:45.962520 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-62064ba9-3610-4734-affd-c7e76ccc5aa8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:45.970760 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-62064ba9-3610-4734-affd-c7e76ccc5aa8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.157864 Sep 21 16:45:45.971393 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 621/1154] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:45 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:46.243759 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-ab9d796d-8f80-4b2f-839e-74ae7178bb68 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:46.244366 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-ab9d796d-8f80-4b2f-839e-74ae7178bb68 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:46.250974 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ab9d796d-8f80-4b2f-839e-74ae7178bb68 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:46.251480 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ab9d796d-8f80-4b2f-839e-74ae7178bb68 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:46.251910 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ab9d796d-8f80-4b2f-839e-74ae7178bb68 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:46.253134 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ab9d796d-8f80-4b2f-839e-74ae7178bb68 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:46.253585 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ab9d796d-8f80-4b2f-839e-74ae7178bb68 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:46.254033 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ab9d796d-8f80-4b2f-839e-74ae7178bb68 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:46.317657 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-ab9d796d-8f80-4b2f-839e-74ae7178bb68 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:46.325320 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-ab9d796d-8f80-4b2f-839e-74ae7178bb68 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.085435 Sep 21 16:45:46.325884 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 534/1155] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:46 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:46.993812 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-06ba57c4-3efc-408b-8662-90ba04c59b2e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:46.994435 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-06ba57c4-3efc-408b-8662-90ba04c59b2e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:47.000770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-06ba57c4-3efc-408b-8662-90ba04c59b2e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:47.001244 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-06ba57c4-3efc-408b-8662-90ba04c59b2e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:47.001669 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-06ba57c4-3efc-408b-8662-90ba04c59b2e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:47.002375 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-06ba57c4-3efc-408b-8662-90ba04c59b2e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:47.002821 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-06ba57c4-3efc-408b-8662-90ba04c59b2e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:47.003234 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-06ba57c4-3efc-408b-8662-90ba04c59b2e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:47.130855 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-06ba57c4-3efc-408b-8662-90ba04c59b2e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:47.139970 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-06ba57c4-3efc-408b-8662-90ba04c59b2e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.150109 Sep 21 16:45:47.140553 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 622/1156] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:46 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:47.349555 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-3e76c5ae-d90e-4d53-9958-87aca743a479 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:47.350129 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-3e76c5ae-d90e-4d53-9958-87aca743a479 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:47.357190 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3e76c5ae-d90e-4d53-9958-87aca743a479 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:47.357677 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3e76c5ae-d90e-4d53-9958-87aca743a479 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:47.358152 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3e76c5ae-d90e-4d53-9958-87aca743a479 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:47.358851 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3e76c5ae-d90e-4d53-9958-87aca743a479 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:47.359309 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3e76c5ae-d90e-4d53-9958-87aca743a479 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:47.359734 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3e76c5ae-d90e-4d53-9958-87aca743a479 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:47.420290 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-3e76c5ae-d90e-4d53-9958-87aca743a479 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:47.428334 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-3e76c5ae-d90e-4d53-9958-87aca743a479 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083406 Sep 21 16:45:47.428893 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 535/1157] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:47 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:48.163590 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-1d67eaed-e143-436c-b915-0e236abbff2d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:48.164181 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-1d67eaed-e143-436c-b915-0e236abbff2d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:48.171401 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1d67eaed-e143-436c-b915-0e236abbff2d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:48.171883 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1d67eaed-e143-436c-b915-0e236abbff2d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:48.172314 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1d67eaed-e143-436c-b915-0e236abbff2d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:48.173002 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1d67eaed-e143-436c-b915-0e236abbff2d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:48.173456 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1d67eaed-e143-436c-b915-0e236abbff2d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:48.173870 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1d67eaed-e143-436c-b915-0e236abbff2d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:48.305884 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-1d67eaed-e143-436c-b915-0e236abbff2d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:48.315411 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-1d67eaed-e143-436c-b915-0e236abbff2d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.155086 Sep 21 16:45:48.316013 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 623/1158] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:48 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:48.450898 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-73671c8e-5683-4fc9-91ba-47897161542b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:48.451436 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-73671c8e-5683-4fc9-91ba-47897161542b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:48.458644 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-73671c8e-5683-4fc9-91ba-47897161542b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:48.459047 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-73671c8e-5683-4fc9-91ba-47897161542b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:48.459477 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-73671c8e-5683-4fc9-91ba-47897161542b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:48.460167 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-73671c8e-5683-4fc9-91ba-47897161542b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:48.460620 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-73671c8e-5683-4fc9-91ba-47897161542b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:48.461036 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-73671c8e-5683-4fc9-91ba-47897161542b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:48.522153 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-73671c8e-5683-4fc9-91ba-47897161542b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:48.529776 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-73671c8e-5683-4fc9-91ba-47897161542b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082805 Sep 21 16:45:48.530359 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 536/1159] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:48 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:49.339841 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-44ab2b6d-2bf9-46cb-a197-a8824ba49424 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:49.340442 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-44ab2b6d-2bf9-46cb-a197-a8824ba49424 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:49.347009 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-44ab2b6d-2bf9-46cb-a197-a8824ba49424 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:49.347489 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-44ab2b6d-2bf9-46cb-a197-a8824ba49424 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:49.347915 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-44ab2b6d-2bf9-46cb-a197-a8824ba49424 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:49.348595 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-44ab2b6d-2bf9-46cb-a197-a8824ba49424 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:49.349042 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-44ab2b6d-2bf9-46cb-a197-a8824ba49424 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:49.349461 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-44ab2b6d-2bf9-46cb-a197-a8824ba49424 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:49.475410 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-44ab2b6d-2bf9-46cb-a197-a8824ba49424 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:49.483595 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-44ab2b6d-2bf9-46cb-a197-a8824ba49424 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.147593 Sep 21 16:45:49.484371 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 624/1160] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:49 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:49.553237 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-4681cd31-84a5-4cbf-a9ca-ad9b9a1e8a75 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:49.553841 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-4681cd31-84a5-4cbf-a9ca-ad9b9a1e8a75 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:49.560231 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4681cd31-84a5-4cbf-a9ca-ad9b9a1e8a75 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:49.560708 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4681cd31-84a5-4cbf-a9ca-ad9b9a1e8a75 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:49.561136 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4681cd31-84a5-4cbf-a9ca-ad9b9a1e8a75 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:49.561819 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4681cd31-84a5-4cbf-a9ca-ad9b9a1e8a75 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:49.562311 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4681cd31-84a5-4cbf-a9ca-ad9b9a1e8a75 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:49.562729 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4681cd31-84a5-4cbf-a9ca-ad9b9a1e8a75 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:49.625773 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-4681cd31-84a5-4cbf-a9ca-ad9b9a1e8a75 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:49.634734 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-4681cd31-84a5-4cbf-a9ca-ad9b9a1e8a75 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.085840 Sep 21 16:45:49.635288 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 537/1161] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:49 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:50.507780 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-cd032f63-d4cc-4013-a5df-3d4279270391 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:50.508955 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-cd032f63-d4cc-4013-a5df-3d4279270391 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:50.517185 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cd032f63-d4cc-4013-a5df-3d4279270391 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:50.518104 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cd032f63-d4cc-4013-a5df-3d4279270391 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:50.518906 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cd032f63-d4cc-4013-a5df-3d4279270391 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:50.519792 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cd032f63-d4cc-4013-a5df-3d4279270391 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:50.520250 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cd032f63-d4cc-4013-a5df-3d4279270391 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:50.520675 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cd032f63-d4cc-4013-a5df-3d4279270391 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:50.651204 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-cd032f63-d4cc-4013-a5df-3d4279270391 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:50.656707 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-5a02a059-e454-422e-a64a-5b877991b7be tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:50.657384 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-5a02a059-e454-422e-a64a-5b877991b7be tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:50.660150 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-cd032f63-d4cc-4013-a5df-3d4279270391 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.156256 Sep 21 16:45:50.660738 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 625/1162] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:50 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:50.664485 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5a02a059-e454-422e-a64a-5b877991b7be tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:50.664960 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5a02a059-e454-422e-a64a-5b877991b7be tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:50.665391 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5a02a059-e454-422e-a64a-5b877991b7be tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:50.666090 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5a02a059-e454-422e-a64a-5b877991b7be tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:50.666541 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5a02a059-e454-422e-a64a-5b877991b7be tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:50.666956 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5a02a059-e454-422e-a64a-5b877991b7be tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:50.733362 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-5a02a059-e454-422e-a64a-5b877991b7be tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:50.743415 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-5a02a059-e454-422e-a64a-5b877991b7be tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.090577 Sep 21 16:45:50.743987 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 538/1163] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:50 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:45:51.684038 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-0dfbf13f-1808-47d0-beb3-c0deacd2fb59 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:51.684652 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-0dfbf13f-1808-47d0-beb3-c0deacd2fb59 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:51.691162 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0dfbf13f-1808-47d0-beb3-c0deacd2fb59 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:51.691639 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0dfbf13f-1808-47d0-beb3-c0deacd2fb59 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:51.692071 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0dfbf13f-1808-47d0-beb3-c0deacd2fb59 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:51.692761 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0dfbf13f-1808-47d0-beb3-c0deacd2fb59 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:51.693212 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0dfbf13f-1808-47d0-beb3-c0deacd2fb59 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:51.693634 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0dfbf13f-1808-47d0-beb3-c0deacd2fb59 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:51.766690 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-33132f0d-b32b-440c-8d24-e76d8b542351 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:51.767353 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-33132f0d-b32b-440c-8d24-e76d8b542351 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:51.774357 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-33132f0d-b32b-440c-8d24-e76d8b542351 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:51.775150 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-33132f0d-b32b-440c-8d24-e76d8b542351 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:51.775263 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-33132f0d-b32b-440c-8d24-e76d8b542351 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:51.775979 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-33132f0d-b32b-440c-8d24-e76d8b542351 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:51.776440 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-33132f0d-b32b-440c-8d24-e76d8b542351 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:51.776867 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-33132f0d-b32b-440c-8d24-e76d8b542351 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:51.827677 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-0dfbf13f-1808-47d0-beb3-c0deacd2fb59 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:51.836466 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-0dfbf13f-1808-47d0-beb3-c0deacd2fb59 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.156331 Sep 21 16:45:51.837056 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 626/1164] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:51 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:51.840122 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-33132f0d-b32b-440c-8d24-e76d8b542351 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:51.847925 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-33132f0d-b32b-440c-8d24-e76d8b542351 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.085145 Sep 21 16:45:51.848479 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 539/1165] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:51 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:45:52.859545 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-9a6d5ebb-8aed-400c-b35a-812810e9879d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:52.860111 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-9a6d5ebb-8aed-400c-b35a-812810e9879d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:52.866547 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9a6d5ebb-8aed-400c-b35a-812810e9879d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:52.867591 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9a6d5ebb-8aed-400c-b35a-812810e9879d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:52.868028 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9a6d5ebb-8aed-400c-b35a-812810e9879d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:52.868813 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9a6d5ebb-8aed-400c-b35a-812810e9879d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:52.869265 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9a6d5ebb-8aed-400c-b35a-812810e9879d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:52.869681 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9a6d5ebb-8aed-400c-b35a-812810e9879d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:52.870355 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d037ca67-c7a7-4734-b683-27d1fb1275e7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:52.870998 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d037ca67-c7a7-4734-b683-27d1fb1275e7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:52.877905 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d037ca67-c7a7-4734-b683-27d1fb1275e7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:52.878422 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d037ca67-c7a7-4734-b683-27d1fb1275e7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:52.878856 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d037ca67-c7a7-4734-b683-27d1fb1275e7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:52.879562 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d037ca67-c7a7-4734-b683-27d1fb1275e7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:52.880012 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d037ca67-c7a7-4734-b683-27d1fb1275e7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:52.880437 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d037ca67-c7a7-4734-b683-27d1fb1275e7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:52.945422 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d037ca67-c7a7-4734-b683-27d1fb1275e7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:52.954084 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d037ca67-c7a7-4734-b683-27d1fb1275e7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.087175 Sep 21 16:45:52.955612 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 540/1166] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:52 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:45:53.000816 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-9a6d5ebb-8aed-400c-b35a-812810e9879d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:53.009834 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-9a6d5ebb-8aed-400c-b35a-812810e9879d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.154214 Sep 21 16:45:53.010455 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 627/1167] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:52 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:53.977375 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d1431a73-d265-4a08-bcfa-59a5dbaaa1d9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:53.977985 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d1431a73-d265-4a08-bcfa-59a5dbaaa1d9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:53.984669 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d1431a73-d265-4a08-bcfa-59a5dbaaa1d9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:53.985154 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d1431a73-d265-4a08-bcfa-59a5dbaaa1d9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:53.985589 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d1431a73-d265-4a08-bcfa-59a5dbaaa1d9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:53.986845 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d1431a73-d265-4a08-bcfa-59a5dbaaa1d9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:53.987303 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d1431a73-d265-4a08-bcfa-59a5dbaaa1d9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:53.987729 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d1431a73-d265-4a08-bcfa-59a5dbaaa1d9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:54.033994 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-4f9e0d9d-4a03-41ed-b5c5-4f7eff0b8e9a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:54.034742 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-4f9e0d9d-4a03-41ed-b5c5-4f7eff0b8e9a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:54.041650 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4f9e0d9d-4a03-41ed-b5c5-4f7eff0b8e9a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:54.042239 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4f9e0d9d-4a03-41ed-b5c5-4f7eff0b8e9a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:54.042736 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4f9e0d9d-4a03-41ed-b5c5-4f7eff0b8e9a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:54.043496 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4f9e0d9d-4a03-41ed-b5c5-4f7eff0b8e9a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:54.044014 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4f9e0d9d-4a03-41ed-b5c5-4f7eff0b8e9a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:54.044497 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4f9e0d9d-4a03-41ed-b5c5-4f7eff0b8e9a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:54.053334 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d1431a73-d265-4a08-bcfa-59a5dbaaa1d9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:54.061540 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d1431a73-d265-4a08-bcfa-59a5dbaaa1d9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.087989 Sep 21 16:45:54.062126 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 541/1168] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:53 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:54.183145 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-4f9e0d9d-4a03-41ed-b5c5-4f7eff0b8e9a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:54.191987 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-4f9e0d9d-4a03-41ed-b5c5-4f7eff0b8e9a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.161931 Sep 21 16:45:54.192572 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 628/1169] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:54 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:55.085676 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-1af6f88d-de4a-4a61-9632-48640046c6b0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:55.086313 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-1af6f88d-de4a-4a61-9632-48640046c6b0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:55.092832 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1af6f88d-de4a-4a61-9632-48640046c6b0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:55.093478 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1af6f88d-de4a-4a61-9632-48640046c6b0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:55.093749 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1af6f88d-de4a-4a61-9632-48640046c6b0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:55.094494 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1af6f88d-de4a-4a61-9632-48640046c6b0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:55.094948 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1af6f88d-de4a-4a61-9632-48640046c6b0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:55.095579 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1af6f88d-de4a-4a61-9632-48640046c6b0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:55.160772 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-1af6f88d-de4a-4a61-9632-48640046c6b0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:55.168773 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-1af6f88d-de4a-4a61-9632-48640046c6b0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.086915 Sep 21 16:45:55.169345 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 542/1170] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:55 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:55.215509 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-bb41d599-62d1-4763-a29a-4029c2e7bcf3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:55.216127 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-bb41d599-62d1-4763-a29a-4029c2e7bcf3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:55.222534 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb41d599-62d1-4763-a29a-4029c2e7bcf3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:55.223014 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb41d599-62d1-4763-a29a-4029c2e7bcf3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:55.223448 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb41d599-62d1-4763-a29a-4029c2e7bcf3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:55.224130 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb41d599-62d1-4763-a29a-4029c2e7bcf3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:55.224579 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb41d599-62d1-4763-a29a-4029c2e7bcf3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:55.225017 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb41d599-62d1-4763-a29a-4029c2e7bcf3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:55.351309 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-bb41d599-62d1-4763-a29a-4029c2e7bcf3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:55.359475 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-bb41d599-62d1-4763-a29a-4029c2e7bcf3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.147770 Sep 21 16:45:55.360395 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 629/1171] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:55 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:56.191205 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-56fb7c80-df8a-470d-a5f4-7f57b40c6e36 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:56.191798 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-56fb7c80-df8a-470d-a5f4-7f57b40c6e36 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:56.198198 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-56fb7c80-df8a-470d-a5f4-7f57b40c6e36 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:56.198672 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-56fb7c80-df8a-470d-a5f4-7f57b40c6e36 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:56.199101 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-56fb7c80-df8a-470d-a5f4-7f57b40c6e36 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:56.199786 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-56fb7c80-df8a-470d-a5f4-7f57b40c6e36 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:56.201189 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-56fb7c80-df8a-470d-a5f4-7f57b40c6e36 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:56.201681 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-56fb7c80-df8a-470d-a5f4-7f57b40c6e36 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:56.265358 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-56fb7c80-df8a-470d-a5f4-7f57b40c6e36 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:56.273569 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-56fb7c80-df8a-470d-a5f4-7f57b40c6e36 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.086301 Sep 21 16:45:56.274158 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 543/1172] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:56 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:56.382374 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ebbfb455-7ec5-4fcc-bab3-850eac547a8a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:56.382977 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ebbfb455-7ec5-4fcc-bab3-850eac547a8a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:56.389307 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ebbfb455-7ec5-4fcc-bab3-850eac547a8a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:56.389777 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ebbfb455-7ec5-4fcc-bab3-850eac547a8a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:56.390247 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ebbfb455-7ec5-4fcc-bab3-850eac547a8a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:56.390934 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ebbfb455-7ec5-4fcc-bab3-850eac547a8a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:56.391374 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ebbfb455-7ec5-4fcc-bab3-850eac547a8a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:56.391787 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ebbfb455-7ec5-4fcc-bab3-850eac547a8a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:56.523169 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ebbfb455-7ec5-4fcc-bab3-850eac547a8a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:56.531339 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ebbfb455-7ec5-4fcc-bab3-850eac547a8a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.152792 Sep 21 16:45:56.531915 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 630/1173] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:56 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:57.297073 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-3a3f57d2-3b86-4309-96a2-625a15e69748 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:57.297691 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-3a3f57d2-3b86-4309-96a2-625a15e69748 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:57.304791 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3a3f57d2-3b86-4309-96a2-625a15e69748 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:57.305274 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3a3f57d2-3b86-4309-96a2-625a15e69748 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:57.305707 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3a3f57d2-3b86-4309-96a2-625a15e69748 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:57.306435 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3a3f57d2-3b86-4309-96a2-625a15e69748 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:57.306895 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3a3f57d2-3b86-4309-96a2-625a15e69748 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:57.307317 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3a3f57d2-3b86-4309-96a2-625a15e69748 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:57.370252 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-3a3f57d2-3b86-4309-96a2-625a15e69748 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:57.378410 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-3a3f57d2-3b86-4309-96a2-625a15e69748 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.084898 Sep 21 16:45:57.378597 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 544/1174] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:57 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:57.554226 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-50addd60-1489-4418-bce6-f184d2e3be0b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:57.554779 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-50addd60-1489-4418-bce6-f184d2e3be0b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:57.561159 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-50addd60-1489-4418-bce6-f184d2e3be0b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:57.561627 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-50addd60-1489-4418-bce6-f184d2e3be0b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:57.562071 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-50addd60-1489-4418-bce6-f184d2e3be0b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:57.562764 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-50addd60-1489-4418-bce6-f184d2e3be0b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:57.563212 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-50addd60-1489-4418-bce6-f184d2e3be0b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:57.563622 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-50addd60-1489-4418-bce6-f184d2e3be0b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:57.689089 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-50addd60-1489-4418-bce6-f184d2e3be0b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:57.697264 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-50addd60-1489-4418-bce6-f184d2e3be0b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.147711 Sep 21 16:45:57.697831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 631/1175] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:57 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:58.401273 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-87820d85-94df-4a97-b162-72a41f70e6e3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:58.401867 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-87820d85-94df-4a97-b162-72a41f70e6e3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:58.408237 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-87820d85-94df-4a97-b162-72a41f70e6e3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:58.408708 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-87820d85-94df-4a97-b162-72a41f70e6e3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:58.409751 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-87820d85-94df-4a97-b162-72a41f70e6e3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:58.410457 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-87820d85-94df-4a97-b162-72a41f70e6e3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:58.410908 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-87820d85-94df-4a97-b162-72a41f70e6e3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:58.411321 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-87820d85-94df-4a97-b162-72a41f70e6e3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:58.413806 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=100 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:45:58.472917 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-87820d85-94df-4a97-b162-72a41f70e6e3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:58.480541 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-87820d85-94df-4a97-b162-72a41f70e6e3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083129 Sep 21 16:45:58.481113 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 545/1176] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:58 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:58.720809 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-5d39418e-d9b1-4ff6-ae8a-63f0100949b2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:58.721403 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-5d39418e-d9b1-4ff6-ae8a-63f0100949b2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:58.728431 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5d39418e-d9b1-4ff6-ae8a-63f0100949b2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:58.728909 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5d39418e-d9b1-4ff6-ae8a-63f0100949b2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:58.729339 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5d39418e-d9b1-4ff6-ae8a-63f0100949b2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:58.730022 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5d39418e-d9b1-4ff6-ae8a-63f0100949b2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:58.730487 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5d39418e-d9b1-4ff6-ae8a-63f0100949b2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:58.730901 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5d39418e-d9b1-4ff6-ae8a-63f0100949b2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:58.857894 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5d39418e-d9b1-4ff6-ae8a-63f0100949b2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:58.865964 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-5d39418e-d9b1-4ff6-ae8a-63f0100949b2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.148995 Sep 21 16:45:58.866573 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 632/1177] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:58 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:59.503113 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-3433bed6-7750-4a37-b92c-7c8af1d3a54b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:59.503720 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-3433bed6-7750-4a37-b92c-7c8af1d3a54b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:59.510154 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3433bed6-7750-4a37-b92c-7c8af1d3a54b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:59.510676 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3433bed6-7750-4a37-b92c-7c8af1d3a54b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:59.511072 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3433bed6-7750-4a37-b92c-7c8af1d3a54b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:59.511768 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3433bed6-7750-4a37-b92c-7c8af1d3a54b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:59.512212 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3433bed6-7750-4a37-b92c-7c8af1d3a54b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:59.512624 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3433bed6-7750-4a37-b92c-7c8af1d3a54b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:59.575648 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-3433bed6-7750-4a37-b92c-7c8af1d3a54b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:45:59.583672 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-3433bed6-7750-4a37-b92c-7c8af1d3a54b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.084370 Sep 21 16:45:59.584231 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 546/1178] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:59 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:45:59.889117 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-f657dca0-aca8-4d03-b938-b158745b7cde tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:45:59.889709 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-f657dca0-aca8-4d03-b938-b158745b7cde tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:45:59.896736 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f657dca0-aca8-4d03-b938-b158745b7cde tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:59.897214 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f657dca0-aca8-4d03-b938-b158745b7cde tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:59.897677 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f657dca0-aca8-4d03-b938-b158745b7cde tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:45:59.898382 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f657dca0-aca8-4d03-b938-b158745b7cde tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:45:59.898830 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f657dca0-aca8-4d03-b938-b158745b7cde tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:45:59.899246 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f657dca0-aca8-4d03-b938-b158745b7cde tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:00.031110 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-f657dca0-aca8-4d03-b938-b158745b7cde tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:00.039964 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-f657dca0-aca8-4d03-b938-b158745b7cde tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.154663 Sep 21 16:46:00.040545 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 633/1179] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:45:59 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:00.607806 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-e0d8f2c4-fe70-4f27-a734-a985cb78eeab tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:00.608419 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-e0d8f2c4-fe70-4f27-a734-a985cb78eeab tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:00.614990 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e0d8f2c4-fe70-4f27-a734-a985cb78eeab tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:00.615474 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e0d8f2c4-fe70-4f27-a734-a985cb78eeab tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:00.615910 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e0d8f2c4-fe70-4f27-a734-a985cb78eeab tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:00.616597 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e0d8f2c4-fe70-4f27-a734-a985cb78eeab tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:00.617050 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e0d8f2c4-fe70-4f27-a734-a985cb78eeab tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:00.617471 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e0d8f2c4-fe70-4f27-a734-a985cb78eeab tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:00.678161 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-e0d8f2c4-fe70-4f27-a734-a985cb78eeab tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:00.685823 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-e0d8f2c4-fe70-4f27-a734-a985cb78eeab tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082272 Sep 21 16:46:00.686415 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 547/1180] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:00 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:01.062245 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-4cefad52-aede-405d-82e2-93a83d597c7d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:01.062855 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-4cefad52-aede-405d-82e2-93a83d597c7d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:01.069812 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4cefad52-aede-405d-82e2-93a83d597c7d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:01.070313 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4cefad52-aede-405d-82e2-93a83d597c7d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:01.070742 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4cefad52-aede-405d-82e2-93a83d597c7d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:01.071423 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4cefad52-aede-405d-82e2-93a83d597c7d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:01.071870 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4cefad52-aede-405d-82e2-93a83d597c7d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:01.072291 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4cefad52-aede-405d-82e2-93a83d597c7d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:01.205212 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-4cefad52-aede-405d-82e2-93a83d597c7d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:01.214115 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-4cefad52-aede-405d-82e2-93a83d597c7d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.155759 Sep 21 16:46:01.214693 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 634/1181] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:01 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:01.708892 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-692fcbc1-c183-443e-a1a7-1da18caa7312 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:01.709506 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-692fcbc1-c183-443e-a1a7-1da18caa7312 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:01.715905 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-692fcbc1-c183-443e-a1a7-1da18caa7312 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:01.716389 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-692fcbc1-c183-443e-a1a7-1da18caa7312 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:01.716821 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-692fcbc1-c183-443e-a1a7-1da18caa7312 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:01.717512 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-692fcbc1-c183-443e-a1a7-1da18caa7312 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:01.717967 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-692fcbc1-c183-443e-a1a7-1da18caa7312 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:01.718419 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-692fcbc1-c183-443e-a1a7-1da18caa7312 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:01.780079 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-692fcbc1-c183-443e-a1a7-1da18caa7312 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:01.788199 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-692fcbc1-c183-443e-a1a7-1da18caa7312 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083294 Sep 21 16:46:01.788767 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 548/1182] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:01 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:02.237071 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-d54956f0-f87f-4af6-b44b-f04fe382eac2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:02.237697 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-d54956f0-f87f-4af6-b44b-f04fe382eac2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:02.244937 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d54956f0-f87f-4af6-b44b-f04fe382eac2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:02.245419 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d54956f0-f87f-4af6-b44b-f04fe382eac2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:02.245850 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d54956f0-f87f-4af6-b44b-f04fe382eac2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:02.246560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d54956f0-f87f-4af6-b44b-f04fe382eac2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:02.247014 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d54956f0-f87f-4af6-b44b-f04fe382eac2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:02.247465 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d54956f0-f87f-4af6-b44b-f04fe382eac2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:02.376984 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d54956f0-f87f-4af6-b44b-f04fe382eac2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:02.385779 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-d54956f0-f87f-4af6-b44b-f04fe382eac2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.152565 Sep 21 16:46:02.386391 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 635/1183] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:02 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:02.811216 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-036c7c9e-a135-4771-a017-d333fdf439e3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:02.811862 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-036c7c9e-a135-4771-a017-d333fdf439e3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:02.818342 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-036c7c9e-a135-4771-a017-d333fdf439e3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:02.818823 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-036c7c9e-a135-4771-a017-d333fdf439e3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:02.819256 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-036c7c9e-a135-4771-a017-d333fdf439e3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:02.819946 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-036c7c9e-a135-4771-a017-d333fdf439e3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:02.820406 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-036c7c9e-a135-4771-a017-d333fdf439e3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:02.820833 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-036c7c9e-a135-4771-a017-d333fdf439e3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:02.881149 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-036c7c9e-a135-4771-a017-d333fdf439e3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:02.888983 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-036c7c9e-a135-4771-a017-d333fdf439e3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081696 Sep 21 16:46:02.889543 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 549/1184] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:02 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:03.408650 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-bb27499d-c722-4ea5-b94f-895b1995d80b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:03.409265 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-bb27499d-c722-4ea5-b94f-895b1995d80b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:03.415644 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb27499d-c722-4ea5-b94f-895b1995d80b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:03.416125 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb27499d-c722-4ea5-b94f-895b1995d80b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:03.416557 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb27499d-c722-4ea5-b94f-895b1995d80b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:03.417242 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb27499d-c722-4ea5-b94f-895b1995d80b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:03.417694 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb27499d-c722-4ea5-b94f-895b1995d80b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:03.418141 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb27499d-c722-4ea5-b94f-895b1995d80b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:03.435601 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=100 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:46:03.546087 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-bb27499d-c722-4ea5-b94f-895b1995d80b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:03.554788 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-bb27499d-c722-4ea5-b94f-895b1995d80b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.149966 Sep 21 16:46:03.555359 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 636/1185] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:03 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:03.913304 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d5e4711c-8db7-4d50-ab02-f60b5eda874f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:03.913893 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d5e4711c-8db7-4d50-ab02-f60b5eda874f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:03.920337 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d5e4711c-8db7-4d50-ab02-f60b5eda874f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:03.920821 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d5e4711c-8db7-4d50-ab02-f60b5eda874f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:03.921262 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d5e4711c-8db7-4d50-ab02-f60b5eda874f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:03.921951 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d5e4711c-8db7-4d50-ab02-f60b5eda874f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:03.922442 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d5e4711c-8db7-4d50-ab02-f60b5eda874f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:03.922853 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d5e4711c-8db7-4d50-ab02-f60b5eda874f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:03.989963 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d5e4711c-8db7-4d50-ab02-f60b5eda874f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:03.998028 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d5e4711c-8db7-4d50-ab02-f60b5eda874f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.088607 Sep 21 16:46:03.998628 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 550/1186] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:03 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:04.578568 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-1dba22f6-119a-430f-951d-22a1af2a03f9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:04.579432 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-1dba22f6-119a-430f-951d-22a1af2a03f9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:04.586654 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1dba22f6-119a-430f-951d-22a1af2a03f9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:04.587134 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1dba22f6-119a-430f-951d-22a1af2a03f9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:04.587571 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1dba22f6-119a-430f-951d-22a1af2a03f9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:04.588325 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1dba22f6-119a-430f-951d-22a1af2a03f9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:04.588720 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1dba22f6-119a-430f-951d-22a1af2a03f9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:04.589135 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1dba22f6-119a-430f-951d-22a1af2a03f9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:04.717341 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-1dba22f6-119a-430f-951d-22a1af2a03f9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:04.725466 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-1dba22f6-119a-430f-951d-22a1af2a03f9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.150817 Sep 21 16:46:04.726034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 637/1187] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:04 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:05.021589 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-a87dcb40-204e-4439-bd3d-8c1e3cbdc85f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:05.022211 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-a87dcb40-204e-4439-bd3d-8c1e3cbdc85f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:05.028672 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a87dcb40-204e-4439-bd3d-8c1e3cbdc85f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:05.029149 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a87dcb40-204e-4439-bd3d-8c1e3cbdc85f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:05.029576 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a87dcb40-204e-4439-bd3d-8c1e3cbdc85f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:05.030287 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a87dcb40-204e-4439-bd3d-8c1e3cbdc85f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:05.030738 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a87dcb40-204e-4439-bd3d-8c1e3cbdc85f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:05.031162 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a87dcb40-204e-4439-bd3d-8c1e3cbdc85f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:05.091779 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-a87dcb40-204e-4439-bd3d-8c1e3cbdc85f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:05.100866 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-a87dcb40-204e-4439-bd3d-8c1e3cbdc85f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083684 Sep 21 16:46:05.101662 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 551/1188] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:05 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:05.747917 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-13440bb6-92ca-4247-b74e-8714de80a1d2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:05.748597 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-13440bb6-92ca-4247-b74e-8714de80a1d2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:05.755463 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-13440bb6-92ca-4247-b74e-8714de80a1d2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:05.755921 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-13440bb6-92ca-4247-b74e-8714de80a1d2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:05.756348 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-13440bb6-92ca-4247-b74e-8714de80a1d2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:05.757027 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-13440bb6-92ca-4247-b74e-8714de80a1d2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:05.757475 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-13440bb6-92ca-4247-b74e-8714de80a1d2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:05.757890 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-13440bb6-92ca-4247-b74e-8714de80a1d2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:05.890217 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-13440bb6-92ca-4247-b74e-8714de80a1d2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:05.898405 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-13440bb6-92ca-4247-b74e-8714de80a1d2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.154368 Sep 21 16:46:05.898971 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 638/1189] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:05 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:06.123724 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-a02e8bfc-ba6c-412e-aad7-bdc89bacc1bf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:06.124292 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-a02e8bfc-ba6c-412e-aad7-bdc89bacc1bf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:06.131337 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a02e8bfc-ba6c-412e-aad7-bdc89bacc1bf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:06.131821 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a02e8bfc-ba6c-412e-aad7-bdc89bacc1bf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:06.132248 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a02e8bfc-ba6c-412e-aad7-bdc89bacc1bf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:06.132936 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a02e8bfc-ba6c-412e-aad7-bdc89bacc1bf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:06.133389 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a02e8bfc-ba6c-412e-aad7-bdc89bacc1bf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:06.133807 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a02e8bfc-ba6c-412e-aad7-bdc89bacc1bf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:06.197983 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-a02e8bfc-ba6c-412e-aad7-bdc89bacc1bf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:06.205996 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-a02e8bfc-ba6c-412e-aad7-bdc89bacc1bf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.086214 Sep 21 16:46:06.206723 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 552/1190] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:06 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:06.921303 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-7c6c08ec-af71-4875-9827-86da1888247a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:06.921913 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-7c6c08ec-af71-4875-9827-86da1888247a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:06.928397 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7c6c08ec-af71-4875-9827-86da1888247a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:06.928881 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7c6c08ec-af71-4875-9827-86da1888247a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:06.929313 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7c6c08ec-af71-4875-9827-86da1888247a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:06.930001 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7c6c08ec-af71-4875-9827-86da1888247a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:06.930477 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7c6c08ec-af71-4875-9827-86da1888247a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:06.930898 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7c6c08ec-af71-4875-9827-86da1888247a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:07.058363 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-7c6c08ec-af71-4875-9827-86da1888247a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:07.067051 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-7c6c08ec-af71-4875-9827-86da1888247a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.149562 Sep 21 16:46:07.067571 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 639/1191] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:06 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:07.228751 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-853c0266-fd7f-495a-9469-0781048636ec tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:07.229363 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-853c0266-fd7f-495a-9469-0781048636ec tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:07.235532 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-853c0266-fd7f-495a-9469-0781048636ec tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:07.236003 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-853c0266-fd7f-495a-9469-0781048636ec tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:07.236432 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-853c0266-fd7f-495a-9469-0781048636ec tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:07.237147 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-853c0266-fd7f-495a-9469-0781048636ec tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:07.237601 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-853c0266-fd7f-495a-9469-0781048636ec tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:07.238026 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-853c0266-fd7f-495a-9469-0781048636ec tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:07.297820 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-853c0266-fd7f-495a-9469-0781048636ec tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:07.306023 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-853c0266-fd7f-495a-9469-0781048636ec tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081191 Sep 21 16:46:07.306622 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 553/1192] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:07 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:08.090775 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-39c6ea48-8303-462c-bfc8-edeca067c5ac tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:08.091386 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-39c6ea48-8303-462c-bfc8-edeca067c5ac tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:08.097826 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-39c6ea48-8303-462c-bfc8-edeca067c5ac tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:08.098373 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-39c6ea48-8303-462c-bfc8-edeca067c5ac tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:08.098807 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-39c6ea48-8303-462c-bfc8-edeca067c5ac tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:08.099512 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-39c6ea48-8303-462c-bfc8-edeca067c5ac tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:08.099964 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-39c6ea48-8303-462c-bfc8-edeca067c5ac tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:08.100386 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-39c6ea48-8303-462c-bfc8-edeca067c5ac tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:08.236681 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-39c6ea48-8303-462c-bfc8-edeca067c5ac tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:08.245639 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-39c6ea48-8303-462c-bfc8-edeca067c5ac tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.158686 Sep 21 16:46:08.246248 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 640/1193] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:08 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:08.329576 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-3b84cf06-9953-457d-ba77-1c14754de0e3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:08.330304 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-3b84cf06-9953-457d-ba77-1c14754de0e3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:08.337035 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3b84cf06-9953-457d-ba77-1c14754de0e3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:08.337517 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3b84cf06-9953-457d-ba77-1c14754de0e3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:08.337952 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3b84cf06-9953-457d-ba77-1c14754de0e3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:08.338695 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3b84cf06-9953-457d-ba77-1c14754de0e3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:08.339149 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3b84cf06-9953-457d-ba77-1c14754de0e3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:08.339570 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3b84cf06-9953-457d-ba77-1c14754de0e3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:08.404000 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-3b84cf06-9953-457d-ba77-1c14754de0e3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:08.412443 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-3b84cf06-9953-457d-ba77-1c14754de0e3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.086950 Sep 21 16:46:08.413013 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 554/1194] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:08 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:09.272108 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c00252aa-1568-4754-83e8-1c3a17c02de1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:09.272834 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-c00252aa-1568-4754-83e8-1c3a17c02de1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:09.275280 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_api:SELECT=52 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:46:09.282662 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c00252aa-1568-4754-83e8-1c3a17c02de1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:09.283146 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c00252aa-1568-4754-83e8-1c3a17c02de1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:09.283642 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c00252aa-1568-4754-83e8-1c3a17c02de1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:09.284518 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c00252aa-1568-4754-83e8-1c3a17c02de1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:09.285062 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c00252aa-1568-4754-83e8-1c3a17c02de1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:09.285394 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c00252aa-1568-4754-83e8-1c3a17c02de1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:09.435932 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-56cee609-3ce6-4578-b747-40cdd33a2ab6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:09.437294 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-56cee609-3ce6-4578-b747-40cdd33a2ab6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:09.445429 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-56cee609-3ce6-4578-b747-40cdd33a2ab6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:09.445930 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-56cee609-3ce6-4578-b747-40cdd33a2ab6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:09.446455 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-56cee609-3ce6-4578-b747-40cdd33a2ab6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:09.447554 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-56cee609-3ce6-4578-b747-40cdd33a2ab6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:09.448191 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-56cee609-3ce6-4578-b747-40cdd33a2ab6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:09.448614 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-56cee609-3ce6-4578-b747-40cdd33a2ab6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:09.467003 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-c00252aa-1568-4754-83e8-1c3a17c02de1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:09.475475 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-c00252aa-1568-4754-83e8-1c3a17c02de1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.209654 Sep 21 16:46:09.490310 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 641/1195] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:09 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:46:09.523678 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-56cee609-3ce6-4578-b747-40cdd33a2ab6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:09.531518 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-56cee609-3ce6-4578-b747-40cdd33a2ab6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.099549 Sep 21 16:46:09.542779 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 555/1196] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:09 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:46:10.500084 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-b88519f1-d5e0-4141-9440-87a2a7add647 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:10.501035 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-b88519f1-d5e0-4141-9440-87a2a7add647 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:10.507572 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b88519f1-d5e0-4141-9440-87a2a7add647 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:10.508053 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b88519f1-d5e0-4141-9440-87a2a7add647 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:10.508480 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b88519f1-d5e0-4141-9440-87a2a7add647 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:10.509202 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b88519f1-d5e0-4141-9440-87a2a7add647 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:10.509649 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b88519f1-d5e0-4141-9440-87a2a7add647 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:10.510085 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b88519f1-d5e0-4141-9440-87a2a7add647 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:10.557697 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-bae53b67-25a3-47e1-bb44-543dc469e55a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:10.558337 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-bae53b67-25a3-47e1-bb44-543dc469e55a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:10.560912 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_api:SELECT=56 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:46:10.566284 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bae53b67-25a3-47e1-bb44-543dc469e55a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:10.566766 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bae53b67-25a3-47e1-bb44-543dc469e55a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:10.567193 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bae53b67-25a3-47e1-bb44-543dc469e55a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:10.567886 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bae53b67-25a3-47e1-bb44-543dc469e55a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:10.568383 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bae53b67-25a3-47e1-bb44-543dc469e55a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:10.568748 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bae53b67-25a3-47e1-bb44-543dc469e55a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:10.634342 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-bae53b67-25a3-47e1-bb44-543dc469e55a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:10.642231 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-bae53b67-25a3-47e1-bb44-543dc469e55a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.089155 Sep 21 16:46:10.642809 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 556/1197] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:10 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:10.649133 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-b88519f1-d5e0-4141-9440-87a2a7add647 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:10.657442 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-b88519f1-d5e0-4141-9440-87a2a7add647 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.161185 Sep 21 16:46:10.658004 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 642/1198] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:10 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:11.666359 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-59e56c85-f25a-43b6-aa4f-d626d3625db3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:11.667083 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-59e56c85-f25a-43b6-aa4f-d626d3625db3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:11.673660 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-59e56c85-f25a-43b6-aa4f-d626d3625db3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:11.674164 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-59e56c85-f25a-43b6-aa4f-d626d3625db3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:11.674601 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-59e56c85-f25a-43b6-aa4f-d626d3625db3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:11.675386 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-59e56c85-f25a-43b6-aa4f-d626d3625db3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:11.675852 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-59e56c85-f25a-43b6-aa4f-d626d3625db3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:11.677094 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-59e56c85-f25a-43b6-aa4f-d626d3625db3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:11.681650 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-cf3f09c5-1bed-405c-8cf6-5b787b24bdd3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:11.682293 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-cf3f09c5-1bed-405c-8cf6-5b787b24bdd3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:11.688867 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cf3f09c5-1bed-405c-8cf6-5b787b24bdd3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:11.689349 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cf3f09c5-1bed-405c-8cf6-5b787b24bdd3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:11.689782 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cf3f09c5-1bed-405c-8cf6-5b787b24bdd3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:11.690541 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cf3f09c5-1bed-405c-8cf6-5b787b24bdd3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:11.690992 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cf3f09c5-1bed-405c-8cf6-5b787b24bdd3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:11.691415 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cf3f09c5-1bed-405c-8cf6-5b787b24bdd3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:11.743918 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-59e56c85-f25a-43b6-aa4f-d626d3625db3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:11.752005 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-59e56c85-f25a-43b6-aa4f-d626d3625db3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.089905 Sep 21 16:46:11.752567 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 557/1199] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:11 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:11.818530 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-cf3f09c5-1bed-405c-8cf6-5b787b24bdd3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:11.826814 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-cf3f09c5-1bed-405c-8cf6-5b787b24bdd3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.149116 Sep 21 16:46:11.828026 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 643/1200] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:11 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:12.774982 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-e6b8c04f-75d2-4c5d-aabc-967e5a2586f1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:12.775546 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-e6b8c04f-75d2-4c5d-aabc-967e5a2586f1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:12.782024 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e6b8c04f-75d2-4c5d-aabc-967e5a2586f1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:12.782543 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e6b8c04f-75d2-4c5d-aabc-967e5a2586f1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:12.782988 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e6b8c04f-75d2-4c5d-aabc-967e5a2586f1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:12.783681 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e6b8c04f-75d2-4c5d-aabc-967e5a2586f1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:12.784138 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e6b8c04f-75d2-4c5d-aabc-967e5a2586f1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:12.784564 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e6b8c04f-75d2-4c5d-aabc-967e5a2586f1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:12.846440 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-e6b8c04f-75d2-4c5d-aabc-967e5a2586f1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:12.850287 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-8d9fb5c4-fe85-47c3-897c-33478d97a435 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:12.851033 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-8d9fb5c4-fe85-47c3-897c-33478d97a435 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:12.854310 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-e6b8c04f-75d2-4c5d-aabc-967e5a2586f1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083258 Sep 21 16:46:12.854888 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 558/1201] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:12 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:12.857340 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8d9fb5c4-fe85-47c3-897c-33478d97a435 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:12.857816 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8d9fb5c4-fe85-47c3-897c-33478d97a435 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:12.858287 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8d9fb5c4-fe85-47c3-897c-33478d97a435 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:12.858981 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8d9fb5c4-fe85-47c3-897c-33478d97a435 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:12.859423 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8d9fb5c4-fe85-47c3-897c-33478d97a435 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:12.859844 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8d9fb5c4-fe85-47c3-897c-33478d97a435 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:12.991331 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-8d9fb5c4-fe85-47c3-897c-33478d97a435 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:12.999680 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-8d9fb5c4-fe85-47c3-897c-33478d97a435 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.153203 Sep 21 16:46:13.000247 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 644/1202] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:12 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:46:13.877330 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-1cef212a-e961-4d77-b280-ad734e0c40dc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:13.877934 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-1cef212a-e961-4d77-b280-ad734e0c40dc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:13.884899 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1cef212a-e961-4d77-b280-ad734e0c40dc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:13.885373 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1cef212a-e961-4d77-b280-ad734e0c40dc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:13.885803 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1cef212a-e961-4d77-b280-ad734e0c40dc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:13.886528 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1cef212a-e961-4d77-b280-ad734e0c40dc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:13.886979 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1cef212a-e961-4d77-b280-ad734e0c40dc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:13.887397 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1cef212a-e961-4d77-b280-ad734e0c40dc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:13.948355 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-1cef212a-e961-4d77-b280-ad734e0c40dc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:13.956333 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-1cef212a-e961-4d77-b280-ad734e0c40dc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082891 Sep 21 16:46:13.956900 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 559/1203] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:13 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:14.023780 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-1f01db60-5b63-44e8-9448-114b99c9c3ae tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:14.024456 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-1f01db60-5b63-44e8-9448-114b99c9c3ae tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:14.031878 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1f01db60-5b63-44e8-9448-114b99c9c3ae tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:14.032360 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1f01db60-5b63-44e8-9448-114b99c9c3ae tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:14.032784 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1f01db60-5b63-44e8-9448-114b99c9c3ae tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:14.033474 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1f01db60-5b63-44e8-9448-114b99c9c3ae tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:14.033923 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1f01db60-5b63-44e8-9448-114b99c9c3ae tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:14.034368 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1f01db60-5b63-44e8-9448-114b99c9c3ae tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:14.159680 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-1f01db60-5b63-44e8-9448-114b99c9c3ae tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:14.167842 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-1f01db60-5b63-44e8-9448-114b99c9c3ae tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.148960 Sep 21 16:46:14.168417 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 645/1204] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:14 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:14.980146 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-e2818a89-334d-482d-af27-c017da19b188 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:14.980764 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-e2818a89-334d-482d-af27-c017da19b188 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:14.987226 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e2818a89-334d-482d-af27-c017da19b188 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:14.987712 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e2818a89-334d-482d-af27-c017da19b188 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:14.988148 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e2818a89-334d-482d-af27-c017da19b188 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:14.988866 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e2818a89-334d-482d-af27-c017da19b188 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:14.989322 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e2818a89-334d-482d-af27-c017da19b188 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:14.989770 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e2818a89-334d-482d-af27-c017da19b188 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:15.052484 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-e2818a89-334d-482d-af27-c017da19b188 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:15.060166 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-e2818a89-334d-482d-af27-c017da19b188 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.084003 Sep 21 16:46:15.060742 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 560/1205] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:14 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:15.191242 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-61e52666-9525-4887-b365-8255d0ded988 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:15.192353 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-61e52666-9525-4887-b365-8255d0ded988 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:15.198876 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-61e52666-9525-4887-b365-8255d0ded988 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:15.199356 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-61e52666-9525-4887-b365-8255d0ded988 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:15.199789 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-61e52666-9525-4887-b365-8255d0ded988 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:15.200499 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-61e52666-9525-4887-b365-8255d0ded988 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:15.200952 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-61e52666-9525-4887-b365-8255d0ded988 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:15.201370 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-61e52666-9525-4887-b365-8255d0ded988 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:15.330719 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-61e52666-9525-4887-b365-8255d0ded988 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:15.339496 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-61e52666-9525-4887-b365-8255d0ded988 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.152226 Sep 21 16:46:15.340067 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 646/1206] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:15 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:16.083529 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-97eb0c33-62e7-4e09-96e9-5b42d89d5041 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:16.084898 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-97eb0c33-62e7-4e09-96e9-5b42d89d5041 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:16.091396 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-97eb0c33-62e7-4e09-96e9-5b42d89d5041 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:16.091883 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-97eb0c33-62e7-4e09-96e9-5b42d89d5041 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:16.092322 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-97eb0c33-62e7-4e09-96e9-5b42d89d5041 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:16.093022 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-97eb0c33-62e7-4e09-96e9-5b42d89d5041 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:16.093480 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-97eb0c33-62e7-4e09-96e9-5b42d89d5041 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:16.093905 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-97eb0c33-62e7-4e09-96e9-5b42d89d5041 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:16.154122 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-97eb0c33-62e7-4e09-96e9-5b42d89d5041 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:16.156330 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=100 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:46:16.163758 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-97eb0c33-62e7-4e09-96e9-5b42d89d5041 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.084566 Sep 21 16:46:16.164320 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 561/1207] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:16 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:16.362372 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-1d55e713-802c-4aca-b58c-e297d04c53ed tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:16.362937 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-1d55e713-802c-4aca-b58c-e297d04c53ed tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:16.369385 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1d55e713-802c-4aca-b58c-e297d04c53ed tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:16.369870 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1d55e713-802c-4aca-b58c-e297d04c53ed tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:16.370351 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1d55e713-802c-4aca-b58c-e297d04c53ed tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:16.371046 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1d55e713-802c-4aca-b58c-e297d04c53ed tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:16.371503 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1d55e713-802c-4aca-b58c-e297d04c53ed tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:16.371925 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1d55e713-802c-4aca-b58c-e297d04c53ed tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:16.499211 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-1d55e713-802c-4aca-b58c-e297d04c53ed tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:16.507293 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-1d55e713-802c-4aca-b58c-e297d04c53ed tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.148926 Sep 21 16:46:16.507866 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 647/1208] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:16 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:17.186847 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-3d963e34-d54a-44d9-b3f3-0f498ce1b0e0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:17.187473 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-3d963e34-d54a-44d9-b3f3-0f498ce1b0e0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:17.194520 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3d963e34-d54a-44d9-b3f3-0f498ce1b0e0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:17.195005 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3d963e34-d54a-44d9-b3f3-0f498ce1b0e0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:17.195442 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3d963e34-d54a-44d9-b3f3-0f498ce1b0e0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:17.196139 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3d963e34-d54a-44d9-b3f3-0f498ce1b0e0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:17.196597 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3d963e34-d54a-44d9-b3f3-0f498ce1b0e0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:17.197027 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3d963e34-d54a-44d9-b3f3-0f498ce1b0e0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:17.257830 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-3d963e34-d54a-44d9-b3f3-0f498ce1b0e0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:17.265500 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-3d963e34-d54a-44d9-b3f3-0f498ce1b0e0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082589 Sep 21 16:46:17.266070 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 562/1209] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:17 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:17.530834 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-b325edd6-dc0e-4077-8e72-607667f3994c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:17.531475 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-b325edd6-dc0e-4077-8e72-607667f3994c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:17.538477 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b325edd6-dc0e-4077-8e72-607667f3994c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:17.538954 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b325edd6-dc0e-4077-8e72-607667f3994c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:17.539386 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b325edd6-dc0e-4077-8e72-607667f3994c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:17.540069 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b325edd6-dc0e-4077-8e72-607667f3994c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:17.540521 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b325edd6-dc0e-4077-8e72-607667f3994c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:17.540943 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b325edd6-dc0e-4077-8e72-607667f3994c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:17.668631 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-b325edd6-dc0e-4077-8e72-607667f3994c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:17.677360 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-b325edd6-dc0e-4077-8e72-607667f3994c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.150487 Sep 21 16:46:17.677926 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 648/1210] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:17 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:18.288129 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-997ae2c2-47d8-4689-a596-61b445bc982f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:18.288885 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-997ae2c2-47d8-4689-a596-61b445bc982f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:18.295389 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-997ae2c2-47d8-4689-a596-61b445bc982f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:18.295876 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-997ae2c2-47d8-4689-a596-61b445bc982f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:18.296304 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-997ae2c2-47d8-4689-a596-61b445bc982f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:18.296997 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-997ae2c2-47d8-4689-a596-61b445bc982f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:18.297442 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-997ae2c2-47d8-4689-a596-61b445bc982f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:18.297857 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-997ae2c2-47d8-4689-a596-61b445bc982f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:18.358183 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-997ae2c2-47d8-4689-a596-61b445bc982f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:18.365638 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-997ae2c2-47d8-4689-a596-61b445bc982f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081453 Sep 21 16:46:18.366221 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 563/1211] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:18 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:18.699473 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-7a3484ad-8ecb-4db8-bbf9-21c2c56da62e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:18.700080 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-7a3484ad-8ecb-4db8-bbf9-21c2c56da62e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:18.706731 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7a3484ad-8ecb-4db8-bbf9-21c2c56da62e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:18.707223 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7a3484ad-8ecb-4db8-bbf9-21c2c56da62e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:18.707645 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7a3484ad-8ecb-4db8-bbf9-21c2c56da62e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:18.708326 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7a3484ad-8ecb-4db8-bbf9-21c2c56da62e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:18.708770 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7a3484ad-8ecb-4db8-bbf9-21c2c56da62e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:18.709183 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7a3484ad-8ecb-4db8-bbf9-21c2c56da62e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:18.833338 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-7a3484ad-8ecb-4db8-bbf9-21c2c56da62e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:18.841420 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-7a3484ad-8ecb-4db8-bbf9-21c2c56da62e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.145774 Sep 21 16:46:18.841990 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 649/1212] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:18 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:19.389403 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d5a1a1f1-2a4a-4592-a317-496b03ac5967 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:19.389403 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d5a1a1f1-2a4a-4592-a317-496b03ac5967 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:19.396335 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d5a1a1f1-2a4a-4592-a317-496b03ac5967 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:19.396815 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d5a1a1f1-2a4a-4592-a317-496b03ac5967 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:19.397244 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d5a1a1f1-2a4a-4592-a317-496b03ac5967 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:19.397934 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d5a1a1f1-2a4a-4592-a317-496b03ac5967 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:19.398408 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d5a1a1f1-2a4a-4592-a317-496b03ac5967 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:19.398828 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d5a1a1f1-2a4a-4592-a317-496b03ac5967 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:19.467071 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d5a1a1f1-2a4a-4592-a317-496b03ac5967 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:19.475311 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d5a1a1f1-2a4a-4592-a317-496b03ac5967 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.090426 Sep 21 16:46:19.475866 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 564/1213] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:19 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:19.864302 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-5b7b7b7e-9d40-483f-bb31-09cd3b193acf tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:19.864947 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-5b7b7b7e-9d40-483f-bb31-09cd3b193acf tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:19.871440 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5b7b7b7e-9d40-483f-bb31-09cd3b193acf tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:19.871923 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5b7b7b7e-9d40-483f-bb31-09cd3b193acf tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:19.872362 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5b7b7b7e-9d40-483f-bb31-09cd3b193acf tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:19.873056 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5b7b7b7e-9d40-483f-bb31-09cd3b193acf tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:19.873515 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5b7b7b7e-9d40-483f-bb31-09cd3b193acf tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:19.873939 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5b7b7b7e-9d40-483f-bb31-09cd3b193acf tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:20.000875 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5b7b7b7e-9d40-483f-bb31-09cd3b193acf tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:20.009538 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-5b7b7b7e-9d40-483f-bb31-09cd3b193acf tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.149096 Sep 21 16:46:20.010157 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 650/1214] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:19 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:20.498683 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-1a01acda-5a34-4cfa-a589-259a35b18dd3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:20.499272 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-1a01acda-5a34-4cfa-a589-259a35b18dd3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:20.506143 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1a01acda-5a34-4cfa-a589-259a35b18dd3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:20.506627 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1a01acda-5a34-4cfa-a589-259a35b18dd3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:20.507054 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1a01acda-5a34-4cfa-a589-259a35b18dd3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:20.507745 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1a01acda-5a34-4cfa-a589-259a35b18dd3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:20.508192 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1a01acda-5a34-4cfa-a589-259a35b18dd3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:20.508633 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1a01acda-5a34-4cfa-a589-259a35b18dd3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:20.569144 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-1a01acda-5a34-4cfa-a589-259a35b18dd3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:20.576659 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-1a01acda-5a34-4cfa-a589-259a35b18dd3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081812 Sep 21 16:46:20.577215 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 565/1215] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:20 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:21.034796 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-faa86d5f-ad4c-457a-94d8-a172351dd1e6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:21.035432 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-faa86d5f-ad4c-457a-94d8-a172351dd1e6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:21.041923 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-faa86d5f-ad4c-457a-94d8-a172351dd1e6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:21.042436 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-faa86d5f-ad4c-457a-94d8-a172351dd1e6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:21.042871 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-faa86d5f-ad4c-457a-94d8-a172351dd1e6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:21.043557 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-faa86d5f-ad4c-457a-94d8-a172351dd1e6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:21.044014 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-faa86d5f-ad4c-457a-94d8-a172351dd1e6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:21.044435 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-faa86d5f-ad4c-457a-94d8-a172351dd1e6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:21.177604 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-faa86d5f-ad4c-457a-94d8-a172351dd1e6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:21.186038 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-faa86d5f-ad4c-457a-94d8-a172351dd1e6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.155066 Sep 21 16:46:21.186641 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 651/1216] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:21 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:21.600546 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-b9f6c3d3-2cd2-44dc-a699-8516dab04476 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:21.601159 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-b9f6c3d3-2cd2-44dc-a699-8516dab04476 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:21.607553 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b9f6c3d3-2cd2-44dc-a699-8516dab04476 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:21.608033 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b9f6c3d3-2cd2-44dc-a699-8516dab04476 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:21.608456 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b9f6c3d3-2cd2-44dc-a699-8516dab04476 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:21.609137 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b9f6c3d3-2cd2-44dc-a699-8516dab04476 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:21.609603 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b9f6c3d3-2cd2-44dc-a699-8516dab04476 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:21.610016 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b9f6c3d3-2cd2-44dc-a699-8516dab04476 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:21.670070 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-b9f6c3d3-2cd2-44dc-a699-8516dab04476 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:21.677591 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-b9f6c3d3-2cd2-44dc-a699-8516dab04476 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081438 Sep 21 16:46:21.678168 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 566/1217] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:21 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:22.209951 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-52fb66b0-4c1c-42f1-8da9-5a9caf7ab5b5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:22.210603 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-52fb66b0-4c1c-42f1-8da9-5a9caf7ab5b5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:22.217019 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-52fb66b0-4c1c-42f1-8da9-5a9caf7ab5b5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:22.217498 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-52fb66b0-4c1c-42f1-8da9-5a9caf7ab5b5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:22.217931 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-52fb66b0-4c1c-42f1-8da9-5a9caf7ab5b5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:22.218643 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-52fb66b0-4c1c-42f1-8da9-5a9caf7ab5b5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:22.219097 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-52fb66b0-4c1c-42f1-8da9-5a9caf7ab5b5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:22.219517 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-52fb66b0-4c1c-42f1-8da9-5a9caf7ab5b5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:22.345272 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-52fb66b0-4c1c-42f1-8da9-5a9caf7ab5b5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:22.353450 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-52fb66b0-4c1c-42f1-8da9-5a9caf7ab5b5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.148039 Sep 21 16:46:22.354023 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 652/1218] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:22 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:22.700163 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-835f8f9b-25e7-446f-8608-2dd3f5724959 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:22.700771 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-835f8f9b-25e7-446f-8608-2dd3f5724959 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:22.707840 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-835f8f9b-25e7-446f-8608-2dd3f5724959 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:22.708313 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-835f8f9b-25e7-446f-8608-2dd3f5724959 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:22.708741 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-835f8f9b-25e7-446f-8608-2dd3f5724959 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:22.709420 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-835f8f9b-25e7-446f-8608-2dd3f5724959 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:22.709870 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-835f8f9b-25e7-446f-8608-2dd3f5724959 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:22.710320 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-835f8f9b-25e7-446f-8608-2dd3f5724959 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:22.771678 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-835f8f9b-25e7-446f-8608-2dd3f5724959 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:22.781724 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-835f8f9b-25e7-446f-8608-2dd3f5724959 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.085417 Sep 21 16:46:22.782417 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 567/1219] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:22 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:23.376883 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c599a82c-ec34-43fa-9cba-dc45b5d886dc tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:23.377502 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-c599a82c-ec34-43fa-9cba-dc45b5d886dc tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:23.383989 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c599a82c-ec34-43fa-9cba-dc45b5d886dc tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:23.384472 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c599a82c-ec34-43fa-9cba-dc45b5d886dc tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:23.384911 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c599a82c-ec34-43fa-9cba-dc45b5d886dc tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:23.385600 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c599a82c-ec34-43fa-9cba-dc45b5d886dc tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:23.386074 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c599a82c-ec34-43fa-9cba-dc45b5d886dc tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:23.386503 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c599a82c-ec34-43fa-9cba-dc45b5d886dc tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:23.390479 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=100 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:46:23.516348 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-c599a82c-ec34-43fa-9cba-dc45b5d886dc tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:23.525114 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-c599a82c-ec34-43fa-9cba-dc45b5d886dc tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.152174 Sep 21 16:46:23.525689 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 653/1220] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:23 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:23.805244 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-afc61aa5-c507-4e5f-9ee1-989f23966150 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:23.805862 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-afc61aa5-c507-4e5f-9ee1-989f23966150 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:23.812339 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-afc61aa5-c507-4e5f-9ee1-989f23966150 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:23.812826 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-afc61aa5-c507-4e5f-9ee1-989f23966150 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:23.813266 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-afc61aa5-c507-4e5f-9ee1-989f23966150 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:23.813964 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-afc61aa5-c507-4e5f-9ee1-989f23966150 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:23.814445 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-afc61aa5-c507-4e5f-9ee1-989f23966150 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:23.814870 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-afc61aa5-c507-4e5f-9ee1-989f23966150 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:23.881676 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-afc61aa5-c507-4e5f-9ee1-989f23966150 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:23.889305 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-afc61aa5-c507-4e5f-9ee1-989f23966150 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.088441 Sep 21 16:46:23.889869 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 568/1221] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:23 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:24.547864 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-9cc10f44-be15-408a-a6c3-b31b315f156a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:24.548507 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-9cc10f44-be15-408a-a6c3-b31b315f156a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:24.555522 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9cc10f44-be15-408a-a6c3-b31b315f156a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:24.556003 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9cc10f44-be15-408a-a6c3-b31b315f156a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:24.556433 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9cc10f44-be15-408a-a6c3-b31b315f156a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:24.557117 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9cc10f44-be15-408a-a6c3-b31b315f156a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:24.557567 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9cc10f44-be15-408a-a6c3-b31b315f156a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:24.557989 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9cc10f44-be15-408a-a6c3-b31b315f156a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:24.683684 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-9cc10f44-be15-408a-a6c3-b31b315f156a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:24.691903 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-9cc10f44-be15-408a-a6c3-b31b315f156a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.147929 Sep 21 16:46:24.692493 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 654/1222] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:24 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:24.912511 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-ceebeb65-0796-492a-8249-6bb07804a07c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:24.913111 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-ceebeb65-0796-492a-8249-6bb07804a07c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:24.919478 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ceebeb65-0796-492a-8249-6bb07804a07c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:24.919948 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ceebeb65-0796-492a-8249-6bb07804a07c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:24.920375 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ceebeb65-0796-492a-8249-6bb07804a07c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:24.921053 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ceebeb65-0796-492a-8249-6bb07804a07c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:24.921502 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ceebeb65-0796-492a-8249-6bb07804a07c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:24.921920 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ceebeb65-0796-492a-8249-6bb07804a07c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:24.982612 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-ceebeb65-0796-492a-8249-6bb07804a07c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:24.990474 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-ceebeb65-0796-492a-8249-6bb07804a07c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082433 Sep 21 16:46:24.991066 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 569/1223] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:24 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:25.715590 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-cbd8c444-68fd-4dd6-8b4a-58330f99b600 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:25.716230 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-cbd8c444-68fd-4dd6-8b4a-58330f99b600 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:25.722721 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cbd8c444-68fd-4dd6-8b4a-58330f99b600 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:25.723200 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cbd8c444-68fd-4dd6-8b4a-58330f99b600 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:25.723634 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cbd8c444-68fd-4dd6-8b4a-58330f99b600 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:25.724317 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cbd8c444-68fd-4dd6-8b4a-58330f99b600 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:25.724768 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cbd8c444-68fd-4dd6-8b4a-58330f99b600 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:25.725189 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cbd8c444-68fd-4dd6-8b4a-58330f99b600 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:25.850656 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-cbd8c444-68fd-4dd6-8b4a-58330f99b600 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:25.858915 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-cbd8c444-68fd-4dd6-8b4a-58330f99b600 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.147129 Sep 21 16:46:25.859530 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 655/1224] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:25 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:26.012620 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-1df34809-c3a6-4c12-8750-9c6e22f4b4ad tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:26.013237 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-1df34809-c3a6-4c12-8750-9c6e22f4b4ad tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:26.020253 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1df34809-c3a6-4c12-8750-9c6e22f4b4ad tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:26.020807 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1df34809-c3a6-4c12-8750-9c6e22f4b4ad tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:26.021278 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1df34809-c3a6-4c12-8750-9c6e22f4b4ad tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:26.022008 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1df34809-c3a6-4c12-8750-9c6e22f4b4ad tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:26.022487 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1df34809-c3a6-4c12-8750-9c6e22f4b4ad tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:26.022911 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1df34809-c3a6-4c12-8750-9c6e22f4b4ad tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:26.089222 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-1df34809-c3a6-4c12-8750-9c6e22f4b4ad tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:26.097136 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-1df34809-c3a6-4c12-8750-9c6e22f4b4ad tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.088344 Sep 21 16:46:26.098074 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 570/1225] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:26 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:26.882073 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-e4a5ead8-1875-48a2-b0f0-808e64eeb94d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:26.882695 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-e4a5ead8-1875-48a2-b0f0-808e64eeb94d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:26.889140 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e4a5ead8-1875-48a2-b0f0-808e64eeb94d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:26.889612 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e4a5ead8-1875-48a2-b0f0-808e64eeb94d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:26.890035 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e4a5ead8-1875-48a2-b0f0-808e64eeb94d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:26.890735 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e4a5ead8-1875-48a2-b0f0-808e64eeb94d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:26.891178 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e4a5ead8-1875-48a2-b0f0-808e64eeb94d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:26.891594 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e4a5ead8-1875-48a2-b0f0-808e64eeb94d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:27.018937 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-e4a5ead8-1875-48a2-b0f0-808e64eeb94d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:27.027485 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-e4a5ead8-1875-48a2-b0f0-808e64eeb94d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.149311 Sep 21 16:46:27.028050 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 656/1226] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:26 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:27.119601 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d9f34dd3-d768-43a7-aa64-e58f1aaad07e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:27.120211 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d9f34dd3-d768-43a7-aa64-e58f1aaad07e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:27.126848 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d9f34dd3-d768-43a7-aa64-e58f1aaad07e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:27.127336 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d9f34dd3-d768-43a7-aa64-e58f1aaad07e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:27.127780 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d9f34dd3-d768-43a7-aa64-e58f1aaad07e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:27.128477 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d9f34dd3-d768-43a7-aa64-e58f1aaad07e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:27.128955 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d9f34dd3-d768-43a7-aa64-e58f1aaad07e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:27.129383 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d9f34dd3-d768-43a7-aa64-e58f1aaad07e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:27.190871 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d9f34dd3-d768-43a7-aa64-e58f1aaad07e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:27.199322 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d9f34dd3-d768-43a7-aa64-e58f1aaad07e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083574 Sep 21 16:46:27.199894 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 571/1227] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:27 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:28.052984 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-af900a0a-bb12-4a19-86be-7c3e3ab6ad55 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:28.053583 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-af900a0a-bb12-4a19-86be-7c3e3ab6ad55 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:28.060013 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-af900a0a-bb12-4a19-86be-7c3e3ab6ad55 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:28.060486 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-af900a0a-bb12-4a19-86be-7c3e3ab6ad55 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:28.060914 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-af900a0a-bb12-4a19-86be-7c3e3ab6ad55 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:28.061593 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-af900a0a-bb12-4a19-86be-7c3e3ab6ad55 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:28.062069 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-af900a0a-bb12-4a19-86be-7c3e3ab6ad55 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:28.062485 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-af900a0a-bb12-4a19-86be-7c3e3ab6ad55 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:28.191870 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-af900a0a-bb12-4a19-86be-7c3e3ab6ad55 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:28.199958 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-af900a0a-bb12-4a19-86be-7c3e3ab6ad55 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.151930 Sep 21 16:46:28.200528 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 657/1228] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:28 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:28.223072 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-11b53614-bfac-4138-9a93-12625e6b2eee tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:28.223677 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-11b53614-bfac-4138-9a93-12625e6b2eee tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:28.230026 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-11b53614-bfac-4138-9a93-12625e6b2eee tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:28.230530 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-11b53614-bfac-4138-9a93-12625e6b2eee tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:28.230960 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-11b53614-bfac-4138-9a93-12625e6b2eee tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:28.231646 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-11b53614-bfac-4138-9a93-12625e6b2eee tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:28.232094 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-11b53614-bfac-4138-9a93-12625e6b2eee tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:28.232508 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-11b53614-bfac-4138-9a93-12625e6b2eee tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:28.295710 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-11b53614-bfac-4138-9a93-12625e6b2eee tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:28.304182 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-11b53614-bfac-4138-9a93-12625e6b2eee tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.085243 Sep 21 16:46:28.304688 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 572/1229] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:28 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:29.224649 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-36515cfb-a165-439b-a256-be46d28bde5a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:29.225262 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-36515cfb-a165-439b-a256-be46d28bde5a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:29.231676 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-36515cfb-a165-439b-a256-be46d28bde5a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:29.232163 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-36515cfb-a165-439b-a256-be46d28bde5a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:29.232592 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-36515cfb-a165-439b-a256-be46d28bde5a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:29.233276 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-36515cfb-a165-439b-a256-be46d28bde5a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:29.233726 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-36515cfb-a165-439b-a256-be46d28bde5a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:29.234173 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-36515cfb-a165-439b-a256-be46d28bde5a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:29.327081 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-926fac4e-22c0-4824-b078-2cbb399f5b54 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:29.327681 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-926fac4e-22c0-4824-b078-2cbb399f5b54 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:29.335067 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-926fac4e-22c0-4824-b078-2cbb399f5b54 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:29.335550 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-926fac4e-22c0-4824-b078-2cbb399f5b54 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:29.335985 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-926fac4e-22c0-4824-b078-2cbb399f5b54 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:29.336680 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-926fac4e-22c0-4824-b078-2cbb399f5b54 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:29.337135 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-926fac4e-22c0-4824-b078-2cbb399f5b54 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:29.337556 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-926fac4e-22c0-4824-b078-2cbb399f5b54 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:29.369688 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-36515cfb-a165-439b-a256-be46d28bde5a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:29.377846 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-36515cfb-a165-439b-a256-be46d28bde5a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.157726 Sep 21 16:46:29.378726 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 658/1230] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:29 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:29.398006 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-926fac4e-22c0-4824-b078-2cbb399f5b54 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:29.405599 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-926fac4e-22c0-4824-b078-2cbb399f5b54 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082368 Sep 21 16:46:29.406245 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 573/1231] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:29 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:46:30.400817 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-e547ba07-5b39-4fb9-be12-98e31b1bdd1b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:30.401460 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-e547ba07-5b39-4fb9-be12-98e31b1bdd1b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:30.407893 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e547ba07-5b39-4fb9-be12-98e31b1bdd1b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:30.408375 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e547ba07-5b39-4fb9-be12-98e31b1bdd1b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:30.408807 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e547ba07-5b39-4fb9-be12-98e31b1bdd1b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:30.409487 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e547ba07-5b39-4fb9-be12-98e31b1bdd1b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:30.410451 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e547ba07-5b39-4fb9-be12-98e31b1bdd1b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:30.410873 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e547ba07-5b39-4fb9-be12-98e31b1bdd1b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:30.429036 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-411b5865-cc02-4907-b61f-408b1e153ba8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:30.429640 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-411b5865-cc02-4907-b61f-408b1e153ba8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:30.436056 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-411b5865-cc02-4907-b61f-408b1e153ba8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:30.436530 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-411b5865-cc02-4907-b61f-408b1e153ba8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:30.436958 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-411b5865-cc02-4907-b61f-408b1e153ba8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:30.437643 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-411b5865-cc02-4907-b61f-408b1e153ba8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:30.438113 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-411b5865-cc02-4907-b61f-408b1e153ba8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:30.438534 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-411b5865-cc02-4907-b61f-408b1e153ba8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:30.500029 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-411b5865-cc02-4907-b61f-408b1e153ba8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:30.507731 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-411b5865-cc02-4907-b61f-408b1e153ba8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083118 Sep 21 16:46:30.508495 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 574/1232] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:30 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:46:30.537784 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-e547ba07-5b39-4fb9-be12-98e31b1bdd1b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:30.545990 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-e547ba07-5b39-4fb9-be12-98e31b1bdd1b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.149058 Sep 21 16:46:30.546575 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 659/1233] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:30 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:31.529866 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-cffbf7e3-b329-4d53-a5cd-de5b421629dc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:31.530506 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-cffbf7e3-b329-4d53-a5cd-de5b421629dc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:31.536848 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cffbf7e3-b329-4d53-a5cd-de5b421629dc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:31.537330 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cffbf7e3-b329-4d53-a5cd-de5b421629dc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:31.537765 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cffbf7e3-b329-4d53-a5cd-de5b421629dc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:31.538487 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cffbf7e3-b329-4d53-a5cd-de5b421629dc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:31.538938 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cffbf7e3-b329-4d53-a5cd-de5b421629dc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:31.539359 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cffbf7e3-b329-4d53-a5cd-de5b421629dc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:31.570060 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-32aab933-38e9-4f92-bec8-4e6942f71261 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:31.570679 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-32aab933-38e9-4f92-bec8-4e6942f71261 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:31.577032 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-32aab933-38e9-4f92-bec8-4e6942f71261 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:31.577509 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-32aab933-38e9-4f92-bec8-4e6942f71261 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:31.577937 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-32aab933-38e9-4f92-bec8-4e6942f71261 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:31.578657 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-32aab933-38e9-4f92-bec8-4e6942f71261 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:31.579368 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-32aab933-38e9-4f92-bec8-4e6942f71261 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:31.579784 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-32aab933-38e9-4f92-bec8-4e6942f71261 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:31.600784 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-cffbf7e3-b329-4d53-a5cd-de5b421629dc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:31.608440 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-cffbf7e3-b329-4d53-a5cd-de5b421629dc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082425 Sep 21 16:46:31.609051 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 575/1234] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:31 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:31.709750 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-32aab933-38e9-4f92-bec8-4e6942f71261 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:31.718222 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-32aab933-38e9-4f92-bec8-4e6942f71261 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.152579 Sep 21 16:46:31.718790 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 660/1235] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:31 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:46:32.632004 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-00b384a8-e31e-4029-b6fa-0d28587a1964 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:32.632620 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-00b384a8-e31e-4029-b6fa-0d28587a1964 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:32.639845 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-00b384a8-e31e-4029-b6fa-0d28587a1964 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:32.640352 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-00b384a8-e31e-4029-b6fa-0d28587a1964 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:32.640793 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-00b384a8-e31e-4029-b6fa-0d28587a1964 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:32.641533 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-00b384a8-e31e-4029-b6fa-0d28587a1964 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:32.642013 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-00b384a8-e31e-4029-b6fa-0d28587a1964 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:32.642468 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-00b384a8-e31e-4029-b6fa-0d28587a1964 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:32.709577 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-00b384a8-e31e-4029-b6fa-0d28587a1964 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:32.717501 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-00b384a8-e31e-4029-b6fa-0d28587a1964 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.089845 Sep 21 16:46:32.718082 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 576/1236] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:32 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:46:32.922503 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-54d51597-0a5c-4105-8d3f-79a0b3e7eb10 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:32.923137 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-54d51597-0a5c-4105-8d3f-79a0b3e7eb10 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:32.929460 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-54d51597-0a5c-4105-8d3f-79a0b3e7eb10 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:32.929933 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-54d51597-0a5c-4105-8d3f-79a0b3e7eb10 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:32.930397 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-54d51597-0a5c-4105-8d3f-79a0b3e7eb10 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:32.931073 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-54d51597-0a5c-4105-8d3f-79a0b3e7eb10 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:32.931519 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-54d51597-0a5c-4105-8d3f-79a0b3e7eb10 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:32.931938 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-54d51597-0a5c-4105-8d3f-79a0b3e7eb10 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:33.056221 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-54d51597-0a5c-4105-8d3f-79a0b3e7eb10 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:33.064311 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-54d51597-0a5c-4105-8d3f-79a0b3e7eb10 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.327420 Sep 21 16:46:33.064877 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 661/1237] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:32 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:33.739724 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-955005ce-86d2-4b39-a02f-c3001bcc2601 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:33.740341 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-955005ce-86d2-4b39-a02f-c3001bcc2601 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:33.746789 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-955005ce-86d2-4b39-a02f-c3001bcc2601 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:33.747270 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-955005ce-86d2-4b39-a02f-c3001bcc2601 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:33.747700 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-955005ce-86d2-4b39-a02f-c3001bcc2601 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:33.748390 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-955005ce-86d2-4b39-a02f-c3001bcc2601 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:33.748842 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-955005ce-86d2-4b39-a02f-c3001bcc2601 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:33.749264 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-955005ce-86d2-4b39-a02f-c3001bcc2601 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:33.811333 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-955005ce-86d2-4b39-a02f-c3001bcc2601 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:33.818997 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-955005ce-86d2-4b39-a02f-c3001bcc2601 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083196 Sep 21 16:46:33.819556 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 577/1238] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:33 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:34.088955 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-05ae6600-35b2-4550-a962-c76ea203ecf2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:34.089532 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-05ae6600-35b2-4550-a962-c76ea203ecf2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:34.095835 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-05ae6600-35b2-4550-a962-c76ea203ecf2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:34.096308 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-05ae6600-35b2-4550-a962-c76ea203ecf2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:34.096732 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-05ae6600-35b2-4550-a962-c76ea203ecf2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:34.097443 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-05ae6600-35b2-4550-a962-c76ea203ecf2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:34.097889 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-05ae6600-35b2-4550-a962-c76ea203ecf2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:34.098348 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-05ae6600-35b2-4550-a962-c76ea203ecf2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:34.223638 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-05ae6600-35b2-4550-a962-c76ea203ecf2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:34.231709 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-05ae6600-35b2-4550-a962-c76ea203ecf2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.146668 Sep 21 16:46:34.232280 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 662/1239] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:34 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:34.842445 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-a45cd28e-f046-4e23-a462-a68442e985ee tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:34.843005 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-a45cd28e-f046-4e23-a462-a68442e985ee tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:34.849791 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a45cd28e-f046-4e23-a462-a68442e985ee tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:34.850303 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a45cd28e-f046-4e23-a462-a68442e985ee tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:34.850733 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a45cd28e-f046-4e23-a462-a68442e985ee tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:34.851413 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a45cd28e-f046-4e23-a462-a68442e985ee tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:34.851860 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a45cd28e-f046-4e23-a462-a68442e985ee tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:34.852289 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a45cd28e-f046-4e23-a462-a68442e985ee tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:34.867477 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=100 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:46:34.913543 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-a45cd28e-f046-4e23-a462-a68442e985ee tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:34.921225 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-a45cd28e-f046-4e23-a462-a68442e985ee tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082786 Sep 21 16:46:34.921783 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 578/1240] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:34 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:35.254162 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-917610ff-f5dd-4111-ac5c-5806bd4a992a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:35.254765 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-917610ff-f5dd-4111-ac5c-5806bd4a992a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:35.261078 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-917610ff-f5dd-4111-ac5c-5806bd4a992a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:35.261549 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-917610ff-f5dd-4111-ac5c-5806bd4a992a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:35.261976 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-917610ff-f5dd-4111-ac5c-5806bd4a992a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:35.262675 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-917610ff-f5dd-4111-ac5c-5806bd4a992a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:35.263120 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-917610ff-f5dd-4111-ac5c-5806bd4a992a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:35.263532 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-917610ff-f5dd-4111-ac5c-5806bd4a992a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:35.392505 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-917610ff-f5dd-4111-ac5c-5806bd4a992a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:35.401222 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-917610ff-f5dd-4111-ac5c-5806bd4a992a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.150950 Sep 21 16:46:35.401801 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 663/1241] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:35 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:35.944484 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-32ccf9b2-529c-40f3-b8ff-21ce457333c4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:35.945101 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-32ccf9b2-529c-40f3-b8ff-21ce457333c4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:35.951696 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-32ccf9b2-529c-40f3-b8ff-21ce457333c4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:35.952180 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-32ccf9b2-529c-40f3-b8ff-21ce457333c4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:35.952651 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-32ccf9b2-529c-40f3-b8ff-21ce457333c4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:35.953371 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-32ccf9b2-529c-40f3-b8ff-21ce457333c4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:35.954091 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-32ccf9b2-529c-40f3-b8ff-21ce457333c4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:35.954538 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-32ccf9b2-529c-40f3-b8ff-21ce457333c4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:36.014094 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-32ccf9b2-529c-40f3-b8ff-21ce457333c4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:36.022299 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-32ccf9b2-529c-40f3-b8ff-21ce457333c4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081681 Sep 21 16:46:36.022852 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 579/1242] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:35 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:36.428231 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-428892b0-96aa-4cf5-a9bc-aa3e76325181 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:36.428919 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-428892b0-96aa-4cf5-a9bc-aa3e76325181 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:36.435522 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-428892b0-96aa-4cf5-a9bc-aa3e76325181 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:36.436010 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-428892b0-96aa-4cf5-a9bc-aa3e76325181 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:36.436443 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-428892b0-96aa-4cf5-a9bc-aa3e76325181 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:36.437139 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-428892b0-96aa-4cf5-a9bc-aa3e76325181 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:36.437595 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-428892b0-96aa-4cf5-a9bc-aa3e76325181 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:36.438016 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-428892b0-96aa-4cf5-a9bc-aa3e76325181 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:36.564882 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-428892b0-96aa-4cf5-a9bc-aa3e76325181 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:36.573709 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-428892b0-96aa-4cf5-a9bc-aa3e76325181 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.149438 Sep 21 16:46:36.579379 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 664/1243] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:36 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:46:37.045533 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-e9949f0f-4388-4cf1-961d-2469b5b463f2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:37.046184 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-e9949f0f-4388-4cf1-961d-2469b5b463f2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:37.052578 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e9949f0f-4388-4cf1-961d-2469b5b463f2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:37.053061 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e9949f0f-4388-4cf1-961d-2469b5b463f2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:37.053498 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e9949f0f-4388-4cf1-961d-2469b5b463f2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:37.054225 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e9949f0f-4388-4cf1-961d-2469b5b463f2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:37.054679 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e9949f0f-4388-4cf1-961d-2469b5b463f2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:37.055101 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e9949f0f-4388-4cf1-961d-2469b5b463f2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:37.117663 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-e9949f0f-4388-4cf1-961d-2469b5b463f2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:37.125351 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-e9949f0f-4388-4cf1-961d-2469b5b463f2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083655 Sep 21 16:46:37.125916 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 580/1244] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:37 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:37.602224 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-08bd4377-d42d-4b80-ad75-d4f54c217559 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:37.602866 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-08bd4377-d42d-4b80-ad75-d4f54c217559 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:37.609290 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-08bd4377-d42d-4b80-ad75-d4f54c217559 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:37.609774 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-08bd4377-d42d-4b80-ad75-d4f54c217559 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:37.610241 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-08bd4377-d42d-4b80-ad75-d4f54c217559 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:37.610932 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-08bd4377-d42d-4b80-ad75-d4f54c217559 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:37.611386 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-08bd4377-d42d-4b80-ad75-d4f54c217559 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:37.611809 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-08bd4377-d42d-4b80-ad75-d4f54c217559 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:37.741600 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-08bd4377-d42d-4b80-ad75-d4f54c217559 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:37.749765 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-08bd4377-d42d-4b80-ad75-d4f54c217559 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.152068 Sep 21 16:46:37.750367 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 665/1245] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:37 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:38.149487 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-a96b6a53-5a61-4aa0-9203-f8c078777e6c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:38.150263 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-a96b6a53-5a61-4aa0-9203-f8c078777e6c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:38.156719 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a96b6a53-5a61-4aa0-9203-f8c078777e6c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:38.157219 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a96b6a53-5a61-4aa0-9203-f8c078777e6c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:38.157700 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a96b6a53-5a61-4aa0-9203-f8c078777e6c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:38.158597 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a96b6a53-5a61-4aa0-9203-f8c078777e6c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:38.159029 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a96b6a53-5a61-4aa0-9203-f8c078777e6c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:38.159452 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a96b6a53-5a61-4aa0-9203-f8c078777e6c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:38.219391 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-a96b6a53-5a61-4aa0-9203-f8c078777e6c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:38.227579 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-a96b6a53-5a61-4aa0-9203-f8c078777e6c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082257 Sep 21 16:46:38.228138 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 581/1246] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:38 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:38.774623 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-f1625080-a5fb-4c49-8145-4597f139d6e6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:38.775169 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-f1625080-a5fb-4c49-8145-4597f139d6e6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:38.781235 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f1625080-a5fb-4c49-8145-4597f139d6e6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:38.781719 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f1625080-a5fb-4c49-8145-4597f139d6e6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:38.782174 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f1625080-a5fb-4c49-8145-4597f139d6e6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:38.782856 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f1625080-a5fb-4c49-8145-4597f139d6e6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:38.783302 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f1625080-a5fb-4c49-8145-4597f139d6e6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:38.783719 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f1625080-a5fb-4c49-8145-4597f139d6e6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:38.907430 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-f1625080-a5fb-4c49-8145-4597f139d6e6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:38.916311 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-f1625080-a5fb-4c49-8145-4597f139d6e6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.145663 Sep 21 16:46:38.916883 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 666/1247] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:38 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:39.249938 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-18146c34-565c-4044-92f9-555cb4d642c0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:39.250579 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-18146c34-565c-4044-92f9-555cb4d642c0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:39.257434 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-18146c34-565c-4044-92f9-555cb4d642c0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:39.257908 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-18146c34-565c-4044-92f9-555cb4d642c0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:39.258367 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-18146c34-565c-4044-92f9-555cb4d642c0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:39.259049 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-18146c34-565c-4044-92f9-555cb4d642c0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:39.259497 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-18146c34-565c-4044-92f9-555cb4d642c0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:39.259911 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-18146c34-565c-4044-92f9-555cb4d642c0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:39.319648 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-18146c34-565c-4044-92f9-555cb4d642c0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:39.327142 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-18146c34-565c-4044-92f9-555cb4d642c0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081020 Sep 21 16:46:39.327708 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 582/1248] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:39 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:39.939277 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-d6c45ffe-6db5-4d65-8353-ff7174ddd4f3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:39.939873 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-d6c45ffe-6db5-4d65-8353-ff7174ddd4f3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:39.942267 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_api:SELECT=52 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:46:39.947594 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d6c45ffe-6db5-4d65-8353-ff7174ddd4f3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:39.948077 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d6c45ffe-6db5-4d65-8353-ff7174ddd4f3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:39.948513 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d6c45ffe-6db5-4d65-8353-ff7174ddd4f3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:39.949208 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d6c45ffe-6db5-4d65-8353-ff7174ddd4f3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:39.949662 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d6c45ffe-6db5-4d65-8353-ff7174ddd4f3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:39.950109 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d6c45ffe-6db5-4d65-8353-ff7174ddd4f3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:40.076463 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d6c45ffe-6db5-4d65-8353-ff7174ddd4f3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:40.084889 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-d6c45ffe-6db5-4d65-8353-ff7174ddd4f3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.149515 Sep 21 16:46:40.085465 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 667/1249] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:39 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:40.350757 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-87bf4e7c-3d27-409b-a1c1-c2517a1ca192 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:40.351294 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-87bf4e7c-3d27-409b-a1c1-c2517a1ca192 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:40.357625 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-87bf4e7c-3d27-409b-a1c1-c2517a1ca192 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:40.358135 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-87bf4e7c-3d27-409b-a1c1-c2517a1ca192 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:40.358573 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-87bf4e7c-3d27-409b-a1c1-c2517a1ca192 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:40.359261 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-87bf4e7c-3d27-409b-a1c1-c2517a1ca192 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:40.359714 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-87bf4e7c-3d27-409b-a1c1-c2517a1ca192 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:40.360135 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-87bf4e7c-3d27-409b-a1c1-c2517a1ca192 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:40.419605 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-87bf4e7c-3d27-409b-a1c1-c2517a1ca192 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:40.427089 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-87bf4e7c-3d27-409b-a1c1-c2517a1ca192 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.080892 Sep 21 16:46:40.427662 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 583/1250] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:40 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:41.108643 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-936a8131-ad64-4eaa-8701-ff13e62995be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:41.109197 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-936a8131-ad64-4eaa-8701-ff13e62995be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:41.116131 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-936a8131-ad64-4eaa-8701-ff13e62995be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:41.116612 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-936a8131-ad64-4eaa-8701-ff13e62995be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:41.117046 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-936a8131-ad64-4eaa-8701-ff13e62995be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:41.117734 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-936a8131-ad64-4eaa-8701-ff13e62995be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:41.118221 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-936a8131-ad64-4eaa-8701-ff13e62995be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:41.118646 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-936a8131-ad64-4eaa-8701-ff13e62995be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:41.248099 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-936a8131-ad64-4eaa-8701-ff13e62995be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:41.256888 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-936a8131-ad64-4eaa-8701-ff13e62995be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.152205 Sep 21 16:46:41.257445 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 668/1251] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:41 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:41.448902 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-7f61201d-2239-4959-93c1-b9e8458c655d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:41.449517 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-7f61201d-2239-4959-93c1-b9e8458c655d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:41.451869 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_api:SELECT=56 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:46:41.457545 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7f61201d-2239-4959-93c1-b9e8458c655d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:41.458032 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7f61201d-2239-4959-93c1-b9e8458c655d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:41.458494 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7f61201d-2239-4959-93c1-b9e8458c655d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:41.459192 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7f61201d-2239-4959-93c1-b9e8458c655d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:41.459648 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7f61201d-2239-4959-93c1-b9e8458c655d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:41.460075 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7f61201d-2239-4959-93c1-b9e8458c655d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:41.526842 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-7f61201d-2239-4959-93c1-b9e8458c655d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:41.534484 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-7f61201d-2239-4959-93c1-b9e8458c655d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.089663 Sep 21 16:46:41.535542 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 584/1252] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:41 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:42.279408 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-3f0cf30b-332d-4926-9ee8-4c5e0546caea tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:42.280015 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-3f0cf30b-332d-4926-9ee8-4c5e0546caea tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:42.286462 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3f0cf30b-332d-4926-9ee8-4c5e0546caea tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:42.286938 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3f0cf30b-332d-4926-9ee8-4c5e0546caea tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:42.287368 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3f0cf30b-332d-4926-9ee8-4c5e0546caea tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:42.288045 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3f0cf30b-332d-4926-9ee8-4c5e0546caea tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:42.288496 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3f0cf30b-332d-4926-9ee8-4c5e0546caea tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:42.288917 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3f0cf30b-332d-4926-9ee8-4c5e0546caea tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:42.412834 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-3f0cf30b-332d-4926-9ee8-4c5e0546caea tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:42.416177 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=100 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:46:42.421739 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-3f0cf30b-332d-4926-9ee8-4c5e0546caea tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.146529 Sep 21 16:46:42.422337 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 669/1253] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:42 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:46:42.558129 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-b69f3675-3288-42f8-9f35-1af4aa09f385 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:42.558669 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-b69f3675-3288-42f8-9f35-1af4aa09f385 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:42.565033 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b69f3675-3288-42f8-9f35-1af4aa09f385 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:42.565509 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b69f3675-3288-42f8-9f35-1af4aa09f385 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:42.566584 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b69f3675-3288-42f8-9f35-1af4aa09f385 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:42.567274 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b69f3675-3288-42f8-9f35-1af4aa09f385 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:42.567724 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b69f3675-3288-42f8-9f35-1af4aa09f385 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:42.568144 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b69f3675-3288-42f8-9f35-1af4aa09f385 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:42.628113 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-b69f3675-3288-42f8-9f35-1af4aa09f385 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:42.636265 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-b69f3675-3288-42f8-9f35-1af4aa09f385 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082073 Sep 21 16:46:42.636826 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 585/1254] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:42 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:43.445198 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ea8a78e9-f794-4663-bc58-1ff7bbf27e44 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:43.445806 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ea8a78e9-f794-4663-bc58-1ff7bbf27e44 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:43.452317 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ea8a78e9-f794-4663-bc58-1ff7bbf27e44 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:43.452794 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ea8a78e9-f794-4663-bc58-1ff7bbf27e44 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:43.453223 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ea8a78e9-f794-4663-bc58-1ff7bbf27e44 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:43.454253 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ea8a78e9-f794-4663-bc58-1ff7bbf27e44 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:43.454704 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ea8a78e9-f794-4663-bc58-1ff7bbf27e44 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:43.455123 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ea8a78e9-f794-4663-bc58-1ff7bbf27e44 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:43.582905 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ea8a78e9-f794-4663-bc58-1ff7bbf27e44 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:43.590920 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ea8a78e9-f794-4663-bc58-1ff7bbf27e44 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.150145 Sep 21 16:46:43.591485 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 670/1255] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:43 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:43.658141 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d38b1222-57ef-47cc-a62b-dfcdb8200e1f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:43.658780 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d38b1222-57ef-47cc-a62b-dfcdb8200e1f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:43.665599 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d38b1222-57ef-47cc-a62b-dfcdb8200e1f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:43.666099 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d38b1222-57ef-47cc-a62b-dfcdb8200e1f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:43.666796 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d38b1222-57ef-47cc-a62b-dfcdb8200e1f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:43.667478 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d38b1222-57ef-47cc-a62b-dfcdb8200e1f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:43.668005 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d38b1222-57ef-47cc-a62b-dfcdb8200e1f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:43.668421 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d38b1222-57ef-47cc-a62b-dfcdb8200e1f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:43.728291 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d38b1222-57ef-47cc-a62b-dfcdb8200e1f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:43.735892 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d38b1222-57ef-47cc-a62b-dfcdb8200e1f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081592 Sep 21 16:46:43.736454 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 586/1256] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:43 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:44.614659 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-4f50a42e-35fd-4aa4-9743-115132fda60d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:44.615272 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-4f50a42e-35fd-4aa4-9743-115132fda60d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:44.621765 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4f50a42e-35fd-4aa4-9743-115132fda60d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:44.622278 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4f50a42e-35fd-4aa4-9743-115132fda60d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:44.622716 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4f50a42e-35fd-4aa4-9743-115132fda60d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:44.623490 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4f50a42e-35fd-4aa4-9743-115132fda60d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:44.624309 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4f50a42e-35fd-4aa4-9743-115132fda60d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:44.625083 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4f50a42e-35fd-4aa4-9743-115132fda60d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:44.750965 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-4f50a42e-35fd-4aa4-9743-115132fda60d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:44.758065 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-7e2d2be2-ab38-4797-b3eb-7981e7faa0b0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:44.758685 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-7e2d2be2-ab38-4797-b3eb-7981e7faa0b0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:44.759272 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-4f50a42e-35fd-4aa4-9743-115132fda60d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.149104 Sep 21 16:46:44.759846 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 671/1257] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:44 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:44.765027 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7e2d2be2-ab38-4797-b3eb-7981e7faa0b0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:44.765506 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7e2d2be2-ab38-4797-b3eb-7981e7faa0b0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:44.765943 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7e2d2be2-ab38-4797-b3eb-7981e7faa0b0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:44.766663 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7e2d2be2-ab38-4797-b3eb-7981e7faa0b0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:44.767117 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7e2d2be2-ab38-4797-b3eb-7981e7faa0b0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:44.767542 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7e2d2be2-ab38-4797-b3eb-7981e7faa0b0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:44.829070 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-7e2d2be2-ab38-4797-b3eb-7981e7faa0b0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:44.837334 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-7e2d2be2-ab38-4797-b3eb-7981e7faa0b0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083065 Sep 21 16:46:44.837890 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 587/1258] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:44 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:45.782946 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-140603ef-2fe7-4294-8729-890fbfb76447 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:45.783525 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-140603ef-2fe7-4294-8729-890fbfb76447 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:45.789883 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-140603ef-2fe7-4294-8729-890fbfb76447 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:45.790390 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-140603ef-2fe7-4294-8729-890fbfb76447 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:45.790820 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-140603ef-2fe7-4294-8729-890fbfb76447 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:45.791497 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-140603ef-2fe7-4294-8729-890fbfb76447 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:45.791941 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-140603ef-2fe7-4294-8729-890fbfb76447 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:45.792356 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-140603ef-2fe7-4294-8729-890fbfb76447 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:45.860421 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-2670fee7-bd31-4697-9378-53aa144ba3bc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:45.861030 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-2670fee7-bd31-4697-9378-53aa144ba3bc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:45.868083 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2670fee7-bd31-4697-9378-53aa144ba3bc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:45.868774 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2670fee7-bd31-4697-9378-53aa144ba3bc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:45.869029 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2670fee7-bd31-4697-9378-53aa144ba3bc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:45.869734 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2670fee7-bd31-4697-9378-53aa144ba3bc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:45.870230 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2670fee7-bd31-4697-9378-53aa144ba3bc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:45.870660 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2670fee7-bd31-4697-9378-53aa144ba3bc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:45.922679 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-140603ef-2fe7-4294-8729-890fbfb76447 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:45.934062 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-140603ef-2fe7-4294-8729-890fbfb76447 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.154918 Sep 21 16:46:45.935027 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 672/1259] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:45 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:45.937349 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-2670fee7-bd31-4697-9378-53aa144ba3bc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:45.945949 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-2670fee7-bd31-4697-9378-53aa144ba3bc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.089339 Sep 21 16:46:45.946569 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 588/1260] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:45 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:46:46.963631 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c2eaa759-21e3-4125-86f2-d6b8a2da5a34 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:46.964249 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-c2eaa759-21e3-4125-86f2-d6b8a2da5a34 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:46.968624 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-e60ed208-f645-4e26-a9a6-afd5213a6dcc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:46.969280 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-e60ed208-f645-4e26-a9a6-afd5213a6dcc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:46.970928 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c2eaa759-21e3-4125-86f2-d6b8a2da5a34 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:46.971410 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c2eaa759-21e3-4125-86f2-d6b8a2da5a34 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:46.971887 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c2eaa759-21e3-4125-86f2-d6b8a2da5a34 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:46.972584 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c2eaa759-21e3-4125-86f2-d6b8a2da5a34 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:46.973038 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c2eaa759-21e3-4125-86f2-d6b8a2da5a34 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:46.973456 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c2eaa759-21e3-4125-86f2-d6b8a2da5a34 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:46.975834 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e60ed208-f645-4e26-a9a6-afd5213a6dcc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:46.976313 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e60ed208-f645-4e26-a9a6-afd5213a6dcc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:46.976741 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e60ed208-f645-4e26-a9a6-afd5213a6dcc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:46.977430 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e60ed208-f645-4e26-a9a6-afd5213a6dcc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:46.977880 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e60ed208-f645-4e26-a9a6-afd5213a6dcc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:46.978339 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e60ed208-f645-4e26-a9a6-afd5213a6dcc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:47.040574 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-e60ed208-f645-4e26-a9a6-afd5213a6dcc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:47.048140 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-e60ed208-f645-4e26-a9a6-afd5213a6dcc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083390 Sep 21 16:46:47.062068 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 589/1261] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:46 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:46:47.101181 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-c2eaa759-21e3-4125-86f2-d6b8a2da5a34 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:47.109295 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-c2eaa759-21e3-4125-86f2-d6b8a2da5a34 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.149613 Sep 21 16:46:47.109867 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 673/1262] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:46 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:48.072008 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-fa167fd5-1973-4bc8-9f15-5a928c0e60da tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:48.072623 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-fa167fd5-1973-4bc8-9f15-5a928c0e60da tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:48.079313 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fa167fd5-1973-4bc8-9f15-5a928c0e60da tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:48.079804 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fa167fd5-1973-4bc8-9f15-5a928c0e60da tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:48.080237 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fa167fd5-1973-4bc8-9f15-5a928c0e60da tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:48.080929 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fa167fd5-1973-4bc8-9f15-5a928c0e60da tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:48.081893 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fa167fd5-1973-4bc8-9f15-5a928c0e60da tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:48.082356 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fa167fd5-1973-4bc8-9f15-5a928c0e60da tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:48.132546 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-dda67b29-22e4-45ea-91c1-9787d494d480 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:48.133153 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-dda67b29-22e4-45ea-91c1-9787d494d480 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:48.139482 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dda67b29-22e4-45ea-91c1-9787d494d480 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:48.139943 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dda67b29-22e4-45ea-91c1-9787d494d480 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:48.140366 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dda67b29-22e4-45ea-91c1-9787d494d480 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:48.141048 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dda67b29-22e4-45ea-91c1-9787d494d480 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:48.141496 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dda67b29-22e4-45ea-91c1-9787d494d480 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:48.142265 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dda67b29-22e4-45ea-91c1-9787d494d480 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:48.145087 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-fa167fd5-1973-4bc8-9f15-5a928c0e60da tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:48.155676 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-fa167fd5-1973-4bc8-9f15-5a928c0e60da tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.087515 Sep 21 16:46:48.156262 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 590/1263] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:48 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:48.277837 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-dda67b29-22e4-45ea-91c1-9787d494d480 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:48.286619 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-dda67b29-22e4-45ea-91c1-9787d494d480 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.158009 Sep 21 16:46:48.287189 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 674/1264] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:48 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:49.179296 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-ac53ece4-19b7-48d7-9642-6ec39d529d70 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:49.179905 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-ac53ece4-19b7-48d7-9642-6ec39d529d70 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:49.186352 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ac53ece4-19b7-48d7-9642-6ec39d529d70 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:49.186834 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ac53ece4-19b7-48d7-9642-6ec39d529d70 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:49.187267 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ac53ece4-19b7-48d7-9642-6ec39d529d70 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:49.187958 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ac53ece4-19b7-48d7-9642-6ec39d529d70 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:49.188409 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ac53ece4-19b7-48d7-9642-6ec39d529d70 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:49.188833 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ac53ece4-19b7-48d7-9642-6ec39d529d70 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:49.248274 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-ac53ece4-19b7-48d7-9642-6ec39d529d70 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:49.256320 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-ac53ece4-19b7-48d7-9642-6ec39d529d70 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.080901 Sep 21 16:46:49.256882 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 591/1265] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:49 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:49.310255 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-b46c2a78-9cfc-4797-92a0-49788f55c8c1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:49.310867 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-b46c2a78-9cfc-4797-92a0-49788f55c8c1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:49.317878 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b46c2a78-9cfc-4797-92a0-49788f55c8c1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:49.318392 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b46c2a78-9cfc-4797-92a0-49788f55c8c1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:49.318827 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b46c2a78-9cfc-4797-92a0-49788f55c8c1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:49.319520 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b46c2a78-9cfc-4797-92a0-49788f55c8c1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:49.319972 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b46c2a78-9cfc-4797-92a0-49788f55c8c1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:49.320392 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b46c2a78-9cfc-4797-92a0-49788f55c8c1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:49.448923 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-b46c2a78-9cfc-4797-92a0-49788f55c8c1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:49.457549 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-b46c2a78-9cfc-4797-92a0-49788f55c8c1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.151133 Sep 21 16:46:49.458142 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 675/1266] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:49 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:50.279329 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-57bd96ed-c797-4816-88ae-a6bef530ee76 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:50.279920 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-57bd96ed-c797-4816-88ae-a6bef530ee76 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:50.286301 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-57bd96ed-c797-4816-88ae-a6bef530ee76 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:50.286779 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-57bd96ed-c797-4816-88ae-a6bef530ee76 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:50.287216 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-57bd96ed-c797-4816-88ae-a6bef530ee76 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:50.287897 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-57bd96ed-c797-4816-88ae-a6bef530ee76 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:50.288343 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-57bd96ed-c797-4816-88ae-a6bef530ee76 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:50.288757 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-57bd96ed-c797-4816-88ae-a6bef530ee76 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:50.351980 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-57bd96ed-c797-4816-88ae-a6bef530ee76 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:50.359609 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-57bd96ed-c797-4816-88ae-a6bef530ee76 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.084118 Sep 21 16:46:50.360172 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 592/1267] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:50 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:50.480285 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c6cb20de-6261-443b-865a-b2780deab79e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:50.480906 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-c6cb20de-6261-443b-865a-b2780deab79e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:50.487323 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c6cb20de-6261-443b-865a-b2780deab79e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:50.488435 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c6cb20de-6261-443b-865a-b2780deab79e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:50.488872 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c6cb20de-6261-443b-865a-b2780deab79e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:50.489568 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c6cb20de-6261-443b-865a-b2780deab79e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:50.490022 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c6cb20de-6261-443b-865a-b2780deab79e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:50.490473 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c6cb20de-6261-443b-865a-b2780deab79e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:50.615077 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-c6cb20de-6261-443b-865a-b2780deab79e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:50.623312 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-c6cb20de-6261-443b-865a-b2780deab79e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.146875 Sep 21 16:46:50.623887 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 676/1268] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:50 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:51.384596 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-77a43a6c-3282-4af7-85aa-c0d800bde03c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:51.385210 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-77a43a6c-3282-4af7-85aa-c0d800bde03c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:51.391961 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-77a43a6c-3282-4af7-85aa-c0d800bde03c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:51.392448 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-77a43a6c-3282-4af7-85aa-c0d800bde03c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:51.392907 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-77a43a6c-3282-4af7-85aa-c0d800bde03c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:51.394291 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-77a43a6c-3282-4af7-85aa-c0d800bde03c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:51.394742 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-77a43a6c-3282-4af7-85aa-c0d800bde03c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:51.395156 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-77a43a6c-3282-4af7-85aa-c0d800bde03c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:51.455006 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-77a43a6c-3282-4af7-85aa-c0d800bde03c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:51.463232 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-77a43a6c-3282-4af7-85aa-c0d800bde03c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083775 Sep 21 16:46:51.463790 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 593/1269] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:51 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:51.646354 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-5bdcb61c-bf22-4a3d-b3fe-ac80151a430d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:51.646926 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-5bdcb61c-bf22-4a3d-b3fe-ac80151a430d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:51.653319 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5bdcb61c-bf22-4a3d-b3fe-ac80151a430d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:51.653799 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5bdcb61c-bf22-4a3d-b3fe-ac80151a430d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:51.654264 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5bdcb61c-bf22-4a3d-b3fe-ac80151a430d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:51.654951 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5bdcb61c-bf22-4a3d-b3fe-ac80151a430d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:51.655407 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5bdcb61c-bf22-4a3d-b3fe-ac80151a430d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:51.655829 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5bdcb61c-bf22-4a3d-b3fe-ac80151a430d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:51.788175 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5bdcb61c-bf22-4a3d-b3fe-ac80151a430d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:51.796299 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-5bdcb61c-bf22-4a3d-b3fe-ac80151a430d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.153974 Sep 21 16:46:51.796870 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 677/1270] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:51 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:52.485461 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-01a1bd0f-cd18-498d-b416-df5946799f0c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:52.486000 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-01a1bd0f-cd18-498d-b416-df5946799f0c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:52.492357 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-01a1bd0f-cd18-498d-b416-df5946799f0c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:52.492833 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-01a1bd0f-cd18-498d-b416-df5946799f0c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:52.493261 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-01a1bd0f-cd18-498d-b416-df5946799f0c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:52.493947 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-01a1bd0f-cd18-498d-b416-df5946799f0c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:52.494422 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-01a1bd0f-cd18-498d-b416-df5946799f0c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:52.494840 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-01a1bd0f-cd18-498d-b416-df5946799f0c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:52.554797 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-01a1bd0f-cd18-498d-b416-df5946799f0c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:52.562400 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-01a1bd0f-cd18-498d-b416-df5946799f0c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.080889 Sep 21 16:46:52.562962 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 594/1271] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:52 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:52.820622 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-974a81f2-b9d9-4fff-897e-1e32e70167be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:52.821246 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-974a81f2-b9d9-4fff-897e-1e32e70167be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:52.827601 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-974a81f2-b9d9-4fff-897e-1e32e70167be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:52.828087 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-974a81f2-b9d9-4fff-897e-1e32e70167be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:52.828518 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-974a81f2-b9d9-4fff-897e-1e32e70167be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:52.829477 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-974a81f2-b9d9-4fff-897e-1e32e70167be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:52.829929 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-974a81f2-b9d9-4fff-897e-1e32e70167be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:52.830379 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-974a81f2-b9d9-4fff-897e-1e32e70167be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:52.958413 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-974a81f2-b9d9-4fff-897e-1e32e70167be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:52.966636 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-974a81f2-b9d9-4fff-897e-1e32e70167be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.149977 Sep 21 16:46:52.967210 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 678/1272] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:52 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:53.584945 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-6bf627c5-d53c-4908-99a0-a43bdbabf731 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:53.585672 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-6bf627c5-d53c-4908-99a0-a43bdbabf731 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:53.592188 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6bf627c5-d53c-4908-99a0-a43bdbabf731 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:53.592654 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6bf627c5-d53c-4908-99a0-a43bdbabf731 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:53.593092 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6bf627c5-d53c-4908-99a0-a43bdbabf731 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:53.593787 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6bf627c5-d53c-4908-99a0-a43bdbabf731 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:53.594268 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6bf627c5-d53c-4908-99a0-a43bdbabf731 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:53.594693 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6bf627c5-d53c-4908-99a0-a43bdbabf731 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:53.597833 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=100 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:46:53.661170 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-6bf627c5-d53c-4908-99a0-a43bdbabf731 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:53.669741 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-6bf627c5-d53c-4908-99a0-a43bdbabf731 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.088564 Sep 21 16:46:53.670382 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 595/1273] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:53 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:53.989748 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-0d4ac61d-da15-4080-b174-300a98d37c70 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:53.990318 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-0d4ac61d-da15-4080-b174-300a98d37c70 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:53.996858 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0d4ac61d-da15-4080-b174-300a98d37c70 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:53.997334 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0d4ac61d-da15-4080-b174-300a98d37c70 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:53.997765 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0d4ac61d-da15-4080-b174-300a98d37c70 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:53.998473 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0d4ac61d-da15-4080-b174-300a98d37c70 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:53.998919 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0d4ac61d-da15-4080-b174-300a98d37c70 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:53.999333 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0d4ac61d-da15-4080-b174-300a98d37c70 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:54.125689 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-0d4ac61d-da15-4080-b174-300a98d37c70 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:54.133856 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-0d4ac61d-da15-4080-b174-300a98d37c70 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.148142 Sep 21 16:46:54.134462 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 679/1274] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:53 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:54.693918 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-3413d784-2510-4d38-9bae-4ec43c68b2e0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:54.694563 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-3413d784-2510-4d38-9bae-4ec43c68b2e0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:54.700871 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3413d784-2510-4d38-9bae-4ec43c68b2e0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:54.701345 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3413d784-2510-4d38-9bae-4ec43c68b2e0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:54.701773 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3413d784-2510-4d38-9bae-4ec43c68b2e0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:54.702488 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3413d784-2510-4d38-9bae-4ec43c68b2e0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:54.702937 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3413d784-2510-4d38-9bae-4ec43c68b2e0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:54.703352 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3413d784-2510-4d38-9bae-4ec43c68b2e0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:54.767231 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-3413d784-2510-4d38-9bae-4ec43c68b2e0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:54.774979 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-3413d784-2510-4d38-9bae-4ec43c68b2e0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.085571 Sep 21 16:46:54.775539 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 596/1275] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:54 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:55.156850 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-09be1712-8805-4bbb-8f02-0a1337c7c13e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:55.157462 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-09be1712-8805-4bbb-8f02-0a1337c7c13e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:55.164388 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-09be1712-8805-4bbb-8f02-0a1337c7c13e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:55.164871 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-09be1712-8805-4bbb-8f02-0a1337c7c13e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:55.165304 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-09be1712-8805-4bbb-8f02-0a1337c7c13e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:55.165988 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-09be1712-8805-4bbb-8f02-0a1337c7c13e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:55.166543 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-09be1712-8805-4bbb-8f02-0a1337c7c13e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:55.166964 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-09be1712-8805-4bbb-8f02-0a1337c7c13e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:55.296010 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-09be1712-8805-4bbb-8f02-0a1337c7c13e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:55.304660 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-09be1712-8805-4bbb-8f02-0a1337c7c13e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.151739 Sep 21 16:46:55.305226 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 680/1276] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:55 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:55.796854 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-822b8990-569d-4477-9b88-ee3e35263542 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:55.797396 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-822b8990-569d-4477-9b88-ee3e35263542 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:55.804534 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-822b8990-569d-4477-9b88-ee3e35263542 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:55.805028 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-822b8990-569d-4477-9b88-ee3e35263542 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:55.805459 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-822b8990-569d-4477-9b88-ee3e35263542 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:55.806178 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-822b8990-569d-4477-9b88-ee3e35263542 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:55.806639 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-822b8990-569d-4477-9b88-ee3e35263542 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:55.807062 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-822b8990-569d-4477-9b88-ee3e35263542 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:55.869059 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-822b8990-569d-4477-9b88-ee3e35263542 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:55.876765 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-822b8990-569d-4477-9b88-ee3e35263542 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083917 Sep 21 16:46:55.877327 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 597/1277] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:55 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:56.328004 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-6bfc80f4-0759-467f-a7e5-ccde3599ffdb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:56.328642 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-6bfc80f4-0759-467f-a7e5-ccde3599ffdb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:56.335355 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6bfc80f4-0759-467f-a7e5-ccde3599ffdb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:56.335837 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6bfc80f4-0759-467f-a7e5-ccde3599ffdb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:56.336263 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6bfc80f4-0759-467f-a7e5-ccde3599ffdb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:56.336958 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6bfc80f4-0759-467f-a7e5-ccde3599ffdb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:56.337423 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6bfc80f4-0759-467f-a7e5-ccde3599ffdb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:56.337837 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6bfc80f4-0759-467f-a7e5-ccde3599ffdb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:56.469192 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-6bfc80f4-0759-467f-a7e5-ccde3599ffdb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:56.477933 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-6bfc80f4-0759-467f-a7e5-ccde3599ffdb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.153732 Sep 21 16:46:56.478618 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 681/1278] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:56 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:56.900301 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-f5355c07-c1b8-40fe-90b6-74bf1715c1ce tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:56.900836 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-f5355c07-c1b8-40fe-90b6-74bf1715c1ce tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:56.907198 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f5355c07-c1b8-40fe-90b6-74bf1715c1ce tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:56.907677 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f5355c07-c1b8-40fe-90b6-74bf1715c1ce tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:56.908116 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f5355c07-c1b8-40fe-90b6-74bf1715c1ce tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:56.908804 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f5355c07-c1b8-40fe-90b6-74bf1715c1ce tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:56.909865 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f5355c07-c1b8-40fe-90b6-74bf1715c1ce tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:56.910312 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f5355c07-c1b8-40fe-90b6-74bf1715c1ce tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:56.971375 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-f5355c07-c1b8-40fe-90b6-74bf1715c1ce tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:56.979879 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-f5355c07-c1b8-40fe-90b6-74bf1715c1ce tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083856 Sep 21 16:46:56.980443 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 598/1279] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:56 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:57.501388 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-41ff03eb-1819-4e7d-b02a-77139fa3a228 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:57.501997 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-41ff03eb-1819-4e7d-b02a-77139fa3a228 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:57.508602 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-41ff03eb-1819-4e7d-b02a-77139fa3a228 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:57.509081 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-41ff03eb-1819-4e7d-b02a-77139fa3a228 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:57.509517 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-41ff03eb-1819-4e7d-b02a-77139fa3a228 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:57.510231 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-41ff03eb-1819-4e7d-b02a-77139fa3a228 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:57.510682 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-41ff03eb-1819-4e7d-b02a-77139fa3a228 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:57.511102 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-41ff03eb-1819-4e7d-b02a-77139fa3a228 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:57.638702 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-41ff03eb-1819-4e7d-b02a-77139fa3a228 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:57.647352 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-41ff03eb-1819-4e7d-b02a-77139fa3a228 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.149854 Sep 21 16:46:57.647921 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 682/1280] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:57 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:58.002305 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-a803c756-a783-4208-8463-ea978f50eba8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:58.003425 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-a803c756-a783-4208-8463-ea978f50eba8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:58.009770 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a803c756-a783-4208-8463-ea978f50eba8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:58.010286 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a803c756-a783-4208-8463-ea978f50eba8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:58.010724 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a803c756-a783-4208-8463-ea978f50eba8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:58.011416 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a803c756-a783-4208-8463-ea978f50eba8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:58.011870 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a803c756-a783-4208-8463-ea978f50eba8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:58.012292 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a803c756-a783-4208-8463-ea978f50eba8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:58.072008 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-a803c756-a783-4208-8463-ea978f50eba8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:58.079719 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-a803c756-a783-4208-8463-ea978f50eba8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081292 Sep 21 16:46:58.080280 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 599/1281] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:57 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:58.670984 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-5b499787-96bc-41d5-8148-e5f380052b08 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:58.671592 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-5b499787-96bc-41d5-8148-e5f380052b08 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:58.678614 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5b499787-96bc-41d5-8148-e5f380052b08 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:58.679091 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5b499787-96bc-41d5-8148-e5f380052b08 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:58.679519 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5b499787-96bc-41d5-8148-e5f380052b08 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:58.680199 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5b499787-96bc-41d5-8148-e5f380052b08 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:58.680646 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5b499787-96bc-41d5-8148-e5f380052b08 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:58.681062 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5b499787-96bc-41d5-8148-e5f380052b08 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:58.805322 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5b499787-96bc-41d5-8148-e5f380052b08 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:58.813468 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-5b499787-96bc-41d5-8148-e5f380052b08 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.146372 Sep 21 16:46:58.814070 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 683/1282] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:58 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:59.103583 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d11c810e-b804-424e-9e4d-49d1993e0861 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:59.104100 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d11c810e-b804-424e-9e4d-49d1993e0861 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:59.110438 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d11c810e-b804-424e-9e4d-49d1993e0861 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:59.110913 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d11c810e-b804-424e-9e4d-49d1993e0861 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:59.111343 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d11c810e-b804-424e-9e4d-49d1993e0861 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:59.112028 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d11c810e-b804-424e-9e4d-49d1993e0861 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:59.112503 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d11c810e-b804-424e-9e4d-49d1993e0861 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:59.112922 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d11c810e-b804-424e-9e4d-49d1993e0861 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:59.175716 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d11c810e-b804-424e-9e4d-49d1993e0861 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:59.183296 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d11c810e-b804-424e-9e4d-49d1993e0861 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083683 Sep 21 16:46:59.183849 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 600/1283] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:59 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:46:59.836946 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-1c189075-9d86-4571-a912-953d27801c36 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:46:59.837581 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-1c189075-9d86-4571-a912-953d27801c36 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:46:59.844014 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1c189075-9d86-4571-a912-953d27801c36 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:59.844496 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1c189075-9d86-4571-a912-953d27801c36 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:59.844929 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1c189075-9d86-4571-a912-953d27801c36 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:59.845617 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1c189075-9d86-4571-a912-953d27801c36 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:46:59.846095 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1c189075-9d86-4571-a912-953d27801c36 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:46:59.847138 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1c189075-9d86-4571-a912-953d27801c36 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:46:59.977320 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-1c189075-9d86-4571-a912-953d27801c36 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:46:59.985448 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-1c189075-9d86-4571-a912-953d27801c36 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.152433 Sep 21 16:46:59.986025 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 684/1284] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:46:59 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:00.206416 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-4b6f78dd-0e8e-4e0a-b1b3-394e71136dca tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:00.207044 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-4b6f78dd-0e8e-4e0a-b1b3-394e71136dca tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:00.214125 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4b6f78dd-0e8e-4e0a-b1b3-394e71136dca tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:00.214611 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4b6f78dd-0e8e-4e0a-b1b3-394e71136dca tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:00.215047 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4b6f78dd-0e8e-4e0a-b1b3-394e71136dca tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:00.215737 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4b6f78dd-0e8e-4e0a-b1b3-394e71136dca tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:00.216191 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4b6f78dd-0e8e-4e0a-b1b3-394e71136dca tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:00.216621 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4b6f78dd-0e8e-4e0a-b1b3-394e71136dca tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:00.277282 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-4b6f78dd-0e8e-4e0a-b1b3-394e71136dca tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:00.284978 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-4b6f78dd-0e8e-4e0a-b1b3-394e71136dca tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083259 Sep 21 16:47:00.285541 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 601/1285] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:00 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:01.008520 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-d5c94221-dd7f-401a-8c95-444de6292a20 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:01.009136 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-d5c94221-dd7f-401a-8c95-444de6292a20 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:01.015513 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d5c94221-dd7f-401a-8c95-444de6292a20 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:01.015995 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d5c94221-dd7f-401a-8c95-444de6292a20 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:01.016430 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d5c94221-dd7f-401a-8c95-444de6292a20 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:01.017118 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d5c94221-dd7f-401a-8c95-444de6292a20 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:01.017576 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d5c94221-dd7f-401a-8c95-444de6292a20 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:01.017998 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d5c94221-dd7f-401a-8c95-444de6292a20 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:01.142958 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d5c94221-dd7f-401a-8c95-444de6292a20 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:01.151645 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-d5c94221-dd7f-401a-8c95-444de6292a20 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.147045 Sep 21 16:47:01.152222 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 685/1286] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:01 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:01.307840 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-7962ee82-997f-4775-a7aa-4ed2f4bca12f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:01.308410 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-7962ee82-997f-4775-a7aa-4ed2f4bca12f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:01.314874 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7962ee82-997f-4775-a7aa-4ed2f4bca12f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:01.315962 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7962ee82-997f-4775-a7aa-4ed2f4bca12f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:01.316400 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7962ee82-997f-4775-a7aa-4ed2f4bca12f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:01.317094 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7962ee82-997f-4775-a7aa-4ed2f4bca12f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:01.317549 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7962ee82-997f-4775-a7aa-4ed2f4bca12f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:01.317982 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7962ee82-997f-4775-a7aa-4ed2f4bca12f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:01.379404 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-7962ee82-997f-4775-a7aa-4ed2f4bca12f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:01.387128 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-7962ee82-997f-4775-a7aa-4ed2f4bca12f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083283 Sep 21 16:47:01.387694 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 602/1287] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:01 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:02.174553 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-945540d7-904e-4de3-8e95-deb145acd7d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:02.175162 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-945540d7-904e-4de3-8e95-deb145acd7d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:02.181571 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-945540d7-904e-4de3-8e95-deb145acd7d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:02.182064 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-945540d7-904e-4de3-8e95-deb145acd7d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:02.182509 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-945540d7-904e-4de3-8e95-deb145acd7d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:02.183192 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-945540d7-904e-4de3-8e95-deb145acd7d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:02.183651 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-945540d7-904e-4de3-8e95-deb145acd7d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:02.184071 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-945540d7-904e-4de3-8e95-deb145acd7d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:02.201329 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=100 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:47:02.311057 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-945540d7-904e-4de3-8e95-deb145acd7d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:02.319126 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-945540d7-904e-4de3-8e95-deb145acd7d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.148412 Sep 21 16:47:02.319699 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 686/1288] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:02 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:02.410198 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-ddcc9322-b5da-4f7d-ba12-c6b7a6a8f427 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:02.410814 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-ddcc9322-b5da-4f7d-ba12-c6b7a6a8f427 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:02.417757 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ddcc9322-b5da-4f7d-ba12-c6b7a6a8f427 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:02.418585 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ddcc9322-b5da-4f7d-ba12-c6b7a6a8f427 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:02.419285 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ddcc9322-b5da-4f7d-ba12-c6b7a6a8f427 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:02.420428 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ddcc9322-b5da-4f7d-ba12-c6b7a6a8f427 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:02.421227 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ddcc9322-b5da-4f7d-ba12-c6b7a6a8f427 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:02.421967 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ddcc9322-b5da-4f7d-ba12-c6b7a6a8f427 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:02.484816 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-ddcc9322-b5da-4f7d-ba12-c6b7a6a8f427 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:02.492522 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-ddcc9322-b5da-4f7d-ba12-c6b7a6a8f427 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.086827 Sep 21 16:47:02.493082 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 603/1289] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:02 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:03.342556 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-614f22b0-4b4d-4e6b-b6f7-c7740b5fc111 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:03.343167 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-614f22b0-4b4d-4e6b-b6f7-c7740b5fc111 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:03.349525 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-614f22b0-4b4d-4e6b-b6f7-c7740b5fc111 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:03.349998 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-614f22b0-4b4d-4e6b-b6f7-c7740b5fc111 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:03.350454 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-614f22b0-4b4d-4e6b-b6f7-c7740b5fc111 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:03.351137 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-614f22b0-4b4d-4e6b-b6f7-c7740b5fc111 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:03.351587 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-614f22b0-4b4d-4e6b-b6f7-c7740b5fc111 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:03.352003 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-614f22b0-4b4d-4e6b-b6f7-c7740b5fc111 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:03.482157 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-614f22b0-4b4d-4e6b-b6f7-c7740b5fc111 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:03.490409 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-614f22b0-4b4d-4e6b-b6f7-c7740b5fc111 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.151573 Sep 21 16:47:03.491004 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 687/1290] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:03 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:03.515206 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-060f2692-b3b3-4279-88da-67a4d29e16ad tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:03.515810 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-060f2692-b3b3-4279-88da-67a4d29e16ad tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:03.522753 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-060f2692-b3b3-4279-88da-67a4d29e16ad tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:03.523229 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-060f2692-b3b3-4279-88da-67a4d29e16ad tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:03.523656 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-060f2692-b3b3-4279-88da-67a4d29e16ad tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:03.524336 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-060f2692-b3b3-4279-88da-67a4d29e16ad tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:03.524783 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-060f2692-b3b3-4279-88da-67a4d29e16ad tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:03.525197 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-060f2692-b3b3-4279-88da-67a4d29e16ad tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:03.587878 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-060f2692-b3b3-4279-88da-67a4d29e16ad tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:03.595472 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-060f2692-b3b3-4279-88da-67a4d29e16ad tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083991 Sep 21 16:47:03.595969 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 604/1291] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:03 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:04.513581 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-fa9cc16b-1d26-4796-b099-ac566dc0d3f2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:04.514215 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-fa9cc16b-1d26-4796-b099-ac566dc0d3f2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:04.521097 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fa9cc16b-1d26-4796-b099-ac566dc0d3f2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:04.521571 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fa9cc16b-1d26-4796-b099-ac566dc0d3f2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:04.521997 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fa9cc16b-1d26-4796-b099-ac566dc0d3f2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:04.522698 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fa9cc16b-1d26-4796-b099-ac566dc0d3f2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:04.523145 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fa9cc16b-1d26-4796-b099-ac566dc0d3f2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:04.523559 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fa9cc16b-1d26-4796-b099-ac566dc0d3f2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:04.648752 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-fa9cc16b-1d26-4796-b099-ac566dc0d3f2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:04.656982 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-fa9cc16b-1d26-4796-b099-ac566dc0d3f2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.147269 Sep 21 16:47:04.657563 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 688/1292] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:04 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:04.739637 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-42b56a29-caa1-47e4-898c-f6aeda7d0eb9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:04.740248 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-42b56a29-caa1-47e4-898c-f6aeda7d0eb9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:04.746025 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-42b56a29-caa1-47e4-898c-f6aeda7d0eb9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:04.746528 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-42b56a29-caa1-47e4-898c-f6aeda7d0eb9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:04.746952 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-42b56a29-caa1-47e4-898c-f6aeda7d0eb9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:04.747628 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-42b56a29-caa1-47e4-898c-f6aeda7d0eb9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:04.748076 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-42b56a29-caa1-47e4-898c-f6aeda7d0eb9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:04.748491 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-42b56a29-caa1-47e4-898c-f6aeda7d0eb9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:04.808939 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-42b56a29-caa1-47e4-898c-f6aeda7d0eb9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:04.816549 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-42b56a29-caa1-47e4-898c-f6aeda7d0eb9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.202404 Sep 21 16:47:04.817102 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 605/1293] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:04 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:47:05.680300 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-79ef416d-6ea9-4fc3-8081-33dd18eef93b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:05.680831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-79ef416d-6ea9-4fc3-8081-33dd18eef93b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:05.687219 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-79ef416d-6ea9-4fc3-8081-33dd18eef93b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:05.687704 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-79ef416d-6ea9-4fc3-8081-33dd18eef93b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:05.688137 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-79ef416d-6ea9-4fc3-8081-33dd18eef93b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:05.688822 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-79ef416d-6ea9-4fc3-8081-33dd18eef93b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:05.689274 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-79ef416d-6ea9-4fc3-8081-33dd18eef93b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:05.689699 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-79ef416d-6ea9-4fc3-8081-33dd18eef93b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:05.817074 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-79ef416d-6ea9-4fc3-8081-33dd18eef93b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:05.825330 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-79ef416d-6ea9-4fc3-8081-33dd18eef93b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.148989 Sep 21 16:47:05.825900 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 689/1294] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:05 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:05.838516 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-2c92e4bf-bebf-4016-8c28-efc71dc20250 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:05.839155 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-2c92e4bf-bebf-4016-8c28-efc71dc20250 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:05.845517 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2c92e4bf-bebf-4016-8c28-efc71dc20250 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:05.845991 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2c92e4bf-bebf-4016-8c28-efc71dc20250 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:05.846451 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2c92e4bf-bebf-4016-8c28-efc71dc20250 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:05.847184 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2c92e4bf-bebf-4016-8c28-efc71dc20250 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:05.847634 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2c92e4bf-bebf-4016-8c28-efc71dc20250 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:05.848051 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2c92e4bf-bebf-4016-8c28-efc71dc20250 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:05.908772 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-2c92e4bf-bebf-4016-8c28-efc71dc20250 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:05.916247 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-2c92e4bf-bebf-4016-8c28-efc71dc20250 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081477 Sep 21 16:47:05.916801 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 606/1295] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:05 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:06.849100 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-1d2ce718-725e-452b-9be8-638a13f915f3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:06.849721 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-1d2ce718-725e-452b-9be8-638a13f915f3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:06.856185 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1d2ce718-725e-452b-9be8-638a13f915f3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:06.856666 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1d2ce718-725e-452b-9be8-638a13f915f3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:06.857106 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1d2ce718-725e-452b-9be8-638a13f915f3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:06.857796 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1d2ce718-725e-452b-9be8-638a13f915f3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:06.858295 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1d2ce718-725e-452b-9be8-638a13f915f3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:06.858723 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1d2ce718-725e-452b-9be8-638a13f915f3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:06.939124 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-26e33312-7b2a-4b61-b034-a7a0fc4089a4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:06.939765 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-26e33312-7b2a-4b61-b034-a7a0fc4089a4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:06.946278 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-26e33312-7b2a-4b61-b034-a7a0fc4089a4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:06.946758 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-26e33312-7b2a-4b61-b034-a7a0fc4089a4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:06.947191 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-26e33312-7b2a-4b61-b034-a7a0fc4089a4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:06.947882 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-26e33312-7b2a-4b61-b034-a7a0fc4089a4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:06.948365 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-26e33312-7b2a-4b61-b034-a7a0fc4089a4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:06.948779 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-26e33312-7b2a-4b61-b034-a7a0fc4089a4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:06.988455 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-1d2ce718-725e-452b-9be8-638a13f915f3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:07.002221 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-1d2ce718-725e-452b-9be8-638a13f915f3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.157223 Sep 21 16:47:07.002850 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 690/1296] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:06 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:07.012349 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-26e33312-7b2a-4b61-b034-a7a0fc4089a4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:07.020026 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-26e33312-7b2a-4b61-b034-a7a0fc4089a4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.084827 Sep 21 16:47:07.020572 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 607/1297] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:06 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:08.024744 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-852b210c-f222-4261-966c-3f50e1aced4e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:08.025351 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-852b210c-f222-4261-966c-3f50e1aced4e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:08.031850 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-852b210c-f222-4261-966c-3f50e1aced4e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:08.032326 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-852b210c-f222-4261-966c-3f50e1aced4e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:08.032756 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-852b210c-f222-4261-966c-3f50e1aced4e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:08.033441 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-852b210c-f222-4261-966c-3f50e1aced4e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:08.034428 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-852b210c-f222-4261-966c-3f50e1aced4e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:08.034852 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-852b210c-f222-4261-966c-3f50e1aced4e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:08.042873 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-44e1ff1a-f79b-4ec0-96c5-102659000102 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:08.043521 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-44e1ff1a-f79b-4ec0-96c5-102659000102 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:08.050160 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-44e1ff1a-f79b-4ec0-96c5-102659000102 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:08.050655 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-44e1ff1a-f79b-4ec0-96c5-102659000102 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:08.051092 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-44e1ff1a-f79b-4ec0-96c5-102659000102 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:08.051791 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-44e1ff1a-f79b-4ec0-96c5-102659000102 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:08.052248 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-44e1ff1a-f79b-4ec0-96c5-102659000102 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:08.052681 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-44e1ff1a-f79b-4ec0-96c5-102659000102 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:08.118579 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-44e1ff1a-f79b-4ec0-96c5-102659000102 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:08.126922 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-44e1ff1a-f79b-4ec0-96c5-102659000102 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.088004 Sep 21 16:47:08.127521 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 608/1298] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:08 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:47:08.165181 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-852b210c-f222-4261-966c-3f50e1aced4e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:08.173412 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-852b210c-f222-4261-966c-3f50e1aced4e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.152530 Sep 21 16:47:08.173986 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 691/1299] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:08 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:09.150033 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-0f3c0291-7050-4f16-8175-d77d34607c7b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:09.150643 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-0f3c0291-7050-4f16-8175-d77d34607c7b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:09.156974 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0f3c0291-7050-4f16-8175-d77d34607c7b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:09.157454 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0f3c0291-7050-4f16-8175-d77d34607c7b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:09.157891 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0f3c0291-7050-4f16-8175-d77d34607c7b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:09.158604 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0f3c0291-7050-4f16-8175-d77d34607c7b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:09.159627 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0f3c0291-7050-4f16-8175-d77d34607c7b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:09.160049 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0f3c0291-7050-4f16-8175-d77d34607c7b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:09.196592 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-206c5ae6-0646-41dc-8ba8-1d7fd3ad019e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:09.197216 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-206c5ae6-0646-41dc-8ba8-1d7fd3ad019e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:09.203203 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-206c5ae6-0646-41dc-8ba8-1d7fd3ad019e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:09.203687 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-206c5ae6-0646-41dc-8ba8-1d7fd3ad019e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:09.204384 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-206c5ae6-0646-41dc-8ba8-1d7fd3ad019e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:09.205078 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-206c5ae6-0646-41dc-8ba8-1d7fd3ad019e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:09.205545 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-206c5ae6-0646-41dc-8ba8-1d7fd3ad019e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:09.205966 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-206c5ae6-0646-41dc-8ba8-1d7fd3ad019e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:09.221537 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-0f3c0291-7050-4f16-8175-d77d34607c7b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:09.229172 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-0f3c0291-7050-4f16-8175-d77d34607c7b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083006 Sep 21 16:47:09.229746 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 609/1300] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:09 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:09.333261 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-206c5ae6-0646-41dc-8ba8-1d7fd3ad019e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:09.341289 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-206c5ae6-0646-41dc-8ba8-1d7fd3ad019e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.148674 Sep 21 16:47:09.341852 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 692/1301] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:09 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:47:10.251783 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-15643ce7-5d93-412f-b18e-0141cdda88b0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:10.252944 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-15643ce7-5d93-412f-b18e-0141cdda88b0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:10.259361 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-15643ce7-5d93-412f-b18e-0141cdda88b0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:10.259844 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-15643ce7-5d93-412f-b18e-0141cdda88b0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:10.260284 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-15643ce7-5d93-412f-b18e-0141cdda88b0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:10.260976 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-15643ce7-5d93-412f-b18e-0141cdda88b0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:10.261430 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-15643ce7-5d93-412f-b18e-0141cdda88b0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:10.261855 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-15643ce7-5d93-412f-b18e-0141cdda88b0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:10.328733 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-15643ce7-5d93-412f-b18e-0141cdda88b0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:10.336592 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-15643ce7-5d93-412f-b18e-0141cdda88b0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.088688 Sep 21 16:47:10.337161 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 610/1302] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:10 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:10.364708 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-dc07fadf-80a0-4d6c-83e3-f86cfe74a514 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:10.365319 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-dc07fadf-80a0-4d6c-83e3-f86cfe74a514 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:10.367722 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_api:SELECT=52 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:47:10.373230 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dc07fadf-80a0-4d6c-83e3-f86cfe74a514 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:10.373711 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dc07fadf-80a0-4d6c-83e3-f86cfe74a514 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:10.374177 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dc07fadf-80a0-4d6c-83e3-f86cfe74a514 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:10.374865 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dc07fadf-80a0-4d6c-83e3-f86cfe74a514 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:10.375318 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dc07fadf-80a0-4d6c-83e3-f86cfe74a514 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:10.375739 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dc07fadf-80a0-4d6c-83e3-f86cfe74a514 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:10.501018 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-dc07fadf-80a0-4d6c-83e3-f86cfe74a514 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:10.509915 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-dc07fadf-80a0-4d6c-83e3-f86cfe74a514 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.149439 Sep 21 16:47:10.510450 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 693/1303] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:10 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:11.359114 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-ec15a233-aa35-4374-a603-116e3d5e0b85 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:11.359727 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-ec15a233-aa35-4374-a603-116e3d5e0b85 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:11.366864 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ec15a233-aa35-4374-a603-116e3d5e0b85 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:11.367346 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ec15a233-aa35-4374-a603-116e3d5e0b85 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:11.367777 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ec15a233-aa35-4374-a603-116e3d5e0b85 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:11.368464 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ec15a233-aa35-4374-a603-116e3d5e0b85 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:11.368917 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ec15a233-aa35-4374-a603-116e3d5e0b85 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:11.369334 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ec15a233-aa35-4374-a603-116e3d5e0b85 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:11.429462 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-ec15a233-aa35-4374-a603-116e3d5e0b85 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:11.431667 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=100 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:47:11.438458 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-ec15a233-aa35-4374-a603-116e3d5e0b85 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083143 Sep 21 16:47:11.439016 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 611/1304] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:11 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:11.532813 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-aaf7421d-30e1-499b-b1c5-631687ef9362 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:11.533453 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-aaf7421d-30e1-499b-b1c5-631687ef9362 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:11.540376 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-aaf7421d-30e1-499b-b1c5-631687ef9362 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:11.540849 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-aaf7421d-30e1-499b-b1c5-631687ef9362 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:11.541277 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-aaf7421d-30e1-499b-b1c5-631687ef9362 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:11.541959 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-aaf7421d-30e1-499b-b1c5-631687ef9362 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:11.542436 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-aaf7421d-30e1-499b-b1c5-631687ef9362 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:11.542857 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-aaf7421d-30e1-499b-b1c5-631687ef9362 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:11.671898 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-aaf7421d-30e1-499b-b1c5-631687ef9362 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:11.681339 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-aaf7421d-30e1-499b-b1c5-631687ef9362 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.152179 Sep 21 16:47:11.682367 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 694/1305] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:11 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:12.460980 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-50bdaaa0-50af-4980-a667-5a73ec4bcc2f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:12.461584 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-50bdaaa0-50af-4980-a667-5a73ec4bcc2f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:12.463989 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_api:SELECT=56 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:47:12.469374 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-50bdaaa0-50af-4980-a667-5a73ec4bcc2f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:12.469861 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-50bdaaa0-50af-4980-a667-5a73ec4bcc2f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:12.470324 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-50bdaaa0-50af-4980-a667-5a73ec4bcc2f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:12.471018 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-50bdaaa0-50af-4980-a667-5a73ec4bcc2f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:12.471474 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-50bdaaa0-50af-4980-a667-5a73ec4bcc2f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:12.472423 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-50bdaaa0-50af-4980-a667-5a73ec4bcc2f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:12.536605 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-50bdaaa0-50af-4980-a667-5a73ec4bcc2f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:12.544338 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-50bdaaa0-50af-4980-a667-5a73ec4bcc2f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.087260 Sep 21 16:47:12.544915 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 612/1306] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:12 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:12.704529 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-a01e6f80-6cf5-4ad3-a60b-4a29c6b7de8c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:12.705136 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-a01e6f80-6cf5-4ad3-a60b-4a29c6b7de8c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:12.711513 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a01e6f80-6cf5-4ad3-a60b-4a29c6b7de8c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:12.711929 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a01e6f80-6cf5-4ad3-a60b-4a29c6b7de8c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:12.712357 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a01e6f80-6cf5-4ad3-a60b-4a29c6b7de8c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:12.713038 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a01e6f80-6cf5-4ad3-a60b-4a29c6b7de8c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:12.713484 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a01e6f80-6cf5-4ad3-a60b-4a29c6b7de8c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:12.713902 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a01e6f80-6cf5-4ad3-a60b-4a29c6b7de8c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:12.842339 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a01e6f80-6cf5-4ad3-a60b-4a29c6b7de8c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:12.850437 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-a01e6f80-6cf5-4ad3-a60b-4a29c6b7de8c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.150005 Sep 21 16:47:12.851008 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 695/1307] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:12 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:13.567391 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-b7c0cb14-f262-4b13-bba7-4dbbfafb77e5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:13.568040 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-b7c0cb14-f262-4b13-bba7-4dbbfafb77e5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:13.574625 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b7c0cb14-f262-4b13-bba7-4dbbfafb77e5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:13.575145 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b7c0cb14-f262-4b13-bba7-4dbbfafb77e5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:13.575583 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b7c0cb14-f262-4b13-bba7-4dbbfafb77e5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:13.576278 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b7c0cb14-f262-4b13-bba7-4dbbfafb77e5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:13.576728 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b7c0cb14-f262-4b13-bba7-4dbbfafb77e5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:13.577178 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b7c0cb14-f262-4b13-bba7-4dbbfafb77e5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:13.636996 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-b7c0cb14-f262-4b13-bba7-4dbbfafb77e5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:13.644450 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-b7c0cb14-f262-4b13-bba7-4dbbfafb77e5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081507 Sep 21 16:47:13.645020 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 613/1308] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:13 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:13.873976 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-4248f291-f09e-4166-bc57-baf7c0621f40 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:13.874657 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-4248f291-f09e-4166-bc57-baf7c0621f40 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:13.880963 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4248f291-f09e-4166-bc57-baf7c0621f40 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:13.881436 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4248f291-f09e-4166-bc57-baf7c0621f40 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:13.881861 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4248f291-f09e-4166-bc57-baf7c0621f40 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:13.882560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4248f291-f09e-4166-bc57-baf7c0621f40 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:13.883007 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4248f291-f09e-4166-bc57-baf7c0621f40 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:13.883424 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4248f291-f09e-4166-bc57-baf7c0621f40 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:14.010502 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-4248f291-f09e-4166-bc57-baf7c0621f40 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:14.019191 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-4248f291-f09e-4166-bc57-baf7c0621f40 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.148636 Sep 21 16:47:14.019765 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 696/1309] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:13 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:14.668033 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-a9ced882-cd18-4768-8979-89634f0c4247 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:14.668644 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-a9ced882-cd18-4768-8979-89634f0c4247 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:14.677456 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a9ced882-cd18-4768-8979-89634f0c4247 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:14.678022 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a9ced882-cd18-4768-8979-89634f0c4247 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:14.678481 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a9ced882-cd18-4768-8979-89634f0c4247 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:14.679168 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a9ced882-cd18-4768-8979-89634f0c4247 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:14.679926 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a9ced882-cd18-4768-8979-89634f0c4247 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:14.680344 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a9ced882-cd18-4768-8979-89634f0c4247 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:14.742817 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-a9ced882-cd18-4768-8979-89634f0c4247 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:14.750549 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-a9ced882-cd18-4768-8979-89634f0c4247 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.087383 Sep 21 16:47:14.751111 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 614/1310] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:14 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:15.042139 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c0a54eab-8a1f-4466-9008-0d1bac6db85e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:15.042694 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-c0a54eab-8a1f-4466-9008-0d1bac6db85e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:15.049033 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c0a54eab-8a1f-4466-9008-0d1bac6db85e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:15.049511 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c0a54eab-8a1f-4466-9008-0d1bac6db85e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:15.049933 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c0a54eab-8a1f-4466-9008-0d1bac6db85e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:15.050652 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c0a54eab-8a1f-4466-9008-0d1bac6db85e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:15.051098 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c0a54eab-8a1f-4466-9008-0d1bac6db85e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:15.051516 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c0a54eab-8a1f-4466-9008-0d1bac6db85e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:15.177904 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-c0a54eab-8a1f-4466-9008-0d1bac6db85e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:15.186084 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-c0a54eab-8a1f-4466-9008-0d1bac6db85e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.147940 Sep 21 16:47:15.186660 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 697/1311] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:15 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:15.774235 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-61a052ab-dc7d-4019-8445-c011b0e34d02 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:15.774774 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-61a052ab-dc7d-4019-8445-c011b0e34d02 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:15.781171 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-61a052ab-dc7d-4019-8445-c011b0e34d02 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:15.781649 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-61a052ab-dc7d-4019-8445-c011b0e34d02 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:15.782106 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-61a052ab-dc7d-4019-8445-c011b0e34d02 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:15.782798 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-61a052ab-dc7d-4019-8445-c011b0e34d02 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:15.783250 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-61a052ab-dc7d-4019-8445-c011b0e34d02 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:15.783671 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-61a052ab-dc7d-4019-8445-c011b0e34d02 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:15.845549 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-61a052ab-dc7d-4019-8445-c011b0e34d02 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:15.853193 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-61a052ab-dc7d-4019-8445-c011b0e34d02 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083065 Sep 21 16:47:15.853755 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 615/1312] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:15 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:16.210299 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-4c8c4377-c26f-4cf8-a40c-35d6290aba5a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:16.210903 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-4c8c4377-c26f-4cf8-a40c-35d6290aba5a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:16.217242 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4c8c4377-c26f-4cf8-a40c-35d6290aba5a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:16.217718 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4c8c4377-c26f-4cf8-a40c-35d6290aba5a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:16.218171 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4c8c4377-c26f-4cf8-a40c-35d6290aba5a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:16.218851 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4c8c4377-c26f-4cf8-a40c-35d6290aba5a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:16.219299 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4c8c4377-c26f-4cf8-a40c-35d6290aba5a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:16.219719 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4c8c4377-c26f-4cf8-a40c-35d6290aba5a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:16.346746 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-4c8c4377-c26f-4cf8-a40c-35d6290aba5a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:16.354778 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-4c8c4377-c26f-4cf8-a40c-35d6290aba5a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.148923 Sep 21 16:47:16.355339 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 698/1313] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:16 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:16.876362 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-fcac2698-e355-4c34-968a-aa12ed51b81a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:16.876900 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-fcac2698-e355-4c34-968a-aa12ed51b81a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:16.883752 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fcac2698-e355-4c34-968a-aa12ed51b81a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:16.884232 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fcac2698-e355-4c34-968a-aa12ed51b81a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:16.884667 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fcac2698-e355-4c34-968a-aa12ed51b81a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:16.885353 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fcac2698-e355-4c34-968a-aa12ed51b81a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:16.885805 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fcac2698-e355-4c34-968a-aa12ed51b81a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:16.886261 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fcac2698-e355-4c34-968a-aa12ed51b81a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:16.951089 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-fcac2698-e355-4c34-968a-aa12ed51b81a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:16.959566 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-fcac2698-e355-4c34-968a-aa12ed51b81a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.087160 Sep 21 16:47:16.960132 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 616/1314] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:16 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:17.378970 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-4f2e4a47-0b33-48ce-a7cc-6c10c42b1f4f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:17.379587 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-4f2e4a47-0b33-48ce-a7cc-6c10c42b1f4f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:17.386149 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4f2e4a47-0b33-48ce-a7cc-6c10c42b1f4f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:17.386634 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4f2e4a47-0b33-48ce-a7cc-6c10c42b1f4f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:17.387077 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4f2e4a47-0b33-48ce-a7cc-6c10c42b1f4f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:17.387771 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4f2e4a47-0b33-48ce-a7cc-6c10c42b1f4f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:17.388249 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4f2e4a47-0b33-48ce-a7cc-6c10c42b1f4f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:17.388670 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4f2e4a47-0b33-48ce-a7cc-6c10c42b1f4f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:17.518376 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-4f2e4a47-0b33-48ce-a7cc-6c10c42b1f4f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:17.526721 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-4f2e4a47-0b33-48ce-a7cc-6c10c42b1f4f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.152265 Sep 21 16:47:17.527297 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 699/1315] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:17 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:17.981265 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-5d5070a0-3a35-4bb2-9474-b97cb9e85092 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:17.981871 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-5d5070a0-3a35-4bb2-9474-b97cb9e85092 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:17.988382 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5d5070a0-3a35-4bb2-9474-b97cb9e85092 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:17.988857 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5d5070a0-3a35-4bb2-9474-b97cb9e85092 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:17.989286 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5d5070a0-3a35-4bb2-9474-b97cb9e85092 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:17.989971 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5d5070a0-3a35-4bb2-9474-b97cb9e85092 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:17.990443 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5d5070a0-3a35-4bb2-9474-b97cb9e85092 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:17.990860 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5d5070a0-3a35-4bb2-9474-b97cb9e85092 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:18.052757 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-5d5070a0-3a35-4bb2-9474-b97cb9e85092 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:18.060414 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-5d5070a0-3a35-4bb2-9474-b97cb9e85092 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083031 Sep 21 16:47:18.060979 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 617/1316] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:17 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:18.550273 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-65fea02e-c806-4f3b-888c-051cc746cd8d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:18.550896 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-65fea02e-c806-4f3b-888c-051cc746cd8d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:18.557366 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-65fea02e-c806-4f3b-888c-051cc746cd8d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:18.557843 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-65fea02e-c806-4f3b-888c-051cc746cd8d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:18.558312 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-65fea02e-c806-4f3b-888c-051cc746cd8d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:18.559001 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-65fea02e-c806-4f3b-888c-051cc746cd8d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:18.559455 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-65fea02e-c806-4f3b-888c-051cc746cd8d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:18.559875 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-65fea02e-c806-4f3b-888c-051cc746cd8d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:18.685749 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-65fea02e-c806-4f3b-888c-051cc746cd8d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:18.693962 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-65fea02e-c806-4f3b-888c-051cc746cd8d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.147552 Sep 21 16:47:18.694563 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 700/1317] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:18 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:19.084320 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-ca8d7c08-2b23-4e52-9679-ffa6b4f002af tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:19.084933 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-ca8d7c08-2b23-4e52-9679-ffa6b4f002af tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:19.091429 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ca8d7c08-2b23-4e52-9679-ffa6b4f002af tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:19.091917 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ca8d7c08-2b23-4e52-9679-ffa6b4f002af tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:19.092354 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ca8d7c08-2b23-4e52-9679-ffa6b4f002af tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:19.093056 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ca8d7c08-2b23-4e52-9679-ffa6b4f002af tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:19.093513 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ca8d7c08-2b23-4e52-9679-ffa6b4f002af tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:19.093936 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ca8d7c08-2b23-4e52-9679-ffa6b4f002af tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:19.154540 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-ca8d7c08-2b23-4e52-9679-ffa6b4f002af tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:19.162266 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-ca8d7c08-2b23-4e52-9679-ffa6b4f002af tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082455 Sep 21 16:47:19.162828 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 618/1318] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:19 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:19.717834 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-f9b50089-d3b3-4cc0-8739-45b271346ca5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:19.718433 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-f9b50089-d3b3-4cc0-8739-45b271346ca5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:19.725327 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f9b50089-d3b3-4cc0-8739-45b271346ca5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:19.725803 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f9b50089-d3b3-4cc0-8739-45b271346ca5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:19.726278 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f9b50089-d3b3-4cc0-8739-45b271346ca5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:19.726969 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f9b50089-d3b3-4cc0-8739-45b271346ca5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:19.727421 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f9b50089-d3b3-4cc0-8739-45b271346ca5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:19.727844 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f9b50089-d3b3-4cc0-8739-45b271346ca5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:19.854878 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-f9b50089-d3b3-4cc0-8739-45b271346ca5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:19.863759 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-f9b50089-d3b3-4cc0-8739-45b271346ca5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.149897 Sep 21 16:47:19.864333 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 701/1319] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:19 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:20.185455 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-b8a3c189-667b-40e1-8cc3-dad46e41b71b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:20.186069 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-b8a3c189-667b-40e1-8cc3-dad46e41b71b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:20.192470 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b8a3c189-667b-40e1-8cc3-dad46e41b71b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:20.192944 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b8a3c189-667b-40e1-8cc3-dad46e41b71b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:20.193370 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b8a3c189-667b-40e1-8cc3-dad46e41b71b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:20.194070 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b8a3c189-667b-40e1-8cc3-dad46e41b71b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:20.194524 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b8a3c189-667b-40e1-8cc3-dad46e41b71b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:20.194939 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b8a3c189-667b-40e1-8cc3-dad46e41b71b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:20.254638 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-b8a3c189-667b-40e1-8cc3-dad46e41b71b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:20.262189 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-b8a3c189-667b-40e1-8cc3-dad46e41b71b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.080619 Sep 21 16:47:20.262744 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 619/1320] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:20 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:20.886524 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-e00339a3-678b-4b78-a0ab-5315f0ecffde tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:20.887167 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-e00339a3-678b-4b78-a0ab-5315f0ecffde tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:20.893696 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e00339a3-678b-4b78-a0ab-5315f0ecffde tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:20.894333 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e00339a3-678b-4b78-a0ab-5315f0ecffde tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:20.894752 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e00339a3-678b-4b78-a0ab-5315f0ecffde tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:20.895444 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e00339a3-678b-4b78-a0ab-5315f0ecffde tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:20.895897 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e00339a3-678b-4b78-a0ab-5315f0ecffde tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:20.896320 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e00339a3-678b-4b78-a0ab-5315f0ecffde tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:21.020337 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-e00339a3-678b-4b78-a0ab-5315f0ecffde tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:21.028503 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-e00339a3-678b-4b78-a0ab-5315f0ecffde tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.145893 Sep 21 16:47:21.029078 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 702/1321] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:20 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:21.285939 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-5e790be9-1f9c-4c2f-8737-9486a5181da0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:21.286585 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-5e790be9-1f9c-4c2f-8737-9486a5181da0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:21.292908 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5e790be9-1f9c-4c2f-8737-9486a5181da0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:21.293386 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5e790be9-1f9c-4c2f-8737-9486a5181da0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:21.293819 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5e790be9-1f9c-4c2f-8737-9486a5181da0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:21.294534 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5e790be9-1f9c-4c2f-8737-9486a5181da0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:21.294987 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5e790be9-1f9c-4c2f-8737-9486a5181da0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:21.295414 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5e790be9-1f9c-4c2f-8737-9486a5181da0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:21.358121 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-5e790be9-1f9c-4c2f-8737-9486a5181da0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:21.366360 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-5e790be9-1f9c-4c2f-8737-9486a5181da0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.084825 Sep 21 16:47:21.366931 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 620/1322] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:21 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:22.052040 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-a241de92-895f-4f13-9a61-b6e4ba60bc0b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:22.052806 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-a241de92-895f-4f13-9a61-b6e4ba60bc0b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:22.059347 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a241de92-895f-4f13-9a61-b6e4ba60bc0b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:22.059830 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a241de92-895f-4f13-9a61-b6e4ba60bc0b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:22.060269 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a241de92-895f-4f13-9a61-b6e4ba60bc0b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:22.060962 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a241de92-895f-4f13-9a61-b6e4ba60bc0b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:22.061414 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a241de92-895f-4f13-9a61-b6e4ba60bc0b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:22.061835 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a241de92-895f-4f13-9a61-b6e4ba60bc0b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:22.066374 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=100 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:47:22.187392 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a241de92-895f-4f13-9a61-b6e4ba60bc0b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:22.195973 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-a241de92-895f-4f13-9a61-b6e4ba60bc0b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.148257 Sep 21 16:47:22.196537 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 703/1323] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:22 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:22.389188 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-bf9b9937-cfe1-4698-a98b-35bb650cb843 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:22.389741 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-bf9b9937-cfe1-4698-a98b-35bb650cb843 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:22.396089 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bf9b9937-cfe1-4698-a98b-35bb650cb843 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:22.396570 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bf9b9937-cfe1-4698-a98b-35bb650cb843 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:22.397009 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bf9b9937-cfe1-4698-a98b-35bb650cb843 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:22.397692 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bf9b9937-cfe1-4698-a98b-35bb650cb843 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:22.398171 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bf9b9937-cfe1-4698-a98b-35bb650cb843 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:22.398592 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bf9b9937-cfe1-4698-a98b-35bb650cb843 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:22.458378 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-bf9b9937-cfe1-4698-a98b-35bb650cb843 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:22.465890 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-bf9b9937-cfe1-4698-a98b-35bb650cb843 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.080622 Sep 21 16:47:22.466485 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 621/1324] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:22 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:23.219224 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-8d15ff13-ee42-4b0c-87ae-44d0731c7f92 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:23.219843 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-8d15ff13-ee42-4b0c-87ae-44d0731c7f92 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:23.226932 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8d15ff13-ee42-4b0c-87ae-44d0731c7f92 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:23.227423 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8d15ff13-ee42-4b0c-87ae-44d0731c7f92 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:23.227860 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8d15ff13-ee42-4b0c-87ae-44d0731c7f92 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:23.228553 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8d15ff13-ee42-4b0c-87ae-44d0731c7f92 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:23.229011 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8d15ff13-ee42-4b0c-87ae-44d0731c7f92 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:23.229438 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8d15ff13-ee42-4b0c-87ae-44d0731c7f92 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:23.356524 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-8d15ff13-ee42-4b0c-87ae-44d0731c7f92 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:23.364683 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-8d15ff13-ee42-4b0c-87ae-44d0731c7f92 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.149300 Sep 21 16:47:23.365255 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 704/1325] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:23 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:23.487896 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-b20b815b-baaf-4671-a3c6-4ca9488d2625 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:23.488513 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-b20b815b-baaf-4671-a3c6-4ca9488d2625 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:23.494906 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b20b815b-baaf-4671-a3c6-4ca9488d2625 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:23.495384 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b20b815b-baaf-4671-a3c6-4ca9488d2625 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:23.495846 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b20b815b-baaf-4671-a3c6-4ca9488d2625 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:23.496538 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b20b815b-baaf-4671-a3c6-4ca9488d2625 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:23.497021 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b20b815b-baaf-4671-a3c6-4ca9488d2625 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:23.497444 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b20b815b-baaf-4671-a3c6-4ca9488d2625 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:23.557446 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-b20b815b-baaf-4671-a3c6-4ca9488d2625 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:23.565541 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-b20b815b-baaf-4671-a3c6-4ca9488d2625 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081247 Sep 21 16:47:23.566138 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 622/1326] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:23 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:24.387295 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-27608306-2a1e-43f4-b771-b12f45ae5e53 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:24.387887 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-27608306-2a1e-43f4-b771-b12f45ae5e53 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:24.394269 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-27608306-2a1e-43f4-b771-b12f45ae5e53 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:24.394742 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-27608306-2a1e-43f4-b771-b12f45ae5e53 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:24.395166 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-27608306-2a1e-43f4-b771-b12f45ae5e53 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:24.395845 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-27608306-2a1e-43f4-b771-b12f45ae5e53 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:24.396291 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-27608306-2a1e-43f4-b771-b12f45ae5e53 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:24.396708 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-27608306-2a1e-43f4-b771-b12f45ae5e53 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:24.521866 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-27608306-2a1e-43f4-b771-b12f45ae5e53 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:24.530202 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-27608306-2a1e-43f4-b771-b12f45ae5e53 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.146670 Sep 21 16:47:24.530781 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 705/1327] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:24 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:24.587717 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-0f6f2aed-446a-4fa0-8114-d870825606bf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:24.588333 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-0f6f2aed-446a-4fa0-8114-d870825606bf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:24.594912 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0f6f2aed-446a-4fa0-8114-d870825606bf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:24.595397 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0f6f2aed-446a-4fa0-8114-d870825606bf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:24.595831 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0f6f2aed-446a-4fa0-8114-d870825606bf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:24.597185 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0f6f2aed-446a-4fa0-8114-d870825606bf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:24.597640 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0f6f2aed-446a-4fa0-8114-d870825606bf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:24.598081 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0f6f2aed-446a-4fa0-8114-d870825606bf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:24.659912 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-0f6f2aed-446a-4fa0-8114-d870825606bf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:24.667451 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-0f6f2aed-446a-4fa0-8114-d870825606bf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083579 Sep 21 16:47:24.668016 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 623/1328] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:24 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:25.553959 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ffb3e2a9-c40a-4624-8800-0dbedd7d6324 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:25.554589 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ffb3e2a9-c40a-4624-8800-0dbedd7d6324 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:25.560911 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ffb3e2a9-c40a-4624-8800-0dbedd7d6324 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:25.561384 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ffb3e2a9-c40a-4624-8800-0dbedd7d6324 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:25.561810 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ffb3e2a9-c40a-4624-8800-0dbedd7d6324 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:25.562534 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ffb3e2a9-c40a-4624-8800-0dbedd7d6324 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:25.562979 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ffb3e2a9-c40a-4624-8800-0dbedd7d6324 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:25.563391 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ffb3e2a9-c40a-4624-8800-0dbedd7d6324 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:25.690103 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-005082f0-53c0-434e-8ba5-755f769b2628 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:25.690723 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-005082f0-53c0-434e-8ba5-755f769b2628 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:25.692062 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ffb3e2a9-c40a-4624-8800-0dbedd7d6324 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:25.697325 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-005082f0-53c0-434e-8ba5-755f769b2628 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:25.697840 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-005082f0-53c0-434e-8ba5-755f769b2628 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:25.698301 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-005082f0-53c0-434e-8ba5-755f769b2628 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:25.698995 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-005082f0-53c0-434e-8ba5-755f769b2628 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:25.699449 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-005082f0-53c0-434e-8ba5-755f769b2628 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:25.699870 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-005082f0-53c0-434e-8ba5-755f769b2628 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:25.700404 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ffb3e2a9-c40a-4624-8800-0dbedd7d6324 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.150769 Sep 21 16:47:25.700982 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 706/1329] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:25 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:25.765831 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-005082f0-53c0-434e-8ba5-755f769b2628 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:25.773636 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-005082f0-53c0-434e-8ba5-755f769b2628 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.087619 Sep 21 16:47:25.774228 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 624/1330] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:25 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:47:26.723621 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-b83f959a-136f-4dd4-a8a2-568e967e8081 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:26.724226 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-b83f959a-136f-4dd4-a8a2-568e967e8081 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:26.730608 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b83f959a-136f-4dd4-a8a2-568e967e8081 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:26.731082 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b83f959a-136f-4dd4-a8a2-568e967e8081 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:26.731514 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b83f959a-136f-4dd4-a8a2-568e967e8081 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:26.732192 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b83f959a-136f-4dd4-a8a2-568e967e8081 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:26.732639 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b83f959a-136f-4dd4-a8a2-568e967e8081 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:26.733055 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b83f959a-136f-4dd4-a8a2-568e967e8081 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:26.796949 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-707cde55-9b77-442b-9b5e-a58d8fd0c28b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:26.797500 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-707cde55-9b77-442b-9b5e-a58d8fd0c28b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:26.804426 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-707cde55-9b77-442b-9b5e-a58d8fd0c28b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:26.804903 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-707cde55-9b77-442b-9b5e-a58d8fd0c28b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:26.805331 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-707cde55-9b77-442b-9b5e-a58d8fd0c28b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:26.806020 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-707cde55-9b77-442b-9b5e-a58d8fd0c28b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:26.806493 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-707cde55-9b77-442b-9b5e-a58d8fd0c28b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:26.806909 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-707cde55-9b77-442b-9b5e-a58d8fd0c28b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:26.861077 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-b83f959a-136f-4dd4-a8a2-568e967e8081 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:26.869950 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-b83f959a-136f-4dd4-a8a2-568e967e8081 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.150189 Sep 21 16:47:26.870463 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-707cde55-9b77-442b-9b5e-a58d8fd0c28b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:26.870624 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 707/1331] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:26 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:26.878886 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-707cde55-9b77-442b-9b5e-a58d8fd0c28b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.085797 Sep 21 16:47:26.879436 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 625/1332] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:26 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:47:27.894774 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-108e04a7-6e06-4b90-8fc8-54e1bde4ed65 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:27.895622 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-108e04a7-6e06-4b90-8fc8-54e1bde4ed65 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:27.900556 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-6dda6ecc-19f5-41ad-b371-960069369c01 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:27.901172 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-6dda6ecc-19f5-41ad-b371-960069369c01 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:27.903449 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 21 16:47:27.903592 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Wed Sep 21 16:47:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 (ip 10.222.0.64) !!! Sep 21 16:47:27.903792 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-108e04a7-6e06-4b90-8fc8-54e1bde4ed65 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:27.904797 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-108e04a7-6e06-4b90-8fc8-54e1bde4ed65 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:27.904934 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 21 16:47:27.904934 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Wed Sep 21 16:47:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 (ip 10.222.0.64) !!! Sep 21 16:47:27.905873 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-108e04a7-6e06-4b90-8fc8-54e1bde4ed65 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:27.906022 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 21 16:47:27.906022 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Wed Sep 21 16:47:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 (ip 10.222.0.64) !!! Sep 21 16:47:27.906902 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-108e04a7-6e06-4b90-8fc8-54e1bde4ed65 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:27.906902 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-108e04a7-6e06-4b90-8fc8-54e1bde4ed65 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:27.907315 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-108e04a7-6e06-4b90-8fc8-54e1bde4ed65 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:27.914619 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6dda6ecc-19f5-41ad-b371-960069369c01 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:27.915103 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6dda6ecc-19f5-41ad-b371-960069369c01 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:27.915535 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6dda6ecc-19f5-41ad-b371-960069369c01 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:27.916222 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6dda6ecc-19f5-41ad-b371-960069369c01 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:27.916675 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6dda6ecc-19f5-41ad-b371-960069369c01 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:27.917087 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6dda6ecc-19f5-41ad-b371-960069369c01 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:27.979881 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-6dda6ecc-19f5-41ad-b371-960069369c01 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:27.988341 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-6dda6ecc-19f5-41ad-b371-960069369c01 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.091724 Sep 21 16:47:27.988908 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 626/1333] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:27 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:28.037804 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-108e04a7-6e06-4b90-8fc8-54e1bde4ed65 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:28.046032 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-108e04a7-6e06-4b90-8fc8-54e1bde4ed65 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.155751 Sep 21 16:47:28.046626 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 708/1334] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:27 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:29.010665 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-8f676660-e913-4c0a-b28d-b6d19f071fb9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:29.011303 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-8f676660-e913-4c0a-b28d-b6d19f071fb9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:29.017650 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8f676660-e913-4c0a-b28d-b6d19f071fb9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:29.018798 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8f676660-e913-4c0a-b28d-b6d19f071fb9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:29.019232 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8f676660-e913-4c0a-b28d-b6d19f071fb9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:29.019918 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8f676660-e913-4c0a-b28d-b6d19f071fb9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:29.020365 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8f676660-e913-4c0a-b28d-b6d19f071fb9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:29.020783 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8f676660-e913-4c0a-b28d-b6d19f071fb9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:29.069351 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-4dd0d581-4a23-4f64-b073-3b8a8b6f5719 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:29.069962 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-4dd0d581-4a23-4f64-b073-3b8a8b6f5719 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:29.071952 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 21 16:47:29.072100 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Wed Sep 21 16:47:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db (ip 10.222.0.64) !!! Sep 21 16:47:29.073196 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 21 16:47:29.073331 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Wed Sep 21 16:47:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db (ip 10.222.0.64) !!! Sep 21 16:47:29.074297 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 21 16:47:29.074445 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Wed Sep 21 16:47:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db (ip 10.222.0.64) !!! Sep 21 16:47:29.082271 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-8f676660-e913-4c0a-b28d-b6d19f071fb9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:29.083050 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4dd0d581-4a23-4f64-b073-3b8a8b6f5719 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:29.083539 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4dd0d581-4a23-4f64-b073-3b8a8b6f5719 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:29.083972 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4dd0d581-4a23-4f64-b073-3b8a8b6f5719 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:29.084673 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4dd0d581-4a23-4f64-b073-3b8a8b6f5719 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:29.085125 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4dd0d581-4a23-4f64-b073-3b8a8b6f5719 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:29.085549 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4dd0d581-4a23-4f64-b073-3b8a8b6f5719 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:29.089965 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-8f676660-e913-4c0a-b28d-b6d19f071fb9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083101 Sep 21 16:47:29.090862 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 627/1335] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:29 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:29.213659 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-4dd0d581-4a23-4f64-b073-3b8a8b6f5719 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:29.221907 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-4dd0d581-4a23-4f64-b073-3b8a8b6f5719 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.157073 Sep 21 16:47:29.222648 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 709/1336] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:29 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:47:30.112207 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-3d9ffb6e-6ca0-46a1-9230-339533d466c1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:30.112804 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-3d9ffb6e-6ca0-46a1-9230-339533d466c1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:30.119255 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3d9ffb6e-6ca0-46a1-9230-339533d466c1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:30.119729 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3d9ffb6e-6ca0-46a1-9230-339533d466c1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:30.120166 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3d9ffb6e-6ca0-46a1-9230-339533d466c1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:30.120839 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3d9ffb6e-6ca0-46a1-9230-339533d466c1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:30.121285 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3d9ffb6e-6ca0-46a1-9230-339533d466c1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:30.121700 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3d9ffb6e-6ca0-46a1-9230-339533d466c1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:30.136034 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=100 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:47:30.184580 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-3d9ffb6e-6ca0-46a1-9230-339533d466c1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:30.192665 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-3d9ffb6e-6ca0-46a1-9230-339533d466c1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.084358 Sep 21 16:47:30.193228 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 628/1337] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:30 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:30.245392 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-b00d4f30-5a1f-4121-b102-70a83d33ef26 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:30.246002 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-b00d4f30-5a1f-4121-b102-70a83d33ef26 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:30.253082 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b00d4f30-5a1f-4121-b102-70a83d33ef26 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:30.253559 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b00d4f30-5a1f-4121-b102-70a83d33ef26 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:30.253994 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b00d4f30-5a1f-4121-b102-70a83d33ef26 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:30.254700 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b00d4f30-5a1f-4121-b102-70a83d33ef26 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:30.255152 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b00d4f30-5a1f-4121-b102-70a83d33ef26 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:30.255573 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b00d4f30-5a1f-4121-b102-70a83d33ef26 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:30.383080 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-b00d4f30-5a1f-4121-b102-70a83d33ef26 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:30.391182 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-b00d4f30-5a1f-4121-b102-70a83d33ef26 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.149703 Sep 21 16:47:30.391751 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 710/1338] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:30 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:31.215813 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-0004033c-7faa-4e0e-a7d2-0b456f4a13be tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:31.216440 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-0004033c-7faa-4e0e-a7d2-0b456f4a13be tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:31.222750 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0004033c-7faa-4e0e-a7d2-0b456f4a13be tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:31.223234 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0004033c-7faa-4e0e-a7d2-0b456f4a13be tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:31.223668 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0004033c-7faa-4e0e-a7d2-0b456f4a13be tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:31.224355 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0004033c-7faa-4e0e-a7d2-0b456f4a13be tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:31.224807 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0004033c-7faa-4e0e-a7d2-0b456f4a13be tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:31.225234 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0004033c-7faa-4e0e-a7d2-0b456f4a13be tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:31.285239 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-0004033c-7faa-4e0e-a7d2-0b456f4a13be tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:31.292953 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-0004033c-7faa-4e0e-a7d2-0b456f4a13be tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081020 Sep 21 16:47:31.293526 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 629/1339] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:31 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:31.415122 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-2fabcd47-b5e0-46ff-97bd-c0804d142912 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:31.415740 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-2fabcd47-b5e0-46ff-97bd-c0804d142912 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:31.422399 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2fabcd47-b5e0-46ff-97bd-c0804d142912 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:31.422881 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2fabcd47-b5e0-46ff-97bd-c0804d142912 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:31.423317 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2fabcd47-b5e0-46ff-97bd-c0804d142912 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:31.424006 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2fabcd47-b5e0-46ff-97bd-c0804d142912 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:31.424978 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2fabcd47-b5e0-46ff-97bd-c0804d142912 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:31.425818 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2fabcd47-b5e0-46ff-97bd-c0804d142912 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:31.555749 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-2fabcd47-b5e0-46ff-97bd-c0804d142912 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:31.563823 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-2fabcd47-b5e0-46ff-97bd-c0804d142912 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.152611 Sep 21 16:47:31.564395 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 711/1340] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:31 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:32.316256 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-290712b0-0e36-4128-b345-c9c411d9816f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:32.316866 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-290712b0-0e36-4128-b345-c9c411d9816f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:32.323239 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-290712b0-0e36-4128-b345-c9c411d9816f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:32.323721 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-290712b0-0e36-4128-b345-c9c411d9816f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:32.324152 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-290712b0-0e36-4128-b345-c9c411d9816f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:32.324840 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-290712b0-0e36-4128-b345-c9c411d9816f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:32.325289 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-290712b0-0e36-4128-b345-c9c411d9816f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:32.325709 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-290712b0-0e36-4128-b345-c9c411d9816f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:32.391038 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-290712b0-0e36-4128-b345-c9c411d9816f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:32.399209 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-290712b0-0e36-4128-b345-c9c411d9816f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.086826 Sep 21 16:47:32.399775 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 630/1341] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:32 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:32.587457 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-f6ef8560-ea91-472f-852e-ac7570f9fe71 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:32.588065 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-f6ef8560-ea91-472f-852e-ac7570f9fe71 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:32.594488 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f6ef8560-ea91-472f-852e-ac7570f9fe71 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:32.594958 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f6ef8560-ea91-472f-852e-ac7570f9fe71 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:32.595385 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f6ef8560-ea91-472f-852e-ac7570f9fe71 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:32.596572 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f6ef8560-ea91-472f-852e-ac7570f9fe71 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:32.597017 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f6ef8560-ea91-472f-852e-ac7570f9fe71 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:32.597438 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f6ef8560-ea91-472f-852e-ac7570f9fe71 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:32.727471 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-f6ef8560-ea91-472f-852e-ac7570f9fe71 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:32.735549 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-f6ef8560-ea91-472f-852e-ac7570f9fe71 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.151988 Sep 21 16:47:32.736112 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 712/1342] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:32 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:33.422453 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-0e935079-af58-42db-a7cd-c2248b133637 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:33.423064 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-0e935079-af58-42db-a7cd-c2248b133637 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:33.430126 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0e935079-af58-42db-a7cd-c2248b133637 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:33.430606 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0e935079-af58-42db-a7cd-c2248b133637 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:33.431036 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0e935079-af58-42db-a7cd-c2248b133637 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:33.431722 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0e935079-af58-42db-a7cd-c2248b133637 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:33.432202 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0e935079-af58-42db-a7cd-c2248b133637 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:33.432620 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0e935079-af58-42db-a7cd-c2248b133637 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:33.492571 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-0e935079-af58-42db-a7cd-c2248b133637 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:33.500269 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-0e935079-af58-42db-a7cd-c2248b133637 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081695 Sep 21 16:47:33.500832 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 631/1343] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:33 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:33.759484 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-4c0b7ec9-67c4-419e-89f3-32e4893c7215 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:33.760036 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-4c0b7ec9-67c4-419e-89f3-32e4893c7215 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:33.766356 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4c0b7ec9-67c4-419e-89f3-32e4893c7215 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:33.766832 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4c0b7ec9-67c4-419e-89f3-32e4893c7215 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:33.767259 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4c0b7ec9-67c4-419e-89f3-32e4893c7215 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:33.767942 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4c0b7ec9-67c4-419e-89f3-32e4893c7215 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:33.768388 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4c0b7ec9-67c4-419e-89f3-32e4893c7215 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:33.768805 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4c0b7ec9-67c4-419e-89f3-32e4893c7215 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:33.897327 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-4c0b7ec9-67c4-419e-89f3-32e4893c7215 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:33.905642 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-4c0b7ec9-67c4-419e-89f3-32e4893c7215 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.150136 Sep 21 16:47:33.906236 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 713/1344] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:33 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:34.522999 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-33d92ce0-483a-46bb-b1dd-775c8d256ce9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:34.523647 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-33d92ce0-483a-46bb-b1dd-775c8d256ce9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:34.530038 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-33d92ce0-483a-46bb-b1dd-775c8d256ce9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:34.530545 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-33d92ce0-483a-46bb-b1dd-775c8d256ce9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:34.530979 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-33d92ce0-483a-46bb-b1dd-775c8d256ce9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:34.531666 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-33d92ce0-483a-46bb-b1dd-775c8d256ce9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:34.532118 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-33d92ce0-483a-46bb-b1dd-775c8d256ce9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:34.532543 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-33d92ce0-483a-46bb-b1dd-775c8d256ce9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:34.595198 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-33d92ce0-483a-46bb-b1dd-775c8d256ce9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:34.602827 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-33d92ce0-483a-46bb-b1dd-775c8d256ce9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083760 Sep 21 16:47:34.603387 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 632/1345] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:34 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:34.928725 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-162b6c99-e808-428b-b521-6c698de8f301 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:34.929339 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-162b6c99-e808-428b-b521-6c698de8f301 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:34.935927 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-162b6c99-e808-428b-b521-6c698de8f301 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:34.936403 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-162b6c99-e808-428b-b521-6c698de8f301 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:34.936836 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-162b6c99-e808-428b-b521-6c698de8f301 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:34.937526 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-162b6c99-e808-428b-b521-6c698de8f301 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:34.937976 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-162b6c99-e808-428b-b521-6c698de8f301 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:34.938426 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-162b6c99-e808-428b-b521-6c698de8f301 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:35.064270 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-162b6c99-e808-428b-b521-6c698de8f301 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:35.072951 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-162b6c99-e808-428b-b521-6c698de8f301 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.148752 Sep 21 16:47:35.073545 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 714/1346] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:34 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:35.625450 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d4e3829a-53ed-41e9-b20b-aebb0a984fde tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:35.626080 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d4e3829a-53ed-41e9-b20b-aebb0a984fde tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:35.632581 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d4e3829a-53ed-41e9-b20b-aebb0a984fde tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:35.633070 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d4e3829a-53ed-41e9-b20b-aebb0a984fde tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:35.633505 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d4e3829a-53ed-41e9-b20b-aebb0a984fde tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:35.634236 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d4e3829a-53ed-41e9-b20b-aebb0a984fde tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:35.634692 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d4e3829a-53ed-41e9-b20b-aebb0a984fde tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:35.635112 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d4e3829a-53ed-41e9-b20b-aebb0a984fde tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:35.694920 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d4e3829a-53ed-41e9-b20b-aebb0a984fde tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:35.702724 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d4e3829a-53ed-41e9-b20b-aebb0a984fde tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081178 Sep 21 16:47:35.703300 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 633/1347] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:35 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:36.096084 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-03d4e6b2-04f5-4e9b-8472-9f6b10eb6682 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:36.097728 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-03d4e6b2-04f5-4e9b-8472-9f6b10eb6682 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:36.104035 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-03d4e6b2-04f5-4e9b-8472-9f6b10eb6682 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:36.104510 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-03d4e6b2-04f5-4e9b-8472-9f6b10eb6682 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:36.104938 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-03d4e6b2-04f5-4e9b-8472-9f6b10eb6682 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:36.105625 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-03d4e6b2-04f5-4e9b-8472-9f6b10eb6682 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:36.106092 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-03d4e6b2-04f5-4e9b-8472-9f6b10eb6682 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:36.106515 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-03d4e6b2-04f5-4e9b-8472-9f6b10eb6682 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:36.230253 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-03d4e6b2-04f5-4e9b-8472-9f6b10eb6682 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:36.238316 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-03d4e6b2-04f5-4e9b-8472-9f6b10eb6682 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.146200 Sep 21 16:47:36.238884 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 715/1348] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:36 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:36.725277 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-5d053815-0eff-4e51-a081-dd492aa584c0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:36.725877 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-5d053815-0eff-4e51-a081-dd492aa584c0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:36.732214 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5d053815-0eff-4e51-a081-dd492aa584c0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:36.732686 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5d053815-0eff-4e51-a081-dd492aa584c0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:36.733114 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5d053815-0eff-4e51-a081-dd492aa584c0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:36.733787 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5d053815-0eff-4e51-a081-dd492aa584c0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:36.734280 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5d053815-0eff-4e51-a081-dd492aa584c0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:36.734692 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5d053815-0eff-4e51-a081-dd492aa584c0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:36.794264 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-5d053815-0eff-4e51-a081-dd492aa584c0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:36.802404 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-5d053815-0eff-4e51-a081-dd492aa584c0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.080940 Sep 21 16:47:36.802990 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 634/1349] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:36 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:37.260717 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-dbcec91f-0a9c-443a-b9f5-bb443a63a639 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:37.261327 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-dbcec91f-0a9c-443a-b9f5-bb443a63a639 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:37.267691 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dbcec91f-0a9c-443a-b9f5-bb443a63a639 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:37.268168 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dbcec91f-0a9c-443a-b9f5-bb443a63a639 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:37.269206 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dbcec91f-0a9c-443a-b9f5-bb443a63a639 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:37.269897 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dbcec91f-0a9c-443a-b9f5-bb443a63a639 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:37.270381 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dbcec91f-0a9c-443a-b9f5-bb443a63a639 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:37.270802 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dbcec91f-0a9c-443a-b9f5-bb443a63a639 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:37.614784 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-dbcec91f-0a9c-443a-b9f5-bb443a63a639 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:37.622900 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-dbcec91f-0a9c-443a-b9f5-bb443a63a639 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.366096 Sep 21 16:47:37.623477 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 716/1350] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:37 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:37.826178 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-35ef6a08-25f3-488e-bde0-cec209795954 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:37.826731 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-35ef6a08-25f3-488e-bde0-cec209795954 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:37.833624 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-35ef6a08-25f3-488e-bde0-cec209795954 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:37.834128 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-35ef6a08-25f3-488e-bde0-cec209795954 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:37.834563 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-35ef6a08-25f3-488e-bde0-cec209795954 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:37.835253 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-35ef6a08-25f3-488e-bde0-cec209795954 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:37.835707 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-35ef6a08-25f3-488e-bde0-cec209795954 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:37.836130 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-35ef6a08-25f3-488e-bde0-cec209795954 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:37.899395 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-35ef6a08-25f3-488e-bde0-cec209795954 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:37.907067 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-35ef6a08-25f3-488e-bde0-cec209795954 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.085091 Sep 21 16:47:37.907629 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 635/1351] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:37 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:38.647347 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-abd6dd54-6514-4a82-9a9a-b11c7f6a6bd7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:38.647957 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-abd6dd54-6514-4a82-9a9a-b11c7f6a6bd7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:38.655007 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-abd6dd54-6514-4a82-9a9a-b11c7f6a6bd7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:38.655483 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-abd6dd54-6514-4a82-9a9a-b11c7f6a6bd7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:38.655908 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-abd6dd54-6514-4a82-9a9a-b11c7f6a6bd7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:38.656597 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-abd6dd54-6514-4a82-9a9a-b11c7f6a6bd7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:38.657045 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-abd6dd54-6514-4a82-9a9a-b11c7f6a6bd7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:38.657461 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-abd6dd54-6514-4a82-9a9a-b11c7f6a6bd7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:38.783639 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-abd6dd54-6514-4a82-9a9a-b11c7f6a6bd7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:38.792401 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-abd6dd54-6514-4a82-9a9a-b11c7f6a6bd7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.149386 Sep 21 16:47:38.792973 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 717/1352] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:38 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:38.929995 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-0efb8524-f8c7-40f8-aad6-ac6b89554f78 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:38.930629 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-0efb8524-f8c7-40f8-aad6-ac6b89554f78 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:38.937138 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0efb8524-f8c7-40f8-aad6-ac6b89554f78 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:38.937618 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0efb8524-f8c7-40f8-aad6-ac6b89554f78 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:38.938068 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0efb8524-f8c7-40f8-aad6-ac6b89554f78 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:38.938759 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0efb8524-f8c7-40f8-aad6-ac6b89554f78 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:38.939210 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0efb8524-f8c7-40f8-aad6-ac6b89554f78 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:38.939635 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0efb8524-f8c7-40f8-aad6-ac6b89554f78 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:39.009083 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-0efb8524-f8c7-40f8-aad6-ac6b89554f78 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:39.016855 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-0efb8524-f8c7-40f8-aad6-ac6b89554f78 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.090603 Sep 21 16:47:39.017348 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 636/1353] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:38 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:39.816357 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-3ca9700f-7508-48fc-a770-823f43de5ed7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:39.817131 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-3ca9700f-7508-48fc-a770-823f43de5ed7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:39.823494 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3ca9700f-7508-48fc-a770-823f43de5ed7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:39.823974 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3ca9700f-7508-48fc-a770-823f43de5ed7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:39.824408 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3ca9700f-7508-48fc-a770-823f43de5ed7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:39.825092 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3ca9700f-7508-48fc-a770-823f43de5ed7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:39.825570 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3ca9700f-7508-48fc-a770-823f43de5ed7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:39.825988 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3ca9700f-7508-48fc-a770-823f43de5ed7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:39.953598 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-3ca9700f-7508-48fc-a770-823f43de5ed7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:39.961999 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-3ca9700f-7508-48fc-a770-823f43de5ed7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.150202 Sep 21 16:47:39.962588 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 718/1354] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:39 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:40.039595 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-ba7603eb-ec4d-4dc7-a70c-6691b81dbccb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:40.040207 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-ba7603eb-ec4d-4dc7-a70c-6691b81dbccb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:40.046814 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ba7603eb-ec4d-4dc7-a70c-6691b81dbccb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:40.047296 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ba7603eb-ec4d-4dc7-a70c-6691b81dbccb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:40.047734 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ba7603eb-ec4d-4dc7-a70c-6691b81dbccb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:40.048423 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ba7603eb-ec4d-4dc7-a70c-6691b81dbccb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:40.048873 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ba7603eb-ec4d-4dc7-a70c-6691b81dbccb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:40.049296 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ba7603eb-ec4d-4dc7-a70c-6691b81dbccb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:40.110705 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-ba7603eb-ec4d-4dc7-a70c-6691b81dbccb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:40.118994 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-ba7603eb-ec4d-4dc7-a70c-6691b81dbccb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083187 Sep 21 16:47:40.119557 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 637/1355] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:40 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:40.985569 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-705c82d2-ee66-4253-bcf4-3c714da26995 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:40.986211 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-705c82d2-ee66-4253-bcf4-3c714da26995 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:40.988472 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_api:SELECT=52 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:47:40.993864 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-705c82d2-ee66-4253-bcf4-3c714da26995 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:40.994367 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-705c82d2-ee66-4253-bcf4-3c714da26995 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:40.994791 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-705c82d2-ee66-4253-bcf4-3c714da26995 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:40.995466 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-705c82d2-ee66-4253-bcf4-3c714da26995 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:40.995913 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-705c82d2-ee66-4253-bcf4-3c714da26995 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:40.996325 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-705c82d2-ee66-4253-bcf4-3c714da26995 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:41.123297 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-705c82d2-ee66-4253-bcf4-3c714da26995 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:41.126644 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=100 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:47:41.132764 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-705c82d2-ee66-4253-bcf4-3c714da26995 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.151025 Sep 21 16:47:41.133362 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 719/1356] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:40 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:41.140912 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-8234e9ba-b683-444a-be1c-521167bb4fbb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:41.141550 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-8234e9ba-b683-444a-be1c-521167bb4fbb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:41.147948 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8234e9ba-b683-444a-be1c-521167bb4fbb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:41.148424 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8234e9ba-b683-444a-be1c-521167bb4fbb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:41.149151 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8234e9ba-b683-444a-be1c-521167bb4fbb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:41.150106 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8234e9ba-b683-444a-be1c-521167bb4fbb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:41.150560 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8234e9ba-b683-444a-be1c-521167bb4fbb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:41.150974 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8234e9ba-b683-444a-be1c-521167bb4fbb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:41.212677 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-8234e9ba-b683-444a-be1c-521167bb4fbb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:41.220191 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-8234e9ba-b683-444a-be1c-521167bb4fbb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083133 Sep 21 16:47:41.220752 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 638/1357] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:41 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:42.155796 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-09f7ff0b-c992-4a64-8a7e-f127c04ef1d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:42.156405 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-09f7ff0b-c992-4a64-8a7e-f127c04ef1d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:42.163172 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-09f7ff0b-c992-4a64-8a7e-f127c04ef1d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:42.163658 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-09f7ff0b-c992-4a64-8a7e-f127c04ef1d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:42.164091 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-09f7ff0b-c992-4a64-8a7e-f127c04ef1d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:42.164789 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-09f7ff0b-c992-4a64-8a7e-f127c04ef1d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:42.165242 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-09f7ff0b-c992-4a64-8a7e-f127c04ef1d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:42.165670 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-09f7ff0b-c992-4a64-8a7e-f127c04ef1d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:42.242567 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-689fc156-4465-485a-a5b3-c433ccdba97d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:42.243183 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-689fc156-4465-485a-a5b3-c433ccdba97d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:42.249279 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-689fc156-4465-485a-a5b3-c433ccdba97d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:42.249763 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-689fc156-4465-485a-a5b3-c433ccdba97d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:42.250225 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-689fc156-4465-485a-a5b3-c433ccdba97d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:42.250920 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-689fc156-4465-485a-a5b3-c433ccdba97d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:42.251371 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-689fc156-4465-485a-a5b3-c433ccdba97d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:42.251793 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-689fc156-4465-485a-a5b3-c433ccdba97d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:42.296781 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-09f7ff0b-c992-4a64-8a7e-f127c04ef1d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:42.305014 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-09f7ff0b-c992-4a64-8a7e-f127c04ef1d3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.153044 Sep 21 16:47:42.305588 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 720/1358] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:42 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:42.312880 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-689fc156-4465-485a-a5b3-c433ccdba97d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:42.321018 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-689fc156-4465-485a-a5b3-c433ccdba97d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082275 Sep 21 16:47:42.321574 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 639/1359] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:42 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:47:43.328210 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-2ae03dea-855f-4d36-af04-1518b5695e0e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:43.329086 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-2ae03dea-855f-4d36-af04-1518b5695e0e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:43.336037 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2ae03dea-855f-4d36-af04-1518b5695e0e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:43.336520 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2ae03dea-855f-4d36-af04-1518b5695e0e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:43.336954 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2ae03dea-855f-4d36-af04-1518b5695e0e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:43.337647 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2ae03dea-855f-4d36-af04-1518b5695e0e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:43.338122 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2ae03dea-855f-4d36-af04-1518b5695e0e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:43.338547 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2ae03dea-855f-4d36-af04-1518b5695e0e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:43.343806 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d1fc7c34-8d7b-4821-bcfe-f3161ea3249d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:43.344425 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d1fc7c34-8d7b-4821-bcfe-f3161ea3249d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:43.347405 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_api:SELECT=56 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:47:43.353185 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d1fc7c34-8d7b-4821-bcfe-f3161ea3249d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:43.353673 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d1fc7c34-8d7b-4821-bcfe-f3161ea3249d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:43.354136 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d1fc7c34-8d7b-4821-bcfe-f3161ea3249d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:43.355447 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d1fc7c34-8d7b-4821-bcfe-f3161ea3249d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:43.355934 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d1fc7c34-8d7b-4821-bcfe-f3161ea3249d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:43.356356 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d1fc7c34-8d7b-4821-bcfe-f3161ea3249d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:43.420323 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d1fc7c34-8d7b-4821-bcfe-f3161ea3249d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:43.428464 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d1fc7c34-8d7b-4821-bcfe-f3161ea3249d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.088294 Sep 21 16:47:43.429145 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 640/1360] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:43 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:47:43.466602 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-2ae03dea-855f-4d36-af04-1518b5695e0e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:43.475384 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-2ae03dea-855f-4d36-af04-1518b5695e0e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.151097 Sep 21 16:47:43.475959 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 721/1361] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:43 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:44.451094 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-8980e60f-07c7-47a5-8d91-0d5050bf0590 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:44.451731 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-8980e60f-07c7-47a5-8d91-0d5050bf0590 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:44.458689 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8980e60f-07c7-47a5-8d91-0d5050bf0590 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:44.459177 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8980e60f-07c7-47a5-8d91-0d5050bf0590 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:44.459613 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8980e60f-07c7-47a5-8d91-0d5050bf0590 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:44.460311 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8980e60f-07c7-47a5-8d91-0d5050bf0590 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:44.460767 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8980e60f-07c7-47a5-8d91-0d5050bf0590 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:44.461194 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8980e60f-07c7-47a5-8d91-0d5050bf0590 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:44.498079 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-79128969-80ac-40f6-b694-accec883c8dd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:44.498730 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-79128969-80ac-40f6-b694-accec883c8dd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:44.505176 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-79128969-80ac-40f6-b694-accec883c8dd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:44.505671 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-79128969-80ac-40f6-b694-accec883c8dd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:44.506137 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-79128969-80ac-40f6-b694-accec883c8dd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:44.506845 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-79128969-80ac-40f6-b694-accec883c8dd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:44.507303 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-79128969-80ac-40f6-b694-accec883c8dd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:44.507728 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-79128969-80ac-40f6-b694-accec883c8dd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:44.521838 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-8980e60f-07c7-47a5-8d91-0d5050bf0590 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:44.529558 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-8980e60f-07c7-47a5-8d91-0d5050bf0590 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082282 Sep 21 16:47:44.530144 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 641/1362] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:44 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:44.636543 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-79128969-80ac-40f6-b694-accec883c8dd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:44.644905 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-79128969-80ac-40f6-b694-accec883c8dd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.150613 Sep 21 16:47:44.645479 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 722/1363] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:44 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:47:45.553325 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-bb39bd12-88f8-4b1c-934f-fd40434a61e5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:45.553971 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-bb39bd12-88f8-4b1c-934f-fd40434a61e5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:45.560435 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bb39bd12-88f8-4b1c-934f-fd40434a61e5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:45.560917 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bb39bd12-88f8-4b1c-934f-fd40434a61e5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:45.561355 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bb39bd12-88f8-4b1c-934f-fd40434a61e5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:45.562065 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bb39bd12-88f8-4b1c-934f-fd40434a61e5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:45.562537 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bb39bd12-88f8-4b1c-934f-fd40434a61e5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:45.562958 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bb39bd12-88f8-4b1c-934f-fd40434a61e5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:45.623185 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-bb39bd12-88f8-4b1c-934f-fd40434a61e5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:45.631571 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-bb39bd12-88f8-4b1c-934f-fd40434a61e5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082712 Sep 21 16:47:45.632141 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 642/1364] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:45 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:45.668643 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-cac16189-432d-4257-80b0-3a5a0f7eb92c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:45.669258 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-cac16189-432d-4257-80b0-3a5a0f7eb92c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:45.676371 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cac16189-432d-4257-80b0-3a5a0f7eb92c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:45.676864 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cac16189-432d-4257-80b0-3a5a0f7eb92c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:45.677301 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cac16189-432d-4257-80b0-3a5a0f7eb92c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:45.677995 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cac16189-432d-4257-80b0-3a5a0f7eb92c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:45.678483 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cac16189-432d-4257-80b0-3a5a0f7eb92c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:45.678910 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cac16189-432d-4257-80b0-3a5a0f7eb92c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:45.804124 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-cac16189-432d-4257-80b0-3a5a0f7eb92c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:45.812275 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-cac16189-432d-4257-80b0-3a5a0f7eb92c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.147492 Sep 21 16:47:45.812869 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 723/1365] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:45 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:46.653909 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-1765a3ce-abc7-4538-ba0f-863e491520fa tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:46.654568 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-1765a3ce-abc7-4538-ba0f-863e491520fa tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:46.661433 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1765a3ce-abc7-4538-ba0f-863e491520fa tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:46.661905 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1765a3ce-abc7-4538-ba0f-863e491520fa tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:46.662357 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1765a3ce-abc7-4538-ba0f-863e491520fa tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:46.663042 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1765a3ce-abc7-4538-ba0f-863e491520fa tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:46.663490 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1765a3ce-abc7-4538-ba0f-863e491520fa tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:46.663904 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1765a3ce-abc7-4538-ba0f-863e491520fa tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:46.726997 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-1765a3ce-abc7-4538-ba0f-863e491520fa tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:46.734501 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-1765a3ce-abc7-4538-ba0f-863e491520fa tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.084402 Sep 21 16:47:46.735062 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 643/1366] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:46 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:46.836025 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-4271ca70-718c-46c1-a988-ba68448d5b85 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:46.836567 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-4271ca70-718c-46c1-a988-ba68448d5b85 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:46.843611 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4271ca70-718c-46c1-a988-ba68448d5b85 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:46.844097 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4271ca70-718c-46c1-a988-ba68448d5b85 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:46.844532 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4271ca70-718c-46c1-a988-ba68448d5b85 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:46.845222 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4271ca70-718c-46c1-a988-ba68448d5b85 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:46.845675 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4271ca70-718c-46c1-a988-ba68448d5b85 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:46.846638 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4271ca70-718c-46c1-a988-ba68448d5b85 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:46.979376 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-4271ca70-718c-46c1-a988-ba68448d5b85 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:46.988142 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-4271ca70-718c-46c1-a988-ba68448d5b85 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.156051 Sep 21 16:47:46.988712 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 724/1367] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:46 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:47.757310 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-eaffb18b-9e38-4863-b86a-c378ae8d3f65 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:47.757855 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-eaffb18b-9e38-4863-b86a-c378ae8d3f65 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:47.764184 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-eaffb18b-9e38-4863-b86a-c378ae8d3f65 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:47.764655 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-eaffb18b-9e38-4863-b86a-c378ae8d3f65 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:47.765079 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-eaffb18b-9e38-4863-b86a-c378ae8d3f65 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:47.765751 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-eaffb18b-9e38-4863-b86a-c378ae8d3f65 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:47.766232 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-eaffb18b-9e38-4863-b86a-c378ae8d3f65 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:47.766643 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-eaffb18b-9e38-4863-b86a-c378ae8d3f65 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:47.830099 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-eaffb18b-9e38-4863-b86a-c378ae8d3f65 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:47.837716 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-eaffb18b-9e38-4863-b86a-c378ae8d3f65 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.084343 Sep 21 16:47:47.838315 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 644/1368] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:47 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:48.010247 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-409e91fd-6377-4ce2-8923-d1e564c58065 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:48.010767 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-409e91fd-6377-4ce2-8923-d1e564c58065 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:48.017012 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-409e91fd-6377-4ce2-8923-d1e564c58065 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:48.017486 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-409e91fd-6377-4ce2-8923-d1e564c58065 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:48.017941 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-409e91fd-6377-4ce2-8923-d1e564c58065 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:48.018652 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-409e91fd-6377-4ce2-8923-d1e564c58065 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:48.019102 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-409e91fd-6377-4ce2-8923-d1e564c58065 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:48.019519 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-409e91fd-6377-4ce2-8923-d1e564c58065 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:48.146660 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-409e91fd-6377-4ce2-8923-d1e564c58065 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:48.154708 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-409e91fd-6377-4ce2-8923-d1e564c58065 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.148391 Sep 21 16:47:48.155284 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 725/1369] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:48 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:48.860853 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-221bc4e0-c181-4b2e-b851-d43a990ab5a2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:48.861380 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-221bc4e0-c181-4b2e-b851-d43a990ab5a2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:48.868349 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-221bc4e0-c181-4b2e-b851-d43a990ab5a2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:48.868828 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-221bc4e0-c181-4b2e-b851-d43a990ab5a2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:48.869263 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-221bc4e0-c181-4b2e-b851-d43a990ab5a2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:48.869955 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-221bc4e0-c181-4b2e-b851-d43a990ab5a2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:48.870431 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-221bc4e0-c181-4b2e-b851-d43a990ab5a2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:48.870853 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-221bc4e0-c181-4b2e-b851-d43a990ab5a2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:48.873355 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=100 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:47:48.936007 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-221bc4e0-c181-4b2e-b851-d43a990ab5a2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:48.943706 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-221bc4e0-c181-4b2e-b851-d43a990ab5a2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.086847 Sep 21 16:47:48.944255 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 645/1370] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:48 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:49.178360 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-a6e0f6da-c615-478c-b2e6-236cc94edca4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:49.178966 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-a6e0f6da-c615-478c-b2e6-236cc94edca4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:49.185289 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a6e0f6da-c615-478c-b2e6-236cc94edca4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:49.185761 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a6e0f6da-c615-478c-b2e6-236cc94edca4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:49.186219 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a6e0f6da-c615-478c-b2e6-236cc94edca4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:49.186897 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a6e0f6da-c615-478c-b2e6-236cc94edca4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:49.187363 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a6e0f6da-c615-478c-b2e6-236cc94edca4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:49.187759 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a6e0f6da-c615-478c-b2e6-236cc94edca4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:49.314687 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a6e0f6da-c615-478c-b2e6-236cc94edca4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:49.323327 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-a6e0f6da-c615-478c-b2e6-236cc94edca4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.148792 Sep 21 16:47:49.323889 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 726/1371] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:49 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:49.966036 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-684da378-234f-4fc2-8fd4-615cdbb7758c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:49.966666 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-684da378-234f-4fc2-8fd4-615cdbb7758c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:49.973563 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-684da378-234f-4fc2-8fd4-615cdbb7758c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:49.974035 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-684da378-234f-4fc2-8fd4-615cdbb7758c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:49.974481 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-684da378-234f-4fc2-8fd4-615cdbb7758c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:49.975155 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-684da378-234f-4fc2-8fd4-615cdbb7758c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:49.975600 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-684da378-234f-4fc2-8fd4-615cdbb7758c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:49.976013 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-684da378-234f-4fc2-8fd4-615cdbb7758c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:50.036323 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-684da378-234f-4fc2-8fd4-615cdbb7758c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:50.044247 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-684da378-234f-4fc2-8fd4-615cdbb7758c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082041 Sep 21 16:47:50.044812 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 646/1372] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:49 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:50.345819 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-a4fa5a57-90eb-4427-9e58-9d13b66488fb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:50.347018 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-a4fa5a57-90eb-4427-9e58-9d13b66488fb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:50.353417 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a4fa5a57-90eb-4427-9e58-9d13b66488fb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:50.353897 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a4fa5a57-90eb-4427-9e58-9d13b66488fb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:50.354367 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a4fa5a57-90eb-4427-9e58-9d13b66488fb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:50.355056 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a4fa5a57-90eb-4427-9e58-9d13b66488fb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:50.355510 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a4fa5a57-90eb-4427-9e58-9d13b66488fb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:50.355934 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a4fa5a57-90eb-4427-9e58-9d13b66488fb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:50.639138 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a4fa5a57-90eb-4427-9e58-9d13b66488fb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:50.647208 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-a4fa5a57-90eb-4427-9e58-9d13b66488fb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.305368 Sep 21 16:47:50.647811 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 727/1373] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:50 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:51.067253 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-c72cf647-b29c-4c7b-8ee3-ccbfad749dd4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:51.067861 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-c72cf647-b29c-4c7b-8ee3-ccbfad749dd4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:51.074235 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c72cf647-b29c-4c7b-8ee3-ccbfad749dd4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:51.074711 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c72cf647-b29c-4c7b-8ee3-ccbfad749dd4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:51.075141 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c72cf647-b29c-4c7b-8ee3-ccbfad749dd4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:51.075821 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c72cf647-b29c-4c7b-8ee3-ccbfad749dd4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:51.076301 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c72cf647-b29c-4c7b-8ee3-ccbfad749dd4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:51.076717 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c72cf647-b29c-4c7b-8ee3-ccbfad749dd4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:51.136760 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-c72cf647-b29c-4c7b-8ee3-ccbfad749dd4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:51.144299 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-c72cf647-b29c-4c7b-8ee3-ccbfad749dd4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081541 Sep 21 16:47:51.144863 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 647/1374] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:51 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:51.670752 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-6354e790-b934-47d0-9f20-6d2f5049203b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:51.671356 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-6354e790-b934-47d0-9f20-6d2f5049203b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:51.678324 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6354e790-b934-47d0-9f20-6d2f5049203b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:51.679189 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6354e790-b934-47d0-9f20-6d2f5049203b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:51.679627 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6354e790-b934-47d0-9f20-6d2f5049203b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:51.680451 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6354e790-b934-47d0-9f20-6d2f5049203b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:51.680899 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6354e790-b934-47d0-9f20-6d2f5049203b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:51.681459 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6354e790-b934-47d0-9f20-6d2f5049203b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:51.809738 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-6354e790-b934-47d0-9f20-6d2f5049203b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:51.818588 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-6354e790-b934-47d0-9f20-6d2f5049203b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.151656 Sep 21 16:47:51.819154 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 728/1375] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:51 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:52.167249 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d875438a-040c-47c2-ac67-b920984b25d9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:52.167859 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d875438a-040c-47c2-ac67-b920984b25d9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:52.174867 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d875438a-040c-47c2-ac67-b920984b25d9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:52.175351 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d875438a-040c-47c2-ac67-b920984b25d9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:52.176055 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d875438a-040c-47c2-ac67-b920984b25d9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:52.176734 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d875438a-040c-47c2-ac67-b920984b25d9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:52.177179 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d875438a-040c-47c2-ac67-b920984b25d9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:52.177593 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d875438a-040c-47c2-ac67-b920984b25d9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:52.239780 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d875438a-040c-47c2-ac67-b920984b25d9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:52.247308 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d875438a-040c-47c2-ac67-b920984b25d9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083883 Sep 21 16:47:52.247870 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 648/1376] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:52 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:52.841692 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-841784d3-8a5e-4570-b1a6-53ecf54ab924 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:52.842272 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-841784d3-8a5e-4570-b1a6-53ecf54ab924 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:52.848556 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-841784d3-8a5e-4570-b1a6-53ecf54ab924 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:52.849029 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-841784d3-8a5e-4570-b1a6-53ecf54ab924 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:52.849453 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-841784d3-8a5e-4570-b1a6-53ecf54ab924 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:52.850155 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-841784d3-8a5e-4570-b1a6-53ecf54ab924 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:52.850604 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-841784d3-8a5e-4570-b1a6-53ecf54ab924 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:52.851017 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-841784d3-8a5e-4570-b1a6-53ecf54ab924 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:52.977004 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-841784d3-8a5e-4570-b1a6-53ecf54ab924 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:52.985074 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-841784d3-8a5e-4570-b1a6-53ecf54ab924 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.147326 Sep 21 16:47:52.985625 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 729/1377] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:52 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:53.271637 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-0a71f0cb-87d0-4892-8823-2a5460963103 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:53.272808 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-0a71f0cb-87d0-4892-8823-2a5460963103 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:53.281700 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0a71f0cb-87d0-4892-8823-2a5460963103 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:53.282466 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0a71f0cb-87d0-4892-8823-2a5460963103 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:53.282706 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0a71f0cb-87d0-4892-8823-2a5460963103 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:53.283844 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0a71f0cb-87d0-4892-8823-2a5460963103 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:53.283980 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0a71f0cb-87d0-4892-8823-2a5460963103 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:53.284353 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0a71f0cb-87d0-4892-8823-2a5460963103 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:53.347067 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-0a71f0cb-87d0-4892-8823-2a5460963103 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:53.354788 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-0a71f0cb-87d0-4892-8823-2a5460963103 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.088733 Sep 21 16:47:53.355354 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 649/1378] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:53 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:54.007402 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-b66290e8-1ac9-4bfe-9ded-a188773141c9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:54.008038 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-b66290e8-1ac9-4bfe-9ded-a188773141c9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:54.014692 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b66290e8-1ac9-4bfe-9ded-a188773141c9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:54.015167 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b66290e8-1ac9-4bfe-9ded-a188773141c9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:54.015594 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b66290e8-1ac9-4bfe-9ded-a188773141c9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:54.016273 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b66290e8-1ac9-4bfe-9ded-a188773141c9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:54.016720 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b66290e8-1ac9-4bfe-9ded-a188773141c9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:54.017131 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b66290e8-1ac9-4bfe-9ded-a188773141c9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:54.147681 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-b66290e8-1ac9-4bfe-9ded-a188773141c9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:54.155952 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-b66290e8-1ac9-4bfe-9ded-a188773141c9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.152442 Sep 21 16:47:54.156514 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 730/1379] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:54 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:54.377982 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-1da2819b-5eda-49ce-967d-c6106604f874 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:54.378579 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-1da2819b-5eda-49ce-967d-c6106604f874 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:54.384981 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1da2819b-5eda-49ce-967d-c6106604f874 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:54.385465 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1da2819b-5eda-49ce-967d-c6106604f874 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:54.385899 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1da2819b-5eda-49ce-967d-c6106604f874 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:54.386629 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1da2819b-5eda-49ce-967d-c6106604f874 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:54.387083 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1da2819b-5eda-49ce-967d-c6106604f874 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:54.387500 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1da2819b-5eda-49ce-967d-c6106604f874 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:54.451847 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-1da2819b-5eda-49ce-967d-c6106604f874 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:54.460187 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-1da2819b-5eda-49ce-967d-c6106604f874 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.086100 Sep 21 16:47:54.460761 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 650/1380] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:54 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:55.179251 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-3175e4ad-2bb9-45fc-a37d-199a225b5ffe tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:55.179868 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-3175e4ad-2bb9-45fc-a37d-199a225b5ffe tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:55.186282 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3175e4ad-2bb9-45fc-a37d-199a225b5ffe tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:55.186767 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3175e4ad-2bb9-45fc-a37d-199a225b5ffe tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:55.187204 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3175e4ad-2bb9-45fc-a37d-199a225b5ffe tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:55.187897 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3175e4ad-2bb9-45fc-a37d-199a225b5ffe tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:55.188352 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3175e4ad-2bb9-45fc-a37d-199a225b5ffe tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:55.188782 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3175e4ad-2bb9-45fc-a37d-199a225b5ffe tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:55.313361 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-3175e4ad-2bb9-45fc-a37d-199a225b5ffe tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:55.322191 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-3175e4ad-2bb9-45fc-a37d-199a225b5ffe tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.146782 Sep 21 16:47:55.322798 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 731/1381] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:55 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:55.483153 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-f51e52e0-60b2-4123-9e4e-dece43c39e40 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:55.483766 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-f51e52e0-60b2-4123-9e4e-dece43c39e40 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:55.490733 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f51e52e0-60b2-4123-9e4e-dece43c39e40 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:55.491211 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f51e52e0-60b2-4123-9e4e-dece43c39e40 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:55.491642 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f51e52e0-60b2-4123-9e4e-dece43c39e40 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:55.492322 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f51e52e0-60b2-4123-9e4e-dece43c39e40 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:55.492764 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f51e52e0-60b2-4123-9e4e-dece43c39e40 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:55.493175 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f51e52e0-60b2-4123-9e4e-dece43c39e40 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:55.553171 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-f51e52e0-60b2-4123-9e4e-dece43c39e40 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:55.560664 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-f51e52e0-60b2-4123-9e4e-dece43c39e40 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081380 Sep 21 16:47:55.561219 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 651/1382] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:55 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:56.345449 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-0cdead33-9e22-4750-8269-2723f2837e35 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:56.346815 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-0cdead33-9e22-4750-8269-2723f2837e35 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:56.352988 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0cdead33-9e22-4750-8269-2723f2837e35 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:56.353458 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0cdead33-9e22-4750-8269-2723f2837e35 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:56.353883 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0cdead33-9e22-4750-8269-2723f2837e35 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:56.354593 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0cdead33-9e22-4750-8269-2723f2837e35 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:56.355044 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0cdead33-9e22-4750-8269-2723f2837e35 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:56.355458 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0cdead33-9e22-4750-8269-2723f2837e35 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:56.488173 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-0cdead33-9e22-4750-8269-2723f2837e35 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:56.496346 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-0cdead33-9e22-4750-8269-2723f2837e35 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.154771 Sep 21 16:47:56.496909 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 732/1383] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:56 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:56.584452 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-9a2d086c-2264-4a5e-b1dd-4a788c33b501 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:56.585064 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-9a2d086c-2264-4a5e-b1dd-4a788c33b501 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:56.591533 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9a2d086c-2264-4a5e-b1dd-4a788c33b501 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:56.592052 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9a2d086c-2264-4a5e-b1dd-4a788c33b501 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:56.592484 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9a2d086c-2264-4a5e-b1dd-4a788c33b501 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:56.593170 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9a2d086c-2264-4a5e-b1dd-4a788c33b501 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:56.593655 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9a2d086c-2264-4a5e-b1dd-4a788c33b501 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:56.594088 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9a2d086c-2264-4a5e-b1dd-4a788c33b501 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:56.659175 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-9a2d086c-2264-4a5e-b1dd-4a788c33b501 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:56.666999 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-9a2d086c-2264-4a5e-b1dd-4a788c33b501 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.087009 Sep 21 16:47:56.667559 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 652/1384] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:56 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:57.519801 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-5c59ad9e-eb36-4126-8d94-c2fe65838753 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:57.520414 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-5c59ad9e-eb36-4126-8d94-c2fe65838753 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:57.526842 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5c59ad9e-eb36-4126-8d94-c2fe65838753 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:57.527319 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5c59ad9e-eb36-4126-8d94-c2fe65838753 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:57.527750 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5c59ad9e-eb36-4126-8d94-c2fe65838753 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:57.528435 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5c59ad9e-eb36-4126-8d94-c2fe65838753 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:57.528884 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5c59ad9e-eb36-4126-8d94-c2fe65838753 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:57.529306 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5c59ad9e-eb36-4126-8d94-c2fe65838753 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:57.656213 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5c59ad9e-eb36-4126-8d94-c2fe65838753 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:57.664345 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-5c59ad9e-eb36-4126-8d94-c2fe65838753 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.148958 Sep 21 16:47:57.664915 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 733/1385] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:57 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:57.688585 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-a4096e9b-01b6-4faf-bc0f-14d545aab396 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:57.689125 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-a4096e9b-01b6-4faf-bc0f-14d545aab396 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:57.696081 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a4096e9b-01b6-4faf-bc0f-14d545aab396 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:57.696553 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a4096e9b-01b6-4faf-bc0f-14d545aab396 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:57.696981 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a4096e9b-01b6-4faf-bc0f-14d545aab396 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:57.697671 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a4096e9b-01b6-4faf-bc0f-14d545aab396 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:57.698139 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a4096e9b-01b6-4faf-bc0f-14d545aab396 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:57.698558 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a4096e9b-01b6-4faf-bc0f-14d545aab396 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:57.758226 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-a4096e9b-01b6-4faf-bc0f-14d545aab396 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:57.765713 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-a4096e9b-01b6-4faf-bc0f-14d545aab396 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.080950 Sep 21 16:47:57.766310 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 653/1386] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:57 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:58.688152 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-58612249-317c-47fa-a209-ed5d54da063c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:58.688755 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-58612249-317c-47fa-a209-ed5d54da063c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:58.695116 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-58612249-317c-47fa-a209-ed5d54da063c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:58.695588 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-58612249-317c-47fa-a209-ed5d54da063c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:58.696016 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-58612249-317c-47fa-a209-ed5d54da063c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:58.696694 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-58612249-317c-47fa-a209-ed5d54da063c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:58.697135 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-58612249-317c-47fa-a209-ed5d54da063c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:58.697548 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-58612249-317c-47fa-a209-ed5d54da063c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:58.788706 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-59d309bb-62dd-4204-8c81-239f4f38d838 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:58.789318 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-59d309bb-62dd-4204-8c81-239f4f38d838 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:58.795709 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-59d309bb-62dd-4204-8c81-239f4f38d838 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:58.796194 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-59d309bb-62dd-4204-8c81-239f4f38d838 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:58.796628 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-59d309bb-62dd-4204-8c81-239f4f38d838 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:58.797321 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-59d309bb-62dd-4204-8c81-239f4f38d838 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:58.797910 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-59d309bb-62dd-4204-8c81-239f4f38d838 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:58.798356 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-59d309bb-62dd-4204-8c81-239f4f38d838 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:58.827027 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-58612249-317c-47fa-a209-ed5d54da063c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:58.835532 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-58612249-317c-47fa-a209-ed5d54da063c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.151314 Sep 21 16:47:58.836101 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 734/1387] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:58 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:47:58.859318 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-59d309bb-62dd-4204-8c81-239f4f38d838 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:58.867673 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-59d309bb-62dd-4204-8c81-239f4f38d838 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082913 Sep 21 16:47:58.868237 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 654/1388] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:58 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:47:59.859396 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-657a9b3f-09af-4ed5-9da5-41c777ff5882 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:59.859952 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-657a9b3f-09af-4ed5-9da5-41c777ff5882 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:59.866898 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-657a9b3f-09af-4ed5-9da5-41c777ff5882 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:59.867372 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-657a9b3f-09af-4ed5-9da5-41c777ff5882 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:59.867802 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-657a9b3f-09af-4ed5-9da5-41c777ff5882 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:59.868482 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-657a9b3f-09af-4ed5-9da5-41c777ff5882 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:59.868929 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-657a9b3f-09af-4ed5-9da5-41c777ff5882 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:59.869349 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-657a9b3f-09af-4ed5-9da5-41c777ff5882 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:59.890417 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-2b211679-4cb5-40e9-8bc2-d98138ddcf19 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:47:59.891031 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-2b211679-4cb5-40e9-8bc2-d98138ddcf19 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:47:59.897505 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2b211679-4cb5-40e9-8bc2-d98138ddcf19 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:59.897986 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2b211679-4cb5-40e9-8bc2-d98138ddcf19 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:59.898455 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2b211679-4cb5-40e9-8bc2-d98138ddcf19 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:59.899156 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2b211679-4cb5-40e9-8bc2-d98138ddcf19 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:47:59.899609 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2b211679-4cb5-40e9-8bc2-d98138ddcf19 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:47:59.900031 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2b211679-4cb5-40e9-8bc2-d98138ddcf19 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:47:59.962348 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-2b211679-4cb5-40e9-8bc2-d98138ddcf19 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:47:59.969907 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-2b211679-4cb5-40e9-8bc2-d98138ddcf19 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083286 Sep 21 16:47:59.970509 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 655/1389] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:59 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:47:59.995477 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-657a9b3f-09af-4ed5-9da5-41c777ff5882 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:00.004131 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-657a9b3f-09af-4ed5-9da5-41c777ff5882 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.148650 Sep 21 16:48:00.004689 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 735/1390] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:47:59 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:00.993021 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-58622711-e633-46d3-aa70-9b8f524d1a7e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:00.993638 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-58622711-e633-46d3-aa70-9b8f524d1a7e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:00.999980 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-58622711-e633-46d3-aa70-9b8f524d1a7e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:01.000478 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-58622711-e633-46d3-aa70-9b8f524d1a7e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:01.000905 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-58622711-e633-46d3-aa70-9b8f524d1a7e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:01.001583 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-58622711-e633-46d3-aa70-9b8f524d1a7e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:01.002079 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-58622711-e633-46d3-aa70-9b8f524d1a7e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:01.002487 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-58622711-e633-46d3-aa70-9b8f524d1a7e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:01.027048 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-4e68b7dc-f680-4886-b44d-c5bcbd21aa10 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:01.027682 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-4e68b7dc-f680-4886-b44d-c5bcbd21aa10 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:01.035113 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4e68b7dc-f680-4886-b44d-c5bcbd21aa10 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:01.035594 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4e68b7dc-f680-4886-b44d-c5bcbd21aa10 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:01.036028 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4e68b7dc-f680-4886-b44d-c5bcbd21aa10 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:01.036721 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4e68b7dc-f680-4886-b44d-c5bcbd21aa10 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:01.037175 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4e68b7dc-f680-4886-b44d-c5bcbd21aa10 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:01.037596 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4e68b7dc-f680-4886-b44d-c5bcbd21aa10 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:01.056202 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=100 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:48:01.067497 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-58622711-e633-46d3-aa70-9b8f524d1a7e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:01.075321 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-58622711-e633-46d3-aa70-9b8f524d1a7e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.086196 Sep 21 16:48:01.075886 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 656/1391] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:00 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:01.166675 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-4e68b7dc-f680-4886-b44d-c5bcbd21aa10 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:01.175396 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-4e68b7dc-f680-4886-b44d-c5bcbd21aa10 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.152248 Sep 21 16:48:01.175965 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 736/1392] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:01 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:48:02.098022 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-504aead6-dedc-45b0-a921-54df1cbcee76 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:02.098633 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-504aead6-dedc-45b0-a921-54df1cbcee76 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:02.105004 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-504aead6-dedc-45b0-a921-54df1cbcee76 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:02.105489 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-504aead6-dedc-45b0-a921-54df1cbcee76 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:02.105918 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-504aead6-dedc-45b0-a921-54df1cbcee76 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:02.106640 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-504aead6-dedc-45b0-a921-54df1cbcee76 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:02.107094 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-504aead6-dedc-45b0-a921-54df1cbcee76 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:02.107517 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-504aead6-dedc-45b0-a921-54df1cbcee76 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:02.166642 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-504aead6-dedc-45b0-a921-54df1cbcee76 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:02.174669 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-504aead6-dedc-45b0-a921-54df1cbcee76 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.080473 Sep 21 16:48:02.175236 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 657/1393] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:02 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:02.198429 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-17c2f816-74a8-44be-a98b-aa00558c6782 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:02.199082 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-17c2f816-74a8-44be-a98b-aa00558c6782 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:02.205950 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-17c2f816-74a8-44be-a98b-aa00558c6782 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:02.206471 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-17c2f816-74a8-44be-a98b-aa00558c6782 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:02.206909 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-17c2f816-74a8-44be-a98b-aa00558c6782 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:02.207609 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-17c2f816-74a8-44be-a98b-aa00558c6782 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:02.208064 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-17c2f816-74a8-44be-a98b-aa00558c6782 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:02.208489 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-17c2f816-74a8-44be-a98b-aa00558c6782 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:02.339302 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-17c2f816-74a8-44be-a98b-aa00558c6782 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:02.347424 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-17c2f816-74a8-44be-a98b-aa00558c6782 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.153084 Sep 21 16:48:02.347998 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 737/1394] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:02 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:03.197683 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-4823deea-086c-4549-9baf-efd5d3344baa tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:03.198399 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-4823deea-086c-4549-9baf-efd5d3344baa tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:03.205752 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4823deea-086c-4549-9baf-efd5d3344baa tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:03.206265 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4823deea-086c-4549-9baf-efd5d3344baa tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:03.206693 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4823deea-086c-4549-9baf-efd5d3344baa tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:03.207379 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4823deea-086c-4549-9baf-efd5d3344baa tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:03.207830 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4823deea-086c-4549-9baf-efd5d3344baa tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:03.208248 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4823deea-086c-4549-9baf-efd5d3344baa tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:03.268165 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-4823deea-086c-4549-9baf-efd5d3344baa tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:03.275756 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-4823deea-086c-4549-9baf-efd5d3344baa tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081962 Sep 21 16:48:03.276322 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 658/1395] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:03 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:03.371270 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-a2f49743-8076-48f3-88f6-4906c7340966 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:03.371910 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-a2f49743-8076-48f3-88f6-4906c7340966 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:03.378755 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a2f49743-8076-48f3-88f6-4906c7340966 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:03.379229 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a2f49743-8076-48f3-88f6-4906c7340966 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:03.379660 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a2f49743-8076-48f3-88f6-4906c7340966 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:03.380345 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a2f49743-8076-48f3-88f6-4906c7340966 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:03.380790 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a2f49743-8076-48f3-88f6-4906c7340966 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:03.381210 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a2f49743-8076-48f3-88f6-4906c7340966 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:03.505173 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a2f49743-8076-48f3-88f6-4906c7340966 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:03.513357 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-a2f49743-8076-48f3-88f6-4906c7340966 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.145866 Sep 21 16:48:03.513925 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 738/1396] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:03 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:04.298639 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-b41d5ba3-39ec-41a0-b104-69f8b4633b91 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:04.299247 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-b41d5ba3-39ec-41a0-b104-69f8b4633b91 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:04.305606 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b41d5ba3-39ec-41a0-b104-69f8b4633b91 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:04.306112 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b41d5ba3-39ec-41a0-b104-69f8b4633b91 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:04.306550 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b41d5ba3-39ec-41a0-b104-69f8b4633b91 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:04.307244 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b41d5ba3-39ec-41a0-b104-69f8b4633b91 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:04.307700 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b41d5ba3-39ec-41a0-b104-69f8b4633b91 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:04.308118 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b41d5ba3-39ec-41a0-b104-69f8b4633b91 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:04.367635 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-b41d5ba3-39ec-41a0-b104-69f8b4633b91 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:04.375179 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-b41d5ba3-39ec-41a0-b104-69f8b4633b91 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.080556 Sep 21 16:48:04.375744 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 659/1397] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:04 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:04.537256 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c2675c50-9a8d-4746-a8b4-32f9fe47462c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:04.537871 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-c2675c50-9a8d-4746-a8b4-32f9fe47462c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:04.544401 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c2675c50-9a8d-4746-a8b4-32f9fe47462c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:04.544883 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c2675c50-9a8d-4746-a8b4-32f9fe47462c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:04.545318 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c2675c50-9a8d-4746-a8b4-32f9fe47462c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:04.546010 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c2675c50-9a8d-4746-a8b4-32f9fe47462c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:04.546488 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c2675c50-9a8d-4746-a8b4-32f9fe47462c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:04.546913 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c2675c50-9a8d-4746-a8b4-32f9fe47462c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:04.678488 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-c2675c50-9a8d-4746-a8b4-32f9fe47462c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:04.687003 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-c2675c50-9a8d-4746-a8b4-32f9fe47462c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.154185 Sep 21 16:48:04.687572 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 739/1398] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:04 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:05.397877 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-bfd9b237-69a2-4477-a0ea-7ae420721b6d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:05.398478 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-bfd9b237-69a2-4477-a0ea-7ae420721b6d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:05.404875 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bfd9b237-69a2-4477-a0ea-7ae420721b6d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:05.405360 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bfd9b237-69a2-4477-a0ea-7ae420721b6d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:05.405795 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bfd9b237-69a2-4477-a0ea-7ae420721b6d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:05.406518 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bfd9b237-69a2-4477-a0ea-7ae420721b6d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:05.406977 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bfd9b237-69a2-4477-a0ea-7ae420721b6d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:05.407401 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bfd9b237-69a2-4477-a0ea-7ae420721b6d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:05.469999 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-bfd9b237-69a2-4477-a0ea-7ae420721b6d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:05.477759 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-bfd9b237-69a2-4477-a0ea-7ae420721b6d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083770 Sep 21 16:48:05.478356 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 660/1399] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:05 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:05.710832 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-79234ac6-0f92-414a-b1d4-7abc9d332e3a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:05.711468 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-79234ac6-0f92-414a-b1d4-7abc9d332e3a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:05.717868 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-79234ac6-0f92-414a-b1d4-7abc9d332e3a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:05.718377 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-79234ac6-0f92-414a-b1d4-7abc9d332e3a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:05.718805 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-79234ac6-0f92-414a-b1d4-7abc9d332e3a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:05.719480 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-79234ac6-0f92-414a-b1d4-7abc9d332e3a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:05.719926 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-79234ac6-0f92-414a-b1d4-7abc9d332e3a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:05.720346 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-79234ac6-0f92-414a-b1d4-7abc9d332e3a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:05.847956 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-79234ac6-0f92-414a-b1d4-7abc9d332e3a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:05.856108 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-79234ac6-0f92-414a-b1d4-7abc9d332e3a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.149204 Sep 21 16:48:05.856665 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 740/1400] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:05 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:06.500322 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-2e222f33-2033-4e8d-bd27-d1b185a5f5f2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:06.500934 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-2e222f33-2033-4e8d-bd27-d1b185a5f5f2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:06.507457 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2e222f33-2033-4e8d-bd27-d1b185a5f5f2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:06.507939 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2e222f33-2033-4e8d-bd27-d1b185a5f5f2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:06.508371 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2e222f33-2033-4e8d-bd27-d1b185a5f5f2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:06.509065 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2e222f33-2033-4e8d-bd27-d1b185a5f5f2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:06.509518 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2e222f33-2033-4e8d-bd27-d1b185a5f5f2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:06.509943 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2e222f33-2033-4e8d-bd27-d1b185a5f5f2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:06.571193 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-2e222f33-2033-4e8d-bd27-d1b185a5f5f2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:06.573424 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=100 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:48:06.580819 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-2e222f33-2033-4e8d-bd27-d1b185a5f5f2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.084347 Sep 21 16:48:06.581380 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 661/1401] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:06 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:06.880004 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-5ed18c54-152f-49ea-a9f1-7d5cf27f20f2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:06.880615 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-5ed18c54-152f-49ea-a9f1-7d5cf27f20f2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:06.887012 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5ed18c54-152f-49ea-a9f1-7d5cf27f20f2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:06.887489 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5ed18c54-152f-49ea-a9f1-7d5cf27f20f2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:06.887919 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5ed18c54-152f-49ea-a9f1-7d5cf27f20f2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:06.888598 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5ed18c54-152f-49ea-a9f1-7d5cf27f20f2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:06.889049 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5ed18c54-152f-49ea-a9f1-7d5cf27f20f2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:06.889465 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5ed18c54-152f-49ea-a9f1-7d5cf27f20f2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:07.014041 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5ed18c54-152f-49ea-a9f1-7d5cf27f20f2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:07.022698 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-5ed18c54-152f-49ea-a9f1-7d5cf27f20f2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.147076 Sep 21 16:48:07.023264 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 741/1402] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:06 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:07.604477 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d2f61deb-baa3-46d9-a2cd-0eec8b84a156 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:07.605095 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d2f61deb-baa3-46d9-a2cd-0eec8b84a156 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:07.611212 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d2f61deb-baa3-46d9-a2cd-0eec8b84a156 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:07.611696 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d2f61deb-baa3-46d9-a2cd-0eec8b84a156 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:07.612130 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d2f61deb-baa3-46d9-a2cd-0eec8b84a156 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:07.612821 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d2f61deb-baa3-46d9-a2cd-0eec8b84a156 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:07.613274 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d2f61deb-baa3-46d9-a2cd-0eec8b84a156 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:07.613701 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d2f61deb-baa3-46d9-a2cd-0eec8b84a156 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:07.673066 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d2f61deb-baa3-46d9-a2cd-0eec8b84a156 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:07.680652 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d2f61deb-baa3-46d9-a2cd-0eec8b84a156 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.080274 Sep 21 16:48:07.681209 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 662/1403] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:07 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:08.045283 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-8c11ac0e-0f33-48f7-9d7a-1f641b39f090 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:08.045891 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-8c11ac0e-0f33-48f7-9d7a-1f641b39f090 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:08.052794 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8c11ac0e-0f33-48f7-9d7a-1f641b39f090 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:08.053265 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8c11ac0e-0f33-48f7-9d7a-1f641b39f090 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:08.053695 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8c11ac0e-0f33-48f7-9d7a-1f641b39f090 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:08.054400 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8c11ac0e-0f33-48f7-9d7a-1f641b39f090 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:08.054855 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8c11ac0e-0f33-48f7-9d7a-1f641b39f090 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:08.055293 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8c11ac0e-0f33-48f7-9d7a-1f641b39f090 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:08.183916 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-8c11ac0e-0f33-48f7-9d7a-1f641b39f090 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:08.192728 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-8c11ac0e-0f33-48f7-9d7a-1f641b39f090 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.151281 Sep 21 16:48:08.193284 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 742/1404] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:08 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:08.703532 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-7053ddf4-809c-4bbd-b9ec-278656588259 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:08.704461 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-7053ddf4-809c-4bbd-b9ec-278656588259 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:08.710878 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7053ddf4-809c-4bbd-b9ec-278656588259 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:08.711353 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7053ddf4-809c-4bbd-b9ec-278656588259 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:08.711778 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7053ddf4-809c-4bbd-b9ec-278656588259 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:08.712457 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7053ddf4-809c-4bbd-b9ec-278656588259 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:08.712902 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7053ddf4-809c-4bbd-b9ec-278656588259 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:08.713314 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7053ddf4-809c-4bbd-b9ec-278656588259 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:08.776834 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-7053ddf4-809c-4bbd-b9ec-278656588259 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:08.785009 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-7053ddf4-809c-4bbd-b9ec-278656588259 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.085355 Sep 21 16:48:08.785594 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 663/1405] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:08 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:09.216136 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-77f09552-8171-4ab3-8fad-53a65bc2e18e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:09.216743 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-77f09552-8171-4ab3-8fad-53a65bc2e18e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:09.222653 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-77f09552-8171-4ab3-8fad-53a65bc2e18e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:09.223124 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-77f09552-8171-4ab3-8fad-53a65bc2e18e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:09.223552 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-77f09552-8171-4ab3-8fad-53a65bc2e18e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:09.224226 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-77f09552-8171-4ab3-8fad-53a65bc2e18e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:09.224671 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-77f09552-8171-4ab3-8fad-53a65bc2e18e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:09.225085 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-77f09552-8171-4ab3-8fad-53a65bc2e18e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:09.354176 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-77f09552-8171-4ab3-8fad-53a65bc2e18e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:09.367740 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-77f09552-8171-4ab3-8fad-53a65bc2e18e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.155651 Sep 21 16:48:09.368329 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 743/1406] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:09 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:09.807592 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-c4196adf-e074-426d-a769-411f697b3af4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:09.808150 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-c4196adf-e074-426d-a769-411f697b3af4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:09.815311 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c4196adf-e074-426d-a769-411f697b3af4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:09.815789 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c4196adf-e074-426d-a769-411f697b3af4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:09.816215 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c4196adf-e074-426d-a769-411f697b3af4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:09.816894 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c4196adf-e074-426d-a769-411f697b3af4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:09.817338 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c4196adf-e074-426d-a769-411f697b3af4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:09.817748 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-c4196adf-e074-426d-a769-411f697b3af4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:09.883323 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-c4196adf-e074-426d-a769-411f697b3af4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:09.892031 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-c4196adf-e074-426d-a769-411f697b3af4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.088349 Sep 21 16:48:09.892589 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 664/1407] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:09 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:10.390873 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-7cdaa619-21a4-4f42-8655-494bd6ae6af5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:10.391480 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-7cdaa619-21a4-4f42-8655-494bd6ae6af5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:10.397930 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7cdaa619-21a4-4f42-8655-494bd6ae6af5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:10.398441 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7cdaa619-21a4-4f42-8655-494bd6ae6af5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:10.398870 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7cdaa619-21a4-4f42-8655-494bd6ae6af5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:10.399556 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7cdaa619-21a4-4f42-8655-494bd6ae6af5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:10.400005 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7cdaa619-21a4-4f42-8655-494bd6ae6af5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:10.400424 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7cdaa619-21a4-4f42-8655-494bd6ae6af5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:10.530915 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-7cdaa619-21a4-4f42-8655-494bd6ae6af5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:10.539045 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-7cdaa619-21a4-4f42-8655-494bd6ae6af5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.152029 Sep 21 16:48:10.539599 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 744/1408] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:10 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:10.915493 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-60e3bf6c-b539-48f8-8b8f-ca019d4f2ca6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:10.916106 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-60e3bf6c-b539-48f8-8b8f-ca019d4f2ca6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:10.922753 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-60e3bf6c-b539-48f8-8b8f-ca019d4f2ca6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:10.923235 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-60e3bf6c-b539-48f8-8b8f-ca019d4f2ca6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:10.924211 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-60e3bf6c-b539-48f8-8b8f-ca019d4f2ca6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:10.924902 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-60e3bf6c-b539-48f8-8b8f-ca019d4f2ca6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:10.925356 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-60e3bf6c-b539-48f8-8b8f-ca019d4f2ca6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:10.925779 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-60e3bf6c-b539-48f8-8b8f-ca019d4f2ca6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:10.985533 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-60e3bf6c-b539-48f8-8b8f-ca019d4f2ca6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:10.993839 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-60e3bf6c-b539-48f8-8b8f-ca019d4f2ca6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082527 Sep 21 16:48:10.994433 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 665/1409] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:10 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:11.562575 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-afec3c19-1c69-49d1-b772-65578e04857f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:11.563184 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-afec3c19-1c69-49d1-b772-65578e04857f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:11.566141 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_api:SELECT=52 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:48:11.571314 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-afec3c19-1c69-49d1-b772-65578e04857f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:11.571788 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-afec3c19-1c69-49d1-b772-65578e04857f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:11.572221 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-afec3c19-1c69-49d1-b772-65578e04857f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:11.572906 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-afec3c19-1c69-49d1-b772-65578e04857f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:11.573353 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-afec3c19-1c69-49d1-b772-65578e04857f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:11.573771 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-afec3c19-1c69-49d1-b772-65578e04857f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:11.699686 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-afec3c19-1c69-49d1-b772-65578e04857f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:11.708891 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-afec3c19-1c69-49d1-b772-65578e04857f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.150204 Sep 21 16:48:11.709459 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 745/1410] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:11 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:12.016170 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-fd7566b6-ae86-4695-bec2-9dbe81cdf7db tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:12.016716 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-fd7566b6-ae86-4695-bec2-9dbe81cdf7db tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:12.023684 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fd7566b6-ae86-4695-bec2-9dbe81cdf7db tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:12.024163 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fd7566b6-ae86-4695-bec2-9dbe81cdf7db tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:12.024596 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fd7566b6-ae86-4695-bec2-9dbe81cdf7db tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:12.025315 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fd7566b6-ae86-4695-bec2-9dbe81cdf7db tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:12.025768 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fd7566b6-ae86-4695-bec2-9dbe81cdf7db tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:12.026228 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fd7566b6-ae86-4695-bec2-9dbe81cdf7db tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:12.087011 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-fd7566b6-ae86-4695-bec2-9dbe81cdf7db tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:12.094674 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-fd7566b6-ae86-4695-bec2-9dbe81cdf7db tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082485 Sep 21 16:48:12.095875 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 666/1411] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:12 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:12.732091 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-b77a3883-71a2-4d91-998d-c8fc3efebd3d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:12.732706 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-b77a3883-71a2-4d91-998d-c8fc3efebd3d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:12.739720 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b77a3883-71a2-4d91-998d-c8fc3efebd3d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:12.740144 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b77a3883-71a2-4d91-998d-c8fc3efebd3d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:12.740581 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b77a3883-71a2-4d91-998d-c8fc3efebd3d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:12.741271 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b77a3883-71a2-4d91-998d-c8fc3efebd3d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:12.741722 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b77a3883-71a2-4d91-998d-c8fc3efebd3d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:12.742174 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b77a3883-71a2-4d91-998d-c8fc3efebd3d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:12.872968 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-b77a3883-71a2-4d91-998d-c8fc3efebd3d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:12.882017 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-b77a3883-71a2-4d91-998d-c8fc3efebd3d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.153846 Sep 21 16:48:12.882617 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 746/1412] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:12 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:13.118288 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-0223e607-35cd-47c6-b668-caa2f13c6e95 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:13.118853 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-0223e607-35cd-47c6-b668-caa2f13c6e95 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:13.125146 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0223e607-35cd-47c6-b668-caa2f13c6e95 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:13.125631 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0223e607-35cd-47c6-b668-caa2f13c6e95 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:13.126086 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0223e607-35cd-47c6-b668-caa2f13c6e95 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:13.127293 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0223e607-35cd-47c6-b668-caa2f13c6e95 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:13.127739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0223e607-35cd-47c6-b668-caa2f13c6e95 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:13.128158 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0223e607-35cd-47c6-b668-caa2f13c6e95 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:13.186949 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-0223e607-35cd-47c6-b668-caa2f13c6e95 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:13.195056 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-0223e607-35cd-47c6-b668-caa2f13c6e95 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.080745 Sep 21 16:48:13.195619 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 667/1413] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:13 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:13.904435 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-e7697e7f-6f10-4529-9313-48ce2333bcf6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:13.905070 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-e7697e7f-6f10-4529-9313-48ce2333bcf6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:13.912056 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e7697e7f-6f10-4529-9313-48ce2333bcf6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:13.912561 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e7697e7f-6f10-4529-9313-48ce2333bcf6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:13.912994 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e7697e7f-6f10-4529-9313-48ce2333bcf6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:13.913681 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e7697e7f-6f10-4529-9313-48ce2333bcf6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:13.914158 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e7697e7f-6f10-4529-9313-48ce2333bcf6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:13.914586 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e7697e7f-6f10-4529-9313-48ce2333bcf6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:14.039583 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-e7697e7f-6f10-4529-9313-48ce2333bcf6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:14.047788 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-e7697e7f-6f10-4529-9313-48ce2333bcf6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.147229 Sep 21 16:48:14.048357 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 747/1414] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:13 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:14.218964 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-783c6982-ff20-44a8-8515-fa940e5c52f1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:14.219577 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-783c6982-ff20-44a8-8515-fa940e5c52f1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:14.222560 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_api:SELECT=56 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:48:14.227840 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-783c6982-ff20-44a8-8515-fa940e5c52f1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:14.228329 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-783c6982-ff20-44a8-8515-fa940e5c52f1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:14.228783 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-783c6982-ff20-44a8-8515-fa940e5c52f1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:14.229475 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-783c6982-ff20-44a8-8515-fa940e5c52f1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:14.229927 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-783c6982-ff20-44a8-8515-fa940e5c52f1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:14.230377 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-783c6982-ff20-44a8-8515-fa940e5c52f1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:14.292795 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-783c6982-ff20-44a8-8515-fa940e5c52f1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:14.300379 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-783c6982-ff20-44a8-8515-fa940e5c52f1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.085244 Sep 21 16:48:14.300937 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 668/1415] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:14 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:15.071181 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-0a5fae27-c47c-4b48-9d15-0aeec5682f49 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:15.071786 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-0a5fae27-c47c-4b48-9d15-0aeec5682f49 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:15.079118 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0a5fae27-c47c-4b48-9d15-0aeec5682f49 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:15.079594 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0a5fae27-c47c-4b48-9d15-0aeec5682f49 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:15.080023 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0a5fae27-c47c-4b48-9d15-0aeec5682f49 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:15.080705 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0a5fae27-c47c-4b48-9d15-0aeec5682f49 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:15.081151 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0a5fae27-c47c-4b48-9d15-0aeec5682f49 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:15.081567 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0a5fae27-c47c-4b48-9d15-0aeec5682f49 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:15.209689 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-0a5fae27-c47c-4b48-9d15-0aeec5682f49 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:15.217797 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-0a5fae27-c47c-4b48-9d15-0aeec5682f49 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.150522 Sep 21 16:48:15.218400 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 748/1416] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:15 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:15.322918 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-f6d6d250-656b-40a2-82a1-cd894cc55778 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:15.323457 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-f6d6d250-656b-40a2-82a1-cd894cc55778 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:15.330003 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f6d6d250-656b-40a2-82a1-cd894cc55778 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:15.330508 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f6d6d250-656b-40a2-82a1-cd894cc55778 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:15.330937 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f6d6d250-656b-40a2-82a1-cd894cc55778 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:15.331623 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f6d6d250-656b-40a2-82a1-cd894cc55778 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:15.332067 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f6d6d250-656b-40a2-82a1-cd894cc55778 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:15.332486 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f6d6d250-656b-40a2-82a1-cd894cc55778 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:15.391446 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-f6d6d250-656b-40a2-82a1-cd894cc55778 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:15.399038 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-f6d6d250-656b-40a2-82a1-cd894cc55778 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.079976 Sep 21 16:48:15.399597 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 669/1417] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:15 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:16.241693 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-56f90b02-f2ec-4993-a8a0-9eb9e55e4844 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:16.242322 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-56f90b02-f2ec-4993-a8a0-9eb9e55e4844 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:16.248731 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-56f90b02-f2ec-4993-a8a0-9eb9e55e4844 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:16.249200 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-56f90b02-f2ec-4993-a8a0-9eb9e55e4844 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:16.249628 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-56f90b02-f2ec-4993-a8a0-9eb9e55e4844 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:16.250344 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-56f90b02-f2ec-4993-a8a0-9eb9e55e4844 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:16.250794 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-56f90b02-f2ec-4993-a8a0-9eb9e55e4844 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:16.251212 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-56f90b02-f2ec-4993-a8a0-9eb9e55e4844 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:16.379850 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-56f90b02-f2ec-4993-a8a0-9eb9e55e4844 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:16.387896 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-56f90b02-f2ec-4993-a8a0-9eb9e55e4844 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.150080 Sep 21 16:48:16.388456 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 749/1418] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:16 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:16.421777 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-13caee8d-81b7-4c83-be83-000fbd38a080 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:16.422475 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-13caee8d-81b7-4c83-be83-000fbd38a080 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:16.428836 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-13caee8d-81b7-4c83-be83-000fbd38a080 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:16.429318 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-13caee8d-81b7-4c83-be83-000fbd38a080 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:16.429781 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-13caee8d-81b7-4c83-be83-000fbd38a080 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:16.430516 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-13caee8d-81b7-4c83-be83-000fbd38a080 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:16.430978 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-13caee8d-81b7-4c83-be83-000fbd38a080 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:16.431404 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-13caee8d-81b7-4c83-be83-000fbd38a080 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:16.493906 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-13caee8d-81b7-4c83-be83-000fbd38a080 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:16.501538 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-13caee8d-81b7-4c83-be83-000fbd38a080 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083579 Sep 21 16:48:16.502120 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 670/1419] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:16 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:17.411228 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-6b4ff24c-ebdd-412d-bcf7-2d88af63ad8e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:17.411847 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-6b4ff24c-ebdd-412d-bcf7-2d88af63ad8e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:17.418308 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6b4ff24c-ebdd-412d-bcf7-2d88af63ad8e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:17.418788 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6b4ff24c-ebdd-412d-bcf7-2d88af63ad8e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:17.419219 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6b4ff24c-ebdd-412d-bcf7-2d88af63ad8e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:17.419904 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6b4ff24c-ebdd-412d-bcf7-2d88af63ad8e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:17.420357 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6b4ff24c-ebdd-412d-bcf7-2d88af63ad8e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:17.420777 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6b4ff24c-ebdd-412d-bcf7-2d88af63ad8e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:17.524353 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-9cb1c2f2-20f2-415f-9d85-0ec179a477ae tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:17.525063 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-9cb1c2f2-20f2-415f-9d85-0ec179a477ae tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:17.531631 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9cb1c2f2-20f2-415f-9d85-0ec179a477ae tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:17.532116 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9cb1c2f2-20f2-415f-9d85-0ec179a477ae tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:17.532594 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9cb1c2f2-20f2-415f-9d85-0ec179a477ae tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:17.533429 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9cb1c2f2-20f2-415f-9d85-0ec179a477ae tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:17.533877 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9cb1c2f2-20f2-415f-9d85-0ec179a477ae tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:17.534328 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9cb1c2f2-20f2-415f-9d85-0ec179a477ae tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:17.548778 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-6b4ff24c-ebdd-412d-bcf7-2d88af63ad8e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:17.556990 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-6b4ff24c-ebdd-412d-bcf7-2d88af63ad8e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.149756 Sep 21 16:48:17.557572 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 750/1420] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:17 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:17.595001 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-9cb1c2f2-20f2-415f-9d85-0ec179a477ae tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:17.602604 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-9cb1c2f2-20f2-415f-9d85-0ec179a477ae tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082163 Sep 21 16:48:17.603170 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 671/1421] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:17 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:48:18.581231 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-286dcc7f-13c6-4163-85cd-3d750aa49c88 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:18.581841 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-286dcc7f-13c6-4163-85cd-3d750aa49c88 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:18.588268 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-286dcc7f-13c6-4163-85cd-3d750aa49c88 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:18.588747 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-286dcc7f-13c6-4163-85cd-3d750aa49c88 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:18.589181 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-286dcc7f-13c6-4163-85cd-3d750aa49c88 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:18.589866 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-286dcc7f-13c6-4163-85cd-3d750aa49c88 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:18.590348 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-286dcc7f-13c6-4163-85cd-3d750aa49c88 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:18.590776 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-286dcc7f-13c6-4163-85cd-3d750aa49c88 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:18.624908 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-08b5f0f4-ffc9-495f-bde8-c3f43fecb17f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:18.625599 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-08b5f0f4-ffc9-495f-bde8-c3f43fecb17f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:18.632150 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-08b5f0f4-ffc9-495f-bde8-c3f43fecb17f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:18.632708 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-08b5f0f4-ffc9-495f-bde8-c3f43fecb17f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:18.633235 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-08b5f0f4-ffc9-495f-bde8-c3f43fecb17f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:18.634015 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-08b5f0f4-ffc9-495f-bde8-c3f43fecb17f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:18.634553 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-08b5f0f4-ffc9-495f-bde8-c3f43fecb17f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:18.635050 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-08b5f0f4-ffc9-495f-bde8-c3f43fecb17f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:18.698970 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-08b5f0f4-ffc9-495f-bde8-c3f43fecb17f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:18.707415 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-08b5f0f4-ffc9-495f-bde8-c3f43fecb17f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.086257 Sep 21 16:48:18.707983 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 672/1422] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:18 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:48:18.722132 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-286dcc7f-13c6-4163-85cd-3d750aa49c88 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:18.730330 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-286dcc7f-13c6-4163-85cd-3d750aa49c88 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.153756 Sep 21 16:48:18.730894 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 751/1423] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:18 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:19.730731 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-2eea35c9-1c6a-48b8-aa5e-7a95b5430e89 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:19.731278 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-2eea35c9-1c6a-48b8-aa5e-7a95b5430e89 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:19.738299 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2eea35c9-1c6a-48b8-aa5e-7a95b5430e89 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:19.738778 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2eea35c9-1c6a-48b8-aa5e-7a95b5430e89 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:19.739206 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2eea35c9-1c6a-48b8-aa5e-7a95b5430e89 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:19.739918 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2eea35c9-1c6a-48b8-aa5e-7a95b5430e89 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:19.740366 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2eea35c9-1c6a-48b8-aa5e-7a95b5430e89 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:19.740782 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2eea35c9-1c6a-48b8-aa5e-7a95b5430e89 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:19.753003 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c6ddaa56-f80a-49c4-a129-61df1c5a270f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:19.753610 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-c6ddaa56-f80a-49c4-a129-61df1c5a270f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:19.759942 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c6ddaa56-f80a-49c4-a129-61df1c5a270f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:19.760421 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c6ddaa56-f80a-49c4-a129-61df1c5a270f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:19.760854 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c6ddaa56-f80a-49c4-a129-61df1c5a270f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:19.761547 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c6ddaa56-f80a-49c4-a129-61df1c5a270f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:19.762005 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c6ddaa56-f80a-49c4-a129-61df1c5a270f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:19.762453 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c6ddaa56-f80a-49c4-a129-61df1c5a270f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:19.896345 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-c6ddaa56-f80a-49c4-a129-61df1c5a270f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:19.904990 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-c6ddaa56-f80a-49c4-a129-61df1c5a270f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.155812 Sep 21 16:48:19.905582 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 752/1424] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:19 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:48:20.035955 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-2eea35c9-1c6a-48b8-aa5e-7a95b5430e89 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:20.043765 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-2eea35c9-1c6a-48b8-aa5e-7a95b5430e89 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.317005 Sep 21 16:48:20.044333 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 673/1425] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:19 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:20.929599 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-be7209f7-cd1b-4f0a-b81f-51b32a6f5a7b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:20.930252 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-be7209f7-cd1b-4f0a-b81f-51b32a6f5a7b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:20.936697 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-be7209f7-cd1b-4f0a-b81f-51b32a6f5a7b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:20.937171 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-be7209f7-cd1b-4f0a-b81f-51b32a6f5a7b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:20.937603 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-be7209f7-cd1b-4f0a-b81f-51b32a6f5a7b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:20.938320 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-be7209f7-cd1b-4f0a-b81f-51b32a6f5a7b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:20.938841 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-be7209f7-cd1b-4f0a-b81f-51b32a6f5a7b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:20.939265 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-be7209f7-cd1b-4f0a-b81f-51b32a6f5a7b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:20.943213 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=100 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:48:21.066355 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-be7209f7-cd1b-4f0a-b81f-51b32a6f5a7b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:21.066548 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-ef493f45-0adc-4826-ba2e-f06e822ec013 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:21.067064 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-ef493f45-0adc-4826-ba2e-f06e822ec013 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:21.073494 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ef493f45-0adc-4826-ba2e-f06e822ec013 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:21.073976 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ef493f45-0adc-4826-ba2e-f06e822ec013 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:21.074475 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ef493f45-0adc-4826-ba2e-f06e822ec013 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:21.074597 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-be7209f7-cd1b-4f0a-b81f-51b32a6f5a7b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.149165 Sep 21 16:48:21.075157 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 753/1426] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:20 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:21.075277 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ef493f45-0adc-4826-ba2e-f06e822ec013 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:21.075611 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ef493f45-0adc-4826-ba2e-f06e822ec013 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:21.076030 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ef493f45-0adc-4826-ba2e-f06e822ec013 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:21.136213 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-ef493f45-0adc-4826-ba2e-f06e822ec013 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:21.144914 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-ef493f45-0adc-4826-ba2e-f06e822ec013 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082473 Sep 21 16:48:21.145476 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 674/1427] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:21 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:48:22.098464 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-829193b0-ae5a-470b-b450-38eec560bce7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:22.099063 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-829193b0-ae5a-470b-b450-38eec560bce7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:22.105491 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-829193b0-ae5a-470b-b450-38eec560bce7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:22.105964 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-829193b0-ae5a-470b-b450-38eec560bce7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:22.106418 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-829193b0-ae5a-470b-b450-38eec560bce7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:22.107117 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-829193b0-ae5a-470b-b450-38eec560bce7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:22.107544 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-829193b0-ae5a-470b-b450-38eec560bce7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:22.107959 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-829193b0-ae5a-470b-b450-38eec560bce7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:22.167903 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-a0178a22-d59f-42a8-97b7-17082d3c0428 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:22.168509 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-a0178a22-d59f-42a8-97b7-17082d3c0428 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:22.175009 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a0178a22-d59f-42a8-97b7-17082d3c0428 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:22.175490 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a0178a22-d59f-42a8-97b7-17082d3c0428 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:22.175918 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a0178a22-d59f-42a8-97b7-17082d3c0428 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:22.176600 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a0178a22-d59f-42a8-97b7-17082d3c0428 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:22.177046 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a0178a22-d59f-42a8-97b7-17082d3c0428 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:22.177461 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a0178a22-d59f-42a8-97b7-17082d3c0428 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:22.237822 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-a0178a22-d59f-42a8-97b7-17082d3c0428 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:22.238842 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-829193b0-ae5a-470b-b450-38eec560bce7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:22.245542 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-a0178a22-d59f-42a8-97b7-17082d3c0428 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081392 Sep 21 16:48:22.246125 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 675/1428] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:22 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:48:22.246964 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-829193b0-ae5a-470b-b450-38eec560bce7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.152365 Sep 21 16:48:22.247525 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 754/1429] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:22 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:23.269933 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-01db82d9-5bad-4843-be25-9af5b7ada83d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:23.270597 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-01db82d9-5bad-4843-be25-9af5b7ada83d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:23.270728 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-8b5fe0fb-92c0-4e4c-b66e-9ef76a890bbc tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:23.271421 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-8b5fe0fb-92c0-4e4c-b66e-9ef76a890bbc tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:23.277109 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-01db82d9-5bad-4843-be25-9af5b7ada83d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:23.277587 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-01db82d9-5bad-4843-be25-9af5b7ada83d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:23.277726 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8b5fe0fb-92c0-4e4c-b66e-9ef76a890bbc tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:23.278016 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-01db82d9-5bad-4843-be25-9af5b7ada83d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:23.278183 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8b5fe0fb-92c0-4e4c-b66e-9ef76a890bbc tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:23.278619 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8b5fe0fb-92c0-4e4c-b66e-9ef76a890bbc tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:23.278872 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-01db82d9-5bad-4843-be25-9af5b7ada83d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:23.279326 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8b5fe0fb-92c0-4e4c-b66e-9ef76a890bbc tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:23.279434 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-01db82d9-5bad-4843-be25-9af5b7ada83d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:23.279729 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-01db82d9-5bad-4843-be25-9af5b7ada83d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:23.279858 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8b5fe0fb-92c0-4e4c-b66e-9ef76a890bbc tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:23.280166 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8b5fe0fb-92c0-4e4c-b66e-9ef76a890bbc tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:23.342682 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-01db82d9-5bad-4843-be25-9af5b7ada83d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:23.350905 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-01db82d9-5bad-4843-be25-9af5b7ada83d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.085355 Sep 21 16:48:23.351704 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 676/1430] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:23 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:23.405983 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-8b5fe0fb-92c0-4e4c-b66e-9ef76a890bbc tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:23.414191 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-8b5fe0fb-92c0-4e4c-b66e-9ef76a890bbc tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.147809 Sep 21 16:48:23.414765 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 755/1431] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:23 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:48:24.373463 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-7c01d87a-6722-4ea2-b7c8-36c887399d48 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:24.374089 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-7c01d87a-6722-4ea2-b7c8-36c887399d48 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:24.380403 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7c01d87a-6722-4ea2-b7c8-36c887399d48 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:24.380880 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7c01d87a-6722-4ea2-b7c8-36c887399d48 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:24.381307 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7c01d87a-6722-4ea2-b7c8-36c887399d48 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:24.381980 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7c01d87a-6722-4ea2-b7c8-36c887399d48 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:24.382529 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7c01d87a-6722-4ea2-b7c8-36c887399d48 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:24.382959 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7c01d87a-6722-4ea2-b7c8-36c887399d48 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:24.437169 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-9fbf266c-7402-44ba-85cd-89220e5cb911 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:24.437950 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-9fbf266c-7402-44ba-85cd-89220e5cb911 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:24.444470 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9fbf266c-7402-44ba-85cd-89220e5cb911 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:24.444959 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9fbf266c-7402-44ba-85cd-89220e5cb911 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:24.445088 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-7c01d87a-6722-4ea2-b7c8-36c887399d48 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:24.445390 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9fbf266c-7402-44ba-85cd-89220e5cb911 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:24.446117 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9fbf266c-7402-44ba-85cd-89220e5cb911 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:24.446574 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9fbf266c-7402-44ba-85cd-89220e5cb911 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:24.447006 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9fbf266c-7402-44ba-85cd-89220e5cb911 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:24.452864 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-7c01d87a-6722-4ea2-b7c8-36c887399d48 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083342 Sep 21 16:48:24.453426 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 677/1432] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:24 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:24.585177 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-9fbf266c-7402-44ba-85cd-89220e5cb911 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:24.593299 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-9fbf266c-7402-44ba-85cd-89220e5cb911 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.160035 Sep 21 16:48:24.593871 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 756/1433] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:24 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:48:25.475744 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-98417c71-6fa6-48e9-9b4e-16dad75e823c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:25.476346 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-98417c71-6fa6-48e9-9b4e-16dad75e823c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:25.482791 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-98417c71-6fa6-48e9-9b4e-16dad75e823c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:25.483265 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-98417c71-6fa6-48e9-9b4e-16dad75e823c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:25.483690 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-98417c71-6fa6-48e9-9b4e-16dad75e823c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:25.484378 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-98417c71-6fa6-48e9-9b4e-16dad75e823c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:25.484826 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-98417c71-6fa6-48e9-9b4e-16dad75e823c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:25.485242 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-98417c71-6fa6-48e9-9b4e-16dad75e823c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:25.500485 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=100 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:48:25.545641 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-98417c71-6fa6-48e9-9b4e-16dad75e823c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:25.553757 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-98417c71-6fa6-48e9-9b4e-16dad75e823c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081893 Sep 21 16:48:25.554342 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 678/1434] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:25 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:25.617442 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-74535aec-5fb5-4e66-870c-01fa913c4093 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:25.618103 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-74535aec-5fb5-4e66-870c-01fa913c4093 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:25.624597 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-74535aec-5fb5-4e66-870c-01fa913c4093 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:25.625077 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-74535aec-5fb5-4e66-870c-01fa913c4093 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:25.625515 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-74535aec-5fb5-4e66-870c-01fa913c4093 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:25.626236 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-74535aec-5fb5-4e66-870c-01fa913c4093 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:25.626692 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-74535aec-5fb5-4e66-870c-01fa913c4093 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:25.627146 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-74535aec-5fb5-4e66-870c-01fa913c4093 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:25.752146 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-74535aec-5fb5-4e66-870c-01fa913c4093 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:25.760638 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-74535aec-5fb5-4e66-870c-01fa913c4093 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.147095 Sep 21 16:48:25.761197 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 757/1435] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:25 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:26.577149 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-8f50dfa2-cb0c-42d4-ad7e-51cc66e7cdaf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:26.577751 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-8f50dfa2-cb0c-42d4-ad7e-51cc66e7cdaf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:26.584428 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8f50dfa2-cb0c-42d4-ad7e-51cc66e7cdaf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:26.584901 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8f50dfa2-cb0c-42d4-ad7e-51cc66e7cdaf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:26.585331 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8f50dfa2-cb0c-42d4-ad7e-51cc66e7cdaf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:26.586006 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8f50dfa2-cb0c-42d4-ad7e-51cc66e7cdaf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:26.586482 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8f50dfa2-cb0c-42d4-ad7e-51cc66e7cdaf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:26.586896 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8f50dfa2-cb0c-42d4-ad7e-51cc66e7cdaf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:26.647287 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-8f50dfa2-cb0c-42d4-ad7e-51cc66e7cdaf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:26.654946 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-8f50dfa2-cb0c-42d4-ad7e-51cc66e7cdaf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081624 Sep 21 16:48:26.655501 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 679/1436] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:26 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:26.783397 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-a5e61b57-5a82-47bd-a9ab-98e9fe01609d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:26.784492 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-a5e61b57-5a82-47bd-a9ab-98e9fe01609d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:26.790928 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a5e61b57-5a82-47bd-a9ab-98e9fe01609d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:26.791405 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a5e61b57-5a82-47bd-a9ab-98e9fe01609d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:26.791835 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a5e61b57-5a82-47bd-a9ab-98e9fe01609d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:26.792523 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a5e61b57-5a82-47bd-a9ab-98e9fe01609d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:26.792974 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a5e61b57-5a82-47bd-a9ab-98e9fe01609d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:26.793397 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a5e61b57-5a82-47bd-a9ab-98e9fe01609d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:26.920619 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a5e61b57-5a82-47bd-a9ab-98e9fe01609d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:26.928915 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-a5e61b57-5a82-47bd-a9ab-98e9fe01609d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.149640 Sep 21 16:48:26.929516 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 758/1437] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:26 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:27.678122 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-00b959db-9d55-4d90-8aca-583600bc4509 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:27.678723 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-00b959db-9d55-4d90-8aca-583600bc4509 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:27.685083 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-00b959db-9d55-4d90-8aca-583600bc4509 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:27.685560 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-00b959db-9d55-4d90-8aca-583600bc4509 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:27.685985 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-00b959db-9d55-4d90-8aca-583600bc4509 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:27.686695 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-00b959db-9d55-4d90-8aca-583600bc4509 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:27.687137 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-00b959db-9d55-4d90-8aca-583600bc4509 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:27.687550 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-00b959db-9d55-4d90-8aca-583600bc4509 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:27.747356 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-00b959db-9d55-4d90-8aca-583600bc4509 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:27.755248 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-00b959db-9d55-4d90-8aca-583600bc4509 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.080982 Sep 21 16:48:27.756186 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 680/1438] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:27 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:27.951889 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ee4978d5-f071-4038-97fc-037b32106633 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:27.952495 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ee4978d5-f071-4038-97fc-037b32106633 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:27.959952 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ee4978d5-f071-4038-97fc-037b32106633 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:27.960520 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ee4978d5-f071-4038-97fc-037b32106633 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:27.960950 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ee4978d5-f071-4038-97fc-037b32106633 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:27.961630 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ee4978d5-f071-4038-97fc-037b32106633 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:27.962107 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ee4978d5-f071-4038-97fc-037b32106633 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:27.962527 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ee4978d5-f071-4038-97fc-037b32106633 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:28.088125 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ee4978d5-f071-4038-97fc-037b32106633 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:28.096136 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ee4978d5-f071-4038-97fc-037b32106633 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.148042 Sep 21 16:48:28.096705 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 759/1439] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:27 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:28.778704 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-cac7e323-8551-48f5-b1f1-a64a63cbed13 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:28.779257 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-cac7e323-8551-48f5-b1f1-a64a63cbed13 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:28.787887 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cac7e323-8551-48f5-b1f1-a64a63cbed13 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:28.788755 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cac7e323-8551-48f5-b1f1-a64a63cbed13 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:28.789332 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cac7e323-8551-48f5-b1f1-a64a63cbed13 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:28.790148 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cac7e323-8551-48f5-b1f1-a64a63cbed13 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:28.790601 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cac7e323-8551-48f5-b1f1-a64a63cbed13 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:28.791020 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cac7e323-8551-48f5-b1f1-a64a63cbed13 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:28.854523 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-cac7e323-8551-48f5-b1f1-a64a63cbed13 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:28.862741 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-cac7e323-8551-48f5-b1f1-a64a63cbed13 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.088047 Sep 21 16:48:28.863297 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 681/1440] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:28 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:29.118820 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-15dae156-d5f6-42fe-8f31-2fe3c45970e7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:29.119341 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-15dae156-d5f6-42fe-8f31-2fe3c45970e7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:29.125676 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-15dae156-d5f6-42fe-8f31-2fe3c45970e7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:29.126180 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-15dae156-d5f6-42fe-8f31-2fe3c45970e7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:29.126613 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-15dae156-d5f6-42fe-8f31-2fe3c45970e7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:29.127318 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-15dae156-d5f6-42fe-8f31-2fe3c45970e7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:29.127818 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-15dae156-d5f6-42fe-8f31-2fe3c45970e7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:29.128239 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-15dae156-d5f6-42fe-8f31-2fe3c45970e7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:29.252268 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-15dae156-d5f6-42fe-8f31-2fe3c45970e7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:29.260293 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-15dae156-d5f6-42fe-8f31-2fe3c45970e7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.145422 Sep 21 16:48:29.260851 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 760/1441] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:29 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:29.885190 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d5d8a7f6-5438-4c4a-bc5e-bcfb0d3e0a23 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:29.885738 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d5d8a7f6-5438-4c4a-bc5e-bcfb0d3e0a23 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:29.892114 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d5d8a7f6-5438-4c4a-bc5e-bcfb0d3e0a23 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:29.892589 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d5d8a7f6-5438-4c4a-bc5e-bcfb0d3e0a23 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:29.893016 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d5d8a7f6-5438-4c4a-bc5e-bcfb0d3e0a23 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:29.893695 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d5d8a7f6-5438-4c4a-bc5e-bcfb0d3e0a23 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:29.894171 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d5d8a7f6-5438-4c4a-bc5e-bcfb0d3e0a23 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:29.894586 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d5d8a7f6-5438-4c4a-bc5e-bcfb0d3e0a23 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:29.954011 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d5d8a7f6-5438-4c4a-bc5e-bcfb0d3e0a23 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:29.961591 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d5d8a7f6-5438-4c4a-bc5e-bcfb0d3e0a23 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.080393 Sep 21 16:48:29.962486 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 682/1442] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:29 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:30.283943 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-58479bed-4fdf-4a7b-a7b0-05e66c93eace tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:30.284562 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-58479bed-4fdf-4a7b-a7b0-05e66c93eace tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:30.291094 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-58479bed-4fdf-4a7b-a7b0-05e66c93eace tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:30.291576 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-58479bed-4fdf-4a7b-a7b0-05e66c93eace tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:30.292011 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-58479bed-4fdf-4a7b-a7b0-05e66c93eace tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:30.292704 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-58479bed-4fdf-4a7b-a7b0-05e66c93eace tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:30.293160 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-58479bed-4fdf-4a7b-a7b0-05e66c93eace tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:30.293582 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-58479bed-4fdf-4a7b-a7b0-05e66c93eace tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:30.423532 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-58479bed-4fdf-4a7b-a7b0-05e66c93eace tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:30.432317 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-58479bed-4fdf-4a7b-a7b0-05e66c93eace tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.152787 Sep 21 16:48:30.432891 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 761/1443] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:30 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:30.984112 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-4928e333-cd7b-46d4-9ee1-2a7e3b427f3d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:30.984704 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-4928e333-cd7b-46d4-9ee1-2a7e3b427f3d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:30.991060 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4928e333-cd7b-46d4-9ee1-2a7e3b427f3d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:30.991547 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4928e333-cd7b-46d4-9ee1-2a7e3b427f3d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:30.991978 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4928e333-cd7b-46d4-9ee1-2a7e3b427f3d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:30.992668 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4928e333-cd7b-46d4-9ee1-2a7e3b427f3d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:30.993119 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4928e333-cd7b-46d4-9ee1-2a7e3b427f3d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:30.993540 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4928e333-cd7b-46d4-9ee1-2a7e3b427f3d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:31.055202 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-4928e333-cd7b-46d4-9ee1-2a7e3b427f3d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:31.062753 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-4928e333-cd7b-46d4-9ee1-2a7e3b427f3d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082597 Sep 21 16:48:31.063313 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 683/1444] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:30 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:31.456865 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-6dc1f300-9f4d-4afa-bd9d-0681eee8a732 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:31.457588 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-6dc1f300-9f4d-4afa-bd9d-0681eee8a732 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:31.463908 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6dc1f300-9f4d-4afa-bd9d-0681eee8a732 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:31.464378 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6dc1f300-9f4d-4afa-bd9d-0681eee8a732 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:31.464802 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6dc1f300-9f4d-4afa-bd9d-0681eee8a732 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:31.465482 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6dc1f300-9f4d-4afa-bd9d-0681eee8a732 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:31.465929 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6dc1f300-9f4d-4afa-bd9d-0681eee8a732 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:31.466381 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6dc1f300-9f4d-4afa-bd9d-0681eee8a732 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:31.592831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-6dc1f300-9f4d-4afa-bd9d-0681eee8a732 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:31.601475 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-6dc1f300-9f4d-4afa-bd9d-0681eee8a732 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.148975 Sep 21 16:48:31.602069 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 762/1445] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:31 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:32.085705 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-77d1e2b2-7fc4-41d4-903d-5a650040476b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:32.086344 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-77d1e2b2-7fc4-41d4-903d-5a650040476b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:32.092860 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-77d1e2b2-7fc4-41d4-903d-5a650040476b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:32.093347 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-77d1e2b2-7fc4-41d4-903d-5a650040476b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:32.093783 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-77d1e2b2-7fc4-41d4-903d-5a650040476b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:32.094496 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-77d1e2b2-7fc4-41d4-903d-5a650040476b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:32.094950 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-77d1e2b2-7fc4-41d4-903d-5a650040476b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:32.095371 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-77d1e2b2-7fc4-41d4-903d-5a650040476b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:32.159777 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-77d1e2b2-7fc4-41d4-903d-5a650040476b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:32.167374 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-77d1e2b2-7fc4-41d4-903d-5a650040476b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.085538 Sep 21 16:48:32.167938 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 684/1446] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:32 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:32.625183 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c6a167be-b1be-4bb0-b675-f080294c4c08 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:32.625781 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-c6a167be-b1be-4bb0-b675-f080294c4c08 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:32.632301 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c6a167be-b1be-4bb0-b675-f080294c4c08 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:32.632785 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c6a167be-b1be-4bb0-b675-f080294c4c08 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:32.633212 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c6a167be-b1be-4bb0-b675-f080294c4c08 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:32.633925 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c6a167be-b1be-4bb0-b675-f080294c4c08 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:32.634396 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c6a167be-b1be-4bb0-b675-f080294c4c08 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:32.634817 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c6a167be-b1be-4bb0-b675-f080294c4c08 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:32.764266 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-c6a167be-b1be-4bb0-b675-f080294c4c08 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:32.773341 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-c6a167be-b1be-4bb0-b675-f080294c4c08 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.151959 Sep 21 16:48:32.773909 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 763/1447] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:32 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:33.191290 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-895fa5a0-15e6-49cf-8ff4-dc1e5a2a04ff tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:33.192030 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-895fa5a0-15e6-49cf-8ff4-dc1e5a2a04ff tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:33.198440 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-895fa5a0-15e6-49cf-8ff4-dc1e5a2a04ff tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:33.198918 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-895fa5a0-15e6-49cf-8ff4-dc1e5a2a04ff tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:33.199342 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-895fa5a0-15e6-49cf-8ff4-dc1e5a2a04ff tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:33.200034 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-895fa5a0-15e6-49cf-8ff4-dc1e5a2a04ff tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:33.200478 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-895fa5a0-15e6-49cf-8ff4-dc1e5a2a04ff tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:33.200892 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-895fa5a0-15e6-49cf-8ff4-dc1e5a2a04ff tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:33.265736 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-895fa5a0-15e6-49cf-8ff4-dc1e5a2a04ff tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:33.273922 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-895fa5a0-15e6-49cf-8ff4-dc1e5a2a04ff tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.087075 Sep 21 16:48:33.274514 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 685/1448] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:33 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:33.796894 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-a88d54cd-c841-4b96-bf4d-3dc2e78b9564 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:33.797421 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-a88d54cd-c841-4b96-bf4d-3dc2e78b9564 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:33.804341 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a88d54cd-c841-4b96-bf4d-3dc2e78b9564 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:33.804813 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a88d54cd-c841-4b96-bf4d-3dc2e78b9564 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:33.805243 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a88d54cd-c841-4b96-bf4d-3dc2e78b9564 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:33.805929 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a88d54cd-c841-4b96-bf4d-3dc2e78b9564 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:33.806401 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a88d54cd-c841-4b96-bf4d-3dc2e78b9564 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:33.806817 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a88d54cd-c841-4b96-bf4d-3dc2e78b9564 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:33.941021 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a88d54cd-c841-4b96-bf4d-3dc2e78b9564 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:33.949079 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-a88d54cd-c841-4b96-bf4d-3dc2e78b9564 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.156189 Sep 21 16:48:33.949646 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 764/1449] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:33 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:34.296446 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-b343e1d2-e0f6-4fb8-8e77-843936ccc5fb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:34.297061 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-b343e1d2-e0f6-4fb8-8e77-843936ccc5fb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:34.304003 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b343e1d2-e0f6-4fb8-8e77-843936ccc5fb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:34.304484 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b343e1d2-e0f6-4fb8-8e77-843936ccc5fb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:34.304922 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b343e1d2-e0f6-4fb8-8e77-843936ccc5fb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:34.305618 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b343e1d2-e0f6-4fb8-8e77-843936ccc5fb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:34.306101 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b343e1d2-e0f6-4fb8-8e77-843936ccc5fb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:34.306530 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b343e1d2-e0f6-4fb8-8e77-843936ccc5fb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:34.366396 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-b343e1d2-e0f6-4fb8-8e77-843936ccc5fb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:34.373905 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-b343e1d2-e0f6-4fb8-8e77-843936ccc5fb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081378 Sep 21 16:48:34.374505 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 686/1450] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:34 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:34.972693 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-8b16ebd6-df1c-431e-888e-4164e9dac55e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:34.973415 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-8b16ebd6-df1c-431e-888e-4164e9dac55e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:34.980235 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8b16ebd6-df1c-431e-888e-4164e9dac55e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:34.980713 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8b16ebd6-df1c-431e-888e-4164e9dac55e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:34.981138 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8b16ebd6-df1c-431e-888e-4164e9dac55e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:34.981823 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8b16ebd6-df1c-431e-888e-4164e9dac55e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:34.982305 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8b16ebd6-df1c-431e-888e-4164e9dac55e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:34.982727 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8b16ebd6-df1c-431e-888e-4164e9dac55e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:35.110514 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-8b16ebd6-df1c-431e-888e-4164e9dac55e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:35.119661 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-8b16ebd6-df1c-431e-888e-4164e9dac55e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.150809 Sep 21 16:48:35.120228 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 765/1451] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:34 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:35.397368 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-9b8e93ad-1bef-49f1-a016-6d2c625fecb3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:35.397912 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-9b8e93ad-1bef-49f1-a016-6d2c625fecb3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:35.404343 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9b8e93ad-1bef-49f1-a016-6d2c625fecb3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:35.404833 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9b8e93ad-1bef-49f1-a016-6d2c625fecb3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:35.405271 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9b8e93ad-1bef-49f1-a016-6d2c625fecb3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:35.405960 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9b8e93ad-1bef-49f1-a016-6d2c625fecb3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:35.406444 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9b8e93ad-1bef-49f1-a016-6d2c625fecb3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:35.406867 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9b8e93ad-1bef-49f1-a016-6d2c625fecb3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:35.467009 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-9b8e93ad-1bef-49f1-a016-6d2c625fecb3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:35.474663 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-9b8e93ad-1bef-49f1-a016-6d2c625fecb3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081809 Sep 21 16:48:35.475229 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 687/1452] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:35 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:36.143665 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-3ef57736-68b2-4281-9843-55f3923be49c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:36.144256 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-3ef57736-68b2-4281-9843-55f3923be49c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:36.150631 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3ef57736-68b2-4281-9843-55f3923be49c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:36.151105 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3ef57736-68b2-4281-9843-55f3923be49c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:36.151532 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3ef57736-68b2-4281-9843-55f3923be49c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:36.152212 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3ef57736-68b2-4281-9843-55f3923be49c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:36.152660 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3ef57736-68b2-4281-9843-55f3923be49c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:36.153081 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3ef57736-68b2-4281-9843-55f3923be49c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:36.282709 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-3ef57736-68b2-4281-9843-55f3923be49c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:36.291602 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-3ef57736-68b2-4281-9843-55f3923be49c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.151767 Sep 21 16:48:36.292182 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 766/1453] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:36 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:36.496980 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-918b0e17-c508-4c91-9b4b-c37f10d18a9c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:36.497586 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-918b0e17-c508-4c91-9b4b-c37f10d18a9c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:36.504149 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-918b0e17-c508-4c91-9b4b-c37f10d18a9c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:36.504654 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-918b0e17-c508-4c91-9b4b-c37f10d18a9c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:36.505086 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-918b0e17-c508-4c91-9b4b-c37f10d18a9c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:36.505804 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-918b0e17-c508-4c91-9b4b-c37f10d18a9c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:36.506278 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-918b0e17-c508-4c91-9b4b-c37f10d18a9c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:36.506699 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-918b0e17-c508-4c91-9b4b-c37f10d18a9c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:36.566324 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-918b0e17-c508-4c91-9b4b-c37f10d18a9c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:36.573836 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-918b0e17-c508-4c91-9b4b-c37f10d18a9c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.080677 Sep 21 16:48:36.574497 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 688/1454] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:36 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:37.315255 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-b20f7fb0-1215-4bb2-b78c-8fc29f34671b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:37.316519 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-b20f7fb0-1215-4bb2-b78c-8fc29f34671b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:37.322944 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b20f7fb0-1215-4bb2-b78c-8fc29f34671b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:37.323427 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b20f7fb0-1215-4bb2-b78c-8fc29f34671b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:37.323864 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b20f7fb0-1215-4bb2-b78c-8fc29f34671b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:37.324557 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b20f7fb0-1215-4bb2-b78c-8fc29f34671b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:37.325014 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b20f7fb0-1215-4bb2-b78c-8fc29f34671b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:37.325440 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b20f7fb0-1215-4bb2-b78c-8fc29f34671b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:37.451207 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-b20f7fb0-1215-4bb2-b78c-8fc29f34671b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:37.459666 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-b20f7fb0-1215-4bb2-b78c-8fc29f34671b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.148281 Sep 21 16:48:37.460319 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 767/1455] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:37 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:37.598821 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d6a72c76-9ab0-46af-b96e-18fc84b79abd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:37.599424 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d6a72c76-9ab0-46af-b96e-18fc84b79abd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:37.605264 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d6a72c76-9ab0-46af-b96e-18fc84b79abd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:37.605738 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d6a72c76-9ab0-46af-b96e-18fc84b79abd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:37.606202 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d6a72c76-9ab0-46af-b96e-18fc84b79abd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:37.606879 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d6a72c76-9ab0-46af-b96e-18fc84b79abd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:37.607323 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d6a72c76-9ab0-46af-b96e-18fc84b79abd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:37.607738 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d6a72c76-9ab0-46af-b96e-18fc84b79abd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:37.672230 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d6a72c76-9ab0-46af-b96e-18fc84b79abd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:37.680373 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d6a72c76-9ab0-46af-b96e-18fc84b79abd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.086122 Sep 21 16:48:37.680933 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 689/1456] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:37 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:38.482899 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-fff28ac5-5deb-4324-85b8-4c8143b0db99 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:38.483521 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-fff28ac5-5deb-4324-85b8-4c8143b0db99 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:38.489972 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fff28ac5-5deb-4324-85b8-4c8143b0db99 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:38.490482 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fff28ac5-5deb-4324-85b8-4c8143b0db99 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:38.490914 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fff28ac5-5deb-4324-85b8-4c8143b0db99 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:38.491604 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fff28ac5-5deb-4324-85b8-4c8143b0db99 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:38.492059 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fff28ac5-5deb-4324-85b8-4c8143b0db99 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:38.492476 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fff28ac5-5deb-4324-85b8-4c8143b0db99 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:38.621627 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-fff28ac5-5deb-4324-85b8-4c8143b0db99 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:38.630293 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-fff28ac5-5deb-4324-85b8-4c8143b0db99 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.151280 Sep 21 16:48:38.630857 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 768/1457] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:38 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:38.702278 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-e55929f5-d566-411b-88cf-f37e0ebd203b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:38.702938 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-e55929f5-d566-411b-88cf-f37e0ebd203b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:38.710204 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e55929f5-d566-411b-88cf-f37e0ebd203b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:38.710691 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e55929f5-d566-411b-88cf-f37e0ebd203b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:38.711123 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e55929f5-d566-411b-88cf-f37e0ebd203b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:38.711812 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e55929f5-d566-411b-88cf-f37e0ebd203b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:38.712263 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e55929f5-d566-411b-88cf-f37e0ebd203b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:38.712682 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e55929f5-d566-411b-88cf-f37e0ebd203b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:38.771969 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-e55929f5-d566-411b-88cf-f37e0ebd203b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:38.779665 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-e55929f5-d566-411b-88cf-f37e0ebd203b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081213 Sep 21 16:48:38.780231 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 690/1458] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:38 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:39.654064 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-47c452c2-1b60-4457-bbe9-1d75a6b48eb3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:39.654703 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-47c452c2-1b60-4457-bbe9-1d75a6b48eb3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:39.661294 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-47c452c2-1b60-4457-bbe9-1d75a6b48eb3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:39.661780 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-47c452c2-1b60-4457-bbe9-1d75a6b48eb3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:39.662243 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-47c452c2-1b60-4457-bbe9-1d75a6b48eb3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:39.662940 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-47c452c2-1b60-4457-bbe9-1d75a6b48eb3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:39.663395 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-47c452c2-1b60-4457-bbe9-1d75a6b48eb3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:39.663822 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-47c452c2-1b60-4457-bbe9-1d75a6b48eb3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:39.788328 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-47c452c2-1b60-4457-bbe9-1d75a6b48eb3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:39.791699 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=100 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:48:39.797641 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-47c452c2-1b60-4457-bbe9-1d75a6b48eb3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.147344 Sep 21 16:48:39.798245 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 769/1459] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:39 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:39.802440 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-fd42f6d5-9c36-4f29-9f44-7fabce6176f0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:39.803066 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-fd42f6d5-9c36-4f29-9f44-7fabce6176f0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:39.810598 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fd42f6d5-9c36-4f29-9f44-7fabce6176f0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:39.811087 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fd42f6d5-9c36-4f29-9f44-7fabce6176f0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:39.811523 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fd42f6d5-9c36-4f29-9f44-7fabce6176f0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:39.812220 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fd42f6d5-9c36-4f29-9f44-7fabce6176f0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:39.812671 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fd42f6d5-9c36-4f29-9f44-7fabce6176f0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:39.813086 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fd42f6d5-9c36-4f29-9f44-7fabce6176f0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:39.873458 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-fd42f6d5-9c36-4f29-9f44-7fabce6176f0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:39.881584 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-fd42f6d5-9c36-4f29-9f44-7fabce6176f0 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082950 Sep 21 16:48:39.882178 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 691/1460] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:39 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:48:40.825813 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ad4bfed2-140e-4f95-8093-31d38d5c0c42 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:40.826459 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ad4bfed2-140e-4f95-8093-31d38d5c0c42 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:40.833523 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ad4bfed2-140e-4f95-8093-31d38d5c0c42 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:40.834005 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ad4bfed2-140e-4f95-8093-31d38d5c0c42 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:40.834473 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ad4bfed2-140e-4f95-8093-31d38d5c0c42 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:40.835168 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ad4bfed2-140e-4f95-8093-31d38d5c0c42 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:40.835618 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ad4bfed2-140e-4f95-8093-31d38d5c0c42 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:40.836038 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ad4bfed2-140e-4f95-8093-31d38d5c0c42 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:40.905087 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-919af1a2-8135-42df-9333-c40a8a187e7a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:40.905761 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-919af1a2-8135-42df-9333-c40a8a187e7a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:40.912881 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-919af1a2-8135-42df-9333-c40a8a187e7a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:40.913234 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-919af1a2-8135-42df-9333-c40a8a187e7a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:40.913678 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-919af1a2-8135-42df-9333-c40a8a187e7a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:40.914407 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-919af1a2-8135-42df-9333-c40a8a187e7a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:40.914862 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-919af1a2-8135-42df-9333-c40a8a187e7a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:40.915285 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-919af1a2-8135-42df-9333-c40a8a187e7a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:40.968290 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ad4bfed2-140e-4f95-8093-31d38d5c0c42 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:40.977298 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ad4bfed2-140e-4f95-8093-31d38d5c0c42 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.155282 Sep 21 16:48:40.977797 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-919af1a2-8135-42df-9333-c40a8a187e7a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:40.977948 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 770/1461] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:40 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:40.985751 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-919af1a2-8135-42df-9333-c40a8a187e7a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.084713 Sep 21 16:48:40.986343 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 692/1462] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:40 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:48:42.000696 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-206236a8-6024-42c8-89c2-14c26f624db5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:42.001311 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-206236a8-6024-42c8-89c2-14c26f624db5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:42.004263 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_api:SELECT=52 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:48:42.009254 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-3fecaae7-2bda-4e53-afb8-81cff0504afe tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:42.009865 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-3fecaae7-2bda-4e53-afb8-81cff0504afe tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:42.010071 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-206236a8-6024-42c8-89c2-14c26f624db5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:42.010566 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-206236a8-6024-42c8-89c2-14c26f624db5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:42.011000 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-206236a8-6024-42c8-89c2-14c26f624db5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:42.011697 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-206236a8-6024-42c8-89c2-14c26f624db5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:42.012153 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-206236a8-6024-42c8-89c2-14c26f624db5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:42.012581 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-206236a8-6024-42c8-89c2-14c26f624db5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:42.015761 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3fecaae7-2bda-4e53-afb8-81cff0504afe tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:42.016237 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3fecaae7-2bda-4e53-afb8-81cff0504afe tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:42.016662 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3fecaae7-2bda-4e53-afb8-81cff0504afe tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:42.017347 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3fecaae7-2bda-4e53-afb8-81cff0504afe tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:42.017806 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3fecaae7-2bda-4e53-afb8-81cff0504afe tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:42.018248 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3fecaae7-2bda-4e53-afb8-81cff0504afe tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:42.081156 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-3fecaae7-2bda-4e53-afb8-81cff0504afe tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:42.088827 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-3fecaae7-2bda-4e53-afb8-81cff0504afe tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.084019 Sep 21 16:48:42.089387 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 693/1463] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:42 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:48:42.141012 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-206236a8-6024-42c8-89c2-14c26f624db5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:42.149075 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-206236a8-6024-42c8-89c2-14c26f624db5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.152289 Sep 21 16:48:42.149637 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 771/1464] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:41 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:43.111595 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-95cf740d-92ba-43ba-a7a5-122e40d25887 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:43.112228 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-95cf740d-92ba-43ba-a7a5-122e40d25887 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:43.118784 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-95cf740d-92ba-43ba-a7a5-122e40d25887 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:43.119268 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-95cf740d-92ba-43ba-a7a5-122e40d25887 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:43.119702 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-95cf740d-92ba-43ba-a7a5-122e40d25887 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:43.120392 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-95cf740d-92ba-43ba-a7a5-122e40d25887 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:43.120850 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-95cf740d-92ba-43ba-a7a5-122e40d25887 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:43.121271 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-95cf740d-92ba-43ba-a7a5-122e40d25887 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:43.172401 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-407eb7e2-5949-421f-8692-476367cf8757 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:43.173010 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-407eb7e2-5949-421f-8692-476367cf8757 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:43.179730 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-407eb7e2-5949-421f-8692-476367cf8757 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:43.180278 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-407eb7e2-5949-421f-8692-476367cf8757 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:43.180777 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-407eb7e2-5949-421f-8692-476367cf8757 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:43.181228 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-95cf740d-92ba-43ba-a7a5-122e40d25887 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:43.181625 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-407eb7e2-5949-421f-8692-476367cf8757 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:43.182199 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-407eb7e2-5949-421f-8692-476367cf8757 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:43.182691 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-407eb7e2-5949-421f-8692-476367cf8757 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:43.188956 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-95cf740d-92ba-43ba-a7a5-122e40d25887 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081216 Sep 21 16:48:43.189525 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 694/1465] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:43 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:43.308941 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-407eb7e2-5949-421f-8692-476367cf8757 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:43.318613 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-407eb7e2-5949-421f-8692-476367cf8757 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.150149 Sep 21 16:48:43.319190 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 772/1466] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:43 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:48:44.212818 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-a599bacf-202d-48cc-931c-615b7b97970c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:44.213440 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-a599bacf-202d-48cc-931c-615b7b97970c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:44.219845 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a599bacf-202d-48cc-931c-615b7b97970c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:44.220328 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a599bacf-202d-48cc-931c-615b7b97970c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:44.220772 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a599bacf-202d-48cc-931c-615b7b97970c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:44.221456 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a599bacf-202d-48cc-931c-615b7b97970c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:44.221941 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a599bacf-202d-48cc-931c-615b7b97970c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:44.222960 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a599bacf-202d-48cc-931c-615b7b97970c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:44.225504 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=100 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:48:44.283000 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-a599bacf-202d-48cc-931c-615b7b97970c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:44.291540 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-a599bacf-202d-48cc-931c-615b7b97970c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082604 Sep 21 16:48:44.292109 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 695/1467] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:44 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:44.341145 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-bbe90250-da87-4fe0-8f1d-c9e579976162 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:44.341755 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-bbe90250-da87-4fe0-8f1d-c9e579976162 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:44.348232 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bbe90250-da87-4fe0-8f1d-c9e579976162 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:44.348708 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bbe90250-da87-4fe0-8f1d-c9e579976162 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:44.349134 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bbe90250-da87-4fe0-8f1d-c9e579976162 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:44.349822 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bbe90250-da87-4fe0-8f1d-c9e579976162 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:44.350301 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bbe90250-da87-4fe0-8f1d-c9e579976162 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:44.350725 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bbe90250-da87-4fe0-8f1d-c9e579976162 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:44.481880 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-bbe90250-da87-4fe0-8f1d-c9e579976162 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:44.489958 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-bbe90250-da87-4fe0-8f1d-c9e579976162 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.152610 Sep 21 16:48:44.490566 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 773/1468] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:44 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:45.314216 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-92d97425-b797-4ce0-bbd3-9a59af58092a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:45.314830 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-92d97425-b797-4ce0-bbd3-9a59af58092a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:45.317103 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_api:SELECT=56 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:48:45.322296 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-92d97425-b797-4ce0-bbd3-9a59af58092a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:45.322775 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-92d97425-b797-4ce0-bbd3-9a59af58092a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:45.323239 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-92d97425-b797-4ce0-bbd3-9a59af58092a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:45.323927 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-92d97425-b797-4ce0-bbd3-9a59af58092a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:45.324379 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-92d97425-b797-4ce0-bbd3-9a59af58092a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:45.324798 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-92d97425-b797-4ce0-bbd3-9a59af58092a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:45.387355 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-92d97425-b797-4ce0-bbd3-9a59af58092a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:45.395117 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-92d97425-b797-4ce0-bbd3-9a59af58092a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.084796 Sep 21 16:48:45.395679 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 696/1469] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:45 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:45.512713 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-5d4615dd-05e1-4b36-8059-1241dab65d67 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:45.513322 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-5d4615dd-05e1-4b36-8059-1241dab65d67 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:45.520237 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5d4615dd-05e1-4b36-8059-1241dab65d67 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:45.520715 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5d4615dd-05e1-4b36-8059-1241dab65d67 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:45.521144 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5d4615dd-05e1-4b36-8059-1241dab65d67 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:45.521824 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5d4615dd-05e1-4b36-8059-1241dab65d67 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:45.522296 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5d4615dd-05e1-4b36-8059-1241dab65d67 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:45.522713 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5d4615dd-05e1-4b36-8059-1241dab65d67 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:45.646684 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5d4615dd-05e1-4b36-8059-1241dab65d67 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:45.654722 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-5d4615dd-05e1-4b36-8059-1241dab65d67 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.145960 Sep 21 16:48:45.655289 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 774/1470] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:45 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:46.418297 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-9840860f-88f4-4349-a88b-ef475d60fd66 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:46.418914 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-9840860f-88f4-4349-a88b-ef475d60fd66 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:46.425361 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9840860f-88f4-4349-a88b-ef475d60fd66 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:46.425846 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9840860f-88f4-4349-a88b-ef475d60fd66 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:46.426307 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9840860f-88f4-4349-a88b-ef475d60fd66 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:46.427002 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9840860f-88f4-4349-a88b-ef475d60fd66 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:46.427457 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9840860f-88f4-4349-a88b-ef475d60fd66 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:46.427882 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9840860f-88f4-4349-a88b-ef475d60fd66 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:46.490579 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-9840860f-88f4-4349-a88b-ef475d60fd66 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:46.498240 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-9840860f-88f4-4349-a88b-ef475d60fd66 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083890 Sep 21 16:48:46.498805 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 697/1471] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:46 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:46.678215 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-9425f6b8-ccde-4532-ac79-3bc345a78475 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:46.678757 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-9425f6b8-ccde-4532-ac79-3bc345a78475 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:46.685077 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9425f6b8-ccde-4532-ac79-3bc345a78475 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:46.685553 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9425f6b8-ccde-4532-ac79-3bc345a78475 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:46.685978 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9425f6b8-ccde-4532-ac79-3bc345a78475 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:46.686687 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9425f6b8-ccde-4532-ac79-3bc345a78475 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:46.687132 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9425f6b8-ccde-4532-ac79-3bc345a78475 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:46.687550 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9425f6b8-ccde-4532-ac79-3bc345a78475 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:46.816757 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-9425f6b8-ccde-4532-ac79-3bc345a78475 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:46.824849 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-9425f6b8-ccde-4532-ac79-3bc345a78475 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.150585 Sep 21 16:48:46.825418 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 775/1472] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:46 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:47.520633 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-bd73578f-d273-4bd3-91b8-959c5bd3c290 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:47.521244 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-bd73578f-d273-4bd3-91b8-959c5bd3c290 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:47.527755 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bd73578f-d273-4bd3-91b8-959c5bd3c290 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:47.528232 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bd73578f-d273-4bd3-91b8-959c5bd3c290 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:47.528680 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bd73578f-d273-4bd3-91b8-959c5bd3c290 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:47.529354 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bd73578f-d273-4bd3-91b8-959c5bd3c290 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:47.529804 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bd73578f-d273-4bd3-91b8-959c5bd3c290 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:47.530259 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bd73578f-d273-4bd3-91b8-959c5bd3c290 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:47.590323 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-bd73578f-d273-4bd3-91b8-959c5bd3c290 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:47.598426 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-bd73578f-d273-4bd3-91b8-959c5bd3c290 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081670 Sep 21 16:48:47.598992 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 698/1473] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:47 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:47.848814 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-1a457909-f77e-48f0-aa10-3b62aef7881c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:47.849359 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-1a457909-f77e-48f0-aa10-3b62aef7881c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:47.855886 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1a457909-f77e-48f0-aa10-3b62aef7881c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:47.856363 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1a457909-f77e-48f0-aa10-3b62aef7881c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:47.856795 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1a457909-f77e-48f0-aa10-3b62aef7881c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:47.857483 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1a457909-f77e-48f0-aa10-3b62aef7881c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:47.857933 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1a457909-f77e-48f0-aa10-3b62aef7881c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:47.858379 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1a457909-f77e-48f0-aa10-3b62aef7881c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:47.983135 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-1a457909-f77e-48f0-aa10-3b62aef7881c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:47.991270 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-1a457909-f77e-48f0-aa10-3b62aef7881c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.147091 Sep 21 16:48:47.991840 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 776/1474] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:47 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:48.622665 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-66ae6125-c4e4-4ff3-9ba6-666a4eec8bc1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:48.623377 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-66ae6125-c4e4-4ff3-9ba6-666a4eec8bc1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:48.630436 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-66ae6125-c4e4-4ff3-9ba6-666a4eec8bc1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:48.630971 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-66ae6125-c4e4-4ff3-9ba6-666a4eec8bc1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:48.631405 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-66ae6125-c4e4-4ff3-9ba6-666a4eec8bc1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:48.632088 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-66ae6125-c4e4-4ff3-9ba6-666a4eec8bc1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:48.632535 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-66ae6125-c4e4-4ff3-9ba6-666a4eec8bc1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:48.632954 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-66ae6125-c4e4-4ff3-9ba6-666a4eec8bc1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:48.692780 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-66ae6125-c4e4-4ff3-9ba6-666a4eec8bc1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:48.700872 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-66ae6125-c4e4-4ff3-9ba6-666a4eec8bc1 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082667 Sep 21 16:48:48.701436 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 699/1475] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:48 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:49.014162 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-973bff9e-3d77-4e7d-ace2-07d77895e174 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:49.014816 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-973bff9e-3d77-4e7d-ace2-07d77895e174 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:49.021212 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-973bff9e-3d77-4e7d-ace2-07d77895e174 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:49.021692 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-973bff9e-3d77-4e7d-ace2-07d77895e174 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:49.022141 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-973bff9e-3d77-4e7d-ace2-07d77895e174 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:49.022830 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-973bff9e-3d77-4e7d-ace2-07d77895e174 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:49.023278 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-973bff9e-3d77-4e7d-ace2-07d77895e174 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:49.023698 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-973bff9e-3d77-4e7d-ace2-07d77895e174 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:49.148719 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-973bff9e-3d77-4e7d-ace2-07d77895e174 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:49.156879 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-973bff9e-3d77-4e7d-ace2-07d77895e174 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.146607 Sep 21 16:48:49.157442 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 777/1476] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:49 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:48:49.724453 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-7d07e2bc-f790-4b3b-b3bd-12ea6ddaa3f6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:49.724990 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-7d07e2bc-f790-4b3b-b3bd-12ea6ddaa3f6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:49.731425 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7d07e2bc-f790-4b3b-b3bd-12ea6ddaa3f6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:49.731903 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7d07e2bc-f790-4b3b-b3bd-12ea6ddaa3f6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:49.732367 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7d07e2bc-f790-4b3b-b3bd-12ea6ddaa3f6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:49.733052 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7d07e2bc-f790-4b3b-b3bd-12ea6ddaa3f6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:49.733511 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7d07e2bc-f790-4b3b-b3bd-12ea6ddaa3f6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:49.733927 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7d07e2bc-f790-4b3b-b3bd-12ea6ddaa3f6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:49.794600 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-7d07e2bc-f790-4b3b-b3bd-12ea6ddaa3f6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:49.802137 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-7d07e2bc-f790-4b3b-b3bd-12ea6ddaa3f6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081564 Sep 21 16:48:49.802705 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 700/1477] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:49 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:50.180314 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-a2be75a1-7053-4829-9222-edef42f2921d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:50.180921 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-a2be75a1-7053-4829-9222-edef42f2921d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:50.187332 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a2be75a1-7053-4829-9222-edef42f2921d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:50.187811 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a2be75a1-7053-4829-9222-edef42f2921d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:50.188239 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a2be75a1-7053-4829-9222-edef42f2921d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:50.188925 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a2be75a1-7053-4829-9222-edef42f2921d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:50.189371 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a2be75a1-7053-4829-9222-edef42f2921d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:50.189787 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a2be75a1-7053-4829-9222-edef42f2921d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:50.318759 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a2be75a1-7053-4829-9222-edef42f2921d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:50.326815 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-a2be75a1-7053-4829-9222-edef42f2921d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.150447 Sep 21 16:48:50.327390 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 778/1478] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:50 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:50.825157 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-17e9342c-a8f5-49d9-928b-769a081c66fd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:50.825717 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-17e9342c-a8f5-49d9-928b-769a081c66fd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:50.832470 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-17e9342c-a8f5-49d9-928b-769a081c66fd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:50.832954 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-17e9342c-a8f5-49d9-928b-769a081c66fd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:50.833385 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-17e9342c-a8f5-49d9-928b-769a081c66fd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:50.834172 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-17e9342c-a8f5-49d9-928b-769a081c66fd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:50.834691 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-17e9342c-a8f5-49d9-928b-769a081c66fd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:50.835106 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-17e9342c-a8f5-49d9-928b-769a081c66fd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:50.897915 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-17e9342c-a8f5-49d9-928b-769a081c66fd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:50.905586 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-17e9342c-a8f5-49d9-928b-769a081c66fd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.084392 Sep 21 16:48:50.906177 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 701/1479] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:50 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:51.349199 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-a7dbd480-3542-4d3d-ac00-704b7e9af14e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:51.349815 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-a7dbd480-3542-4d3d-ac00-704b7e9af14e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:51.356327 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a7dbd480-3542-4d3d-ac00-704b7e9af14e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:51.356829 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a7dbd480-3542-4d3d-ac00-704b7e9af14e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:51.357254 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a7dbd480-3542-4d3d-ac00-704b7e9af14e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:51.357949 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a7dbd480-3542-4d3d-ac00-704b7e9af14e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:51.358433 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a7dbd480-3542-4d3d-ac00-704b7e9af14e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:51.358858 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a7dbd480-3542-4d3d-ac00-704b7e9af14e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:51.485900 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a7dbd480-3542-4d3d-ac00-704b7e9af14e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:51.496020 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-a7dbd480-3542-4d3d-ac00-704b7e9af14e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.150743 Sep 21 16:48:51.496591 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 779/1480] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:51 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:51.928630 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-49195166-5765-43ac-8ae1-06cdaefe8159 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:51.929247 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-49195166-5765-43ac-8ae1-06cdaefe8159 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:51.935837 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-49195166-5765-43ac-8ae1-06cdaefe8159 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:51.936268 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-49195166-5765-43ac-8ae1-06cdaefe8159 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:51.936706 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-49195166-5765-43ac-8ae1-06cdaefe8159 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:51.937401 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-49195166-5765-43ac-8ae1-06cdaefe8159 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:51.937855 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-49195166-5765-43ac-8ae1-06cdaefe8159 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:51.938303 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-49195166-5765-43ac-8ae1-06cdaefe8159 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:52.001568 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-49195166-5765-43ac-8ae1-06cdaefe8159 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:52.009780 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-49195166-5765-43ac-8ae1-06cdaefe8159 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.085613 Sep 21 16:48:52.010372 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 702/1481] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:51 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:52.519502 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-e52fe707-35f2-40ca-8757-0a0eeb70aa7d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:52.520630 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-e52fe707-35f2-40ca-8757-0a0eeb70aa7d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:52.527099 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e52fe707-35f2-40ca-8757-0a0eeb70aa7d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:52.527581 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e52fe707-35f2-40ca-8757-0a0eeb70aa7d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:52.528018 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e52fe707-35f2-40ca-8757-0a0eeb70aa7d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:52.528709 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e52fe707-35f2-40ca-8757-0a0eeb70aa7d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:52.529192 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e52fe707-35f2-40ca-8757-0a0eeb70aa7d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:52.529616 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e52fe707-35f2-40ca-8757-0a0eeb70aa7d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:52.659654 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-e52fe707-35f2-40ca-8757-0a0eeb70aa7d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:52.667896 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-e52fe707-35f2-40ca-8757-0a0eeb70aa7d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.152269 Sep 21 16:48:52.668466 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 780/1482] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:52 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:53.032808 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-abcf715c-4eb1-4dd8-9580-1cb2d449a384 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:53.033451 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-abcf715c-4eb1-4dd8-9580-1cb2d449a384 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:53.040547 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-abcf715c-4eb1-4dd8-9580-1cb2d449a384 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:53.041033 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-abcf715c-4eb1-4dd8-9580-1cb2d449a384 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:53.041471 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-abcf715c-4eb1-4dd8-9580-1cb2d449a384 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:53.042200 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-abcf715c-4eb1-4dd8-9580-1cb2d449a384 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:53.042658 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-abcf715c-4eb1-4dd8-9580-1cb2d449a384 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:53.043085 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-abcf715c-4eb1-4dd8-9580-1cb2d449a384 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:53.103187 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-abcf715c-4eb1-4dd8-9580-1cb2d449a384 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:53.110842 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-abcf715c-4eb1-4dd8-9580-1cb2d449a384 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081915 Sep 21 16:48:53.111415 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 703/1483] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:53 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:53.693153 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ff8cca58-3294-449b-8cac-ba971721e30a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:53.693772 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ff8cca58-3294-449b-8cac-ba971721e30a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:53.700442 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ff8cca58-3294-449b-8cac-ba971721e30a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:53.700920 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ff8cca58-3294-449b-8cac-ba971721e30a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:53.701346 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ff8cca58-3294-449b-8cac-ba971721e30a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:53.702025 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ff8cca58-3294-449b-8cac-ba971721e30a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:53.702494 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ff8cca58-3294-449b-8cac-ba971721e30a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:53.702911 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ff8cca58-3294-449b-8cac-ba971721e30a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:53.828672 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ff8cca58-3294-449b-8cac-ba971721e30a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:53.837129 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ff8cca58-3294-449b-8cac-ba971721e30a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.149773 Sep 21 16:48:53.837697 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 781/1484] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:53 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:54.133705 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-f3f3219c-7c08-4482-bfe0-c0166066f8a2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:54.134272 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-f3f3219c-7c08-4482-bfe0-c0166066f8a2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:54.140735 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f3f3219c-7c08-4482-bfe0-c0166066f8a2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:54.141208 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f3f3219c-7c08-4482-bfe0-c0166066f8a2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:54.141635 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f3f3219c-7c08-4482-bfe0-c0166066f8a2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:54.142349 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f3f3219c-7c08-4482-bfe0-c0166066f8a2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:54.142795 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f3f3219c-7c08-4482-bfe0-c0166066f8a2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:54.143211 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f3f3219c-7c08-4482-bfe0-c0166066f8a2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:54.202672 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-f3f3219c-7c08-4482-bfe0-c0166066f8a2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:54.210997 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-f3f3219c-7c08-4482-bfe0-c0166066f8a2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081746 Sep 21 16:48:54.211553 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 704/1485] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:54 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:54.860713 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-125446e2-936e-4bb1-a383-d71a164e19b1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:54.861289 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-125446e2-936e-4bb1-a383-d71a164e19b1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:54.867666 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-125446e2-936e-4bb1-a383-d71a164e19b1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:54.868142 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-125446e2-936e-4bb1-a383-d71a164e19b1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:54.868571 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-125446e2-936e-4bb1-a383-d71a164e19b1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:54.869263 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-125446e2-936e-4bb1-a383-d71a164e19b1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:54.869712 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-125446e2-936e-4bb1-a383-d71a164e19b1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:54.870162 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-125446e2-936e-4bb1-a383-d71a164e19b1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:55.015564 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-125446e2-936e-4bb1-a383-d71a164e19b1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:55.024474 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-125446e2-936e-4bb1-a383-d71a164e19b1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.167815 Sep 21 16:48:55.025042 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 782/1486] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:54 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:55.234923 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-043e301d-3b91-497c-aad9-447ee7fa9183 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:55.235522 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-043e301d-3b91-497c-aad9-447ee7fa9183 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:55.241924 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-043e301d-3b91-497c-aad9-447ee7fa9183 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:55.242432 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-043e301d-3b91-497c-aad9-447ee7fa9183 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:55.242862 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-043e301d-3b91-497c-aad9-447ee7fa9183 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:55.243544 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-043e301d-3b91-497c-aad9-447ee7fa9183 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:55.243989 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-043e301d-3b91-497c-aad9-447ee7fa9183 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:55.244405 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-043e301d-3b91-497c-aad9-447ee7fa9183 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:55.307929 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-043e301d-3b91-497c-aad9-447ee7fa9183 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:55.315984 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-043e301d-3b91-497c-aad9-447ee7fa9183 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.085380 Sep 21 16:48:55.316550 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 705/1487] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:55 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:56.048820 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-108295bf-25ec-4770-82a7-32b781f1fbbd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:56.049464 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-108295bf-25ec-4770-82a7-32b781f1fbbd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:56.056381 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-108295bf-25ec-4770-82a7-32b781f1fbbd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:56.056859 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-108295bf-25ec-4770-82a7-32b781f1fbbd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:56.057287 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-108295bf-25ec-4770-82a7-32b781f1fbbd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:56.057968 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-108295bf-25ec-4770-82a7-32b781f1fbbd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:56.059041 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-108295bf-25ec-4770-82a7-32b781f1fbbd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:56.059470 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-108295bf-25ec-4770-82a7-32b781f1fbbd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:56.184160 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-108295bf-25ec-4770-82a7-32b781f1fbbd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:56.192905 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-108295bf-25ec-4770-82a7-32b781f1fbbd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.147387 Sep 21 16:48:56.193482 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 783/1488] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:56 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:56.339230 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-7271889d-69a4-4ec0-94ae-322d4ed0b540 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:56.339778 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-7271889d-69a4-4ec0-94ae-322d4ed0b540 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:56.346136 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7271889d-69a4-4ec0-94ae-322d4ed0b540 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:56.346614 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7271889d-69a4-4ec0-94ae-322d4ed0b540 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:56.347044 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7271889d-69a4-4ec0-94ae-322d4ed0b540 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:56.347728 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7271889d-69a4-4ec0-94ae-322d4ed0b540 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:56.348206 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7271889d-69a4-4ec0-94ae-322d4ed0b540 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:56.348640 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7271889d-69a4-4ec0-94ae-322d4ed0b540 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:56.408165 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-7271889d-69a4-4ec0-94ae-322d4ed0b540 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:56.416316 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-7271889d-69a4-4ec0-94ae-322d4ed0b540 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.080990 Sep 21 16:48:56.416873 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 706/1489] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:56 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:57.216297 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-016f7d53-8945-44a2-8bd5-2b99d721da23 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:57.216918 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-016f7d53-8945-44a2-8bd5-2b99d721da23 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:57.223347 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-016f7d53-8945-44a2-8bd5-2b99d721da23 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:57.223830 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-016f7d53-8945-44a2-8bd5-2b99d721da23 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:57.224261 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-016f7d53-8945-44a2-8bd5-2b99d721da23 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:57.224952 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-016f7d53-8945-44a2-8bd5-2b99d721da23 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:57.225403 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-016f7d53-8945-44a2-8bd5-2b99d721da23 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:57.225823 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-016f7d53-8945-44a2-8bd5-2b99d721da23 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:57.353206 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-016f7d53-8945-44a2-8bd5-2b99d721da23 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:57.361465 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-016f7d53-8945-44a2-8bd5-2b99d721da23 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1558 microversion: 2.1 time: 0.149186 Sep 21 16:48:57.362071 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 784/1490] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:57 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:57.439478 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-406d1104-feec-46c8-93da-968fbbda64dd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:57.440192 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-406d1104-feec-46c8-93da-968fbbda64dd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:57.447247 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-406d1104-feec-46c8-93da-968fbbda64dd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:57.447732 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-406d1104-feec-46c8-93da-968fbbda64dd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:57.448169 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-406d1104-feec-46c8-93da-968fbbda64dd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:57.448868 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-406d1104-feec-46c8-93da-968fbbda64dd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:57.449322 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-406d1104-feec-46c8-93da-968fbbda64dd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:57.449777 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-406d1104-feec-46c8-93da-968fbbda64dd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:57.516696 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-406d1104-feec-46c8-93da-968fbbda64dd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:57.524958 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-406d1104-feec-46c8-93da-968fbbda64dd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.089395 Sep 21 16:48:57.525546 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 707/1491] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:57 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:57.686824 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-30ba716d-d1e0-4a5c-9022-e3b69ae83d42 req-7a0fa631-5e2b-4d58-a3e3-2e1294e74ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0026951-8625-4521-a6fa-7583577348db", "name": "network-vif-deleted", "tag": "54ef679b-81ed-4fd8-a6cf-2aa173c9cb98"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 16:48:57.697147 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-30ba716d-d1e0-4a5c-9022-e3b69ae83d42 req-7a0fa631-5e2b-4d58-a3e3-2e1294e74ca2 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:57.697660 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-30ba716d-d1e0-4a5c-9022-e3b69ae83d42 req-7a0fa631-5e2b-4d58-a3e3-2e1294e74ca2 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:57.698111 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-30ba716d-d1e0-4a5c-9022-e3b69ae83d42 req-7a0fa631-5e2b-4d58-a3e3-2e1294e74ca2 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:57.709848 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-30ba716d-d1e0-4a5c-9022-e3b69ae83d42 req-7a0fa631-5e2b-4d58-a3e3-2e1294e74ca2 service nova] Creating event network-vif-deleted:54ef679b-81ed-4fd8-a6cf-2aa173c9cb98 for instance f0026951-8625-4521-a6fa-7583577348db on hv-cinder-85862 Sep 21 16:48:57.715949 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-30ba716d-d1e0-4a5c-9022-e3b69ae83d42 req-7a0fa631-5e2b-4d58-a3e3-2e1294e74ca2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032775 Sep 21 16:48:57.716582 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 785/1492] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 16:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 16:48:58.385213 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d1d2d936-9095-4338-b5c2-e714af020927 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:58.385817 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d1d2d936-9095-4338-b5c2-e714af020927 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:58.391693 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d1d2d936-9095-4338-b5c2-e714af020927 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:58.392167 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d1d2d936-9095-4338-b5c2-e714af020927 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:58.392595 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d1d2d936-9095-4338-b5c2-e714af020927 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:58.393269 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d1d2d936-9095-4338-b5c2-e714af020927 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:58.393716 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d1d2d936-9095-4338-b5c2-e714af020927 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:58.394152 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d1d2d936-9095-4338-b5c2-e714af020927 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:58.456851 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d1d2d936-9095-4338-b5c2-e714af020927 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:58.465455 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d1d2d936-9095-4338-b5c2-e714af020927 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.084438 Sep 21 16:48:58.466015 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 708/1493] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:58 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:58.550763 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-6c2388a9-d5bd-434d-a85d-a860c9d7f139 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:58.552079 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-6c2388a9-d5bd-434d-a85d-a860c9d7f139 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:58.558154 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6c2388a9-d5bd-434d-a85d-a860c9d7f139 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:58.558632 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6c2388a9-d5bd-434d-a85d-a860c9d7f139 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:58.559058 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6c2388a9-d5bd-434d-a85d-a860c9d7f139 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:58.559764 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6c2388a9-d5bd-434d-a85d-a860c9d7f139 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:58.560215 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6c2388a9-d5bd-434d-a85d-a860c9d7f139 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:58.560631 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6c2388a9-d5bd-434d-a85d-a860c9d7f139 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:58.627162 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-6c2388a9-d5bd-434d-a85d-a860c9d7f139 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:58.637160 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-6c2388a9-d5bd-434d-a85d-a860c9d7f139 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.090684 Sep 21 16:48:58.637695 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 786/1494] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:58 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:59.488539 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-2d5e9eed-5444-428a-9a58-adae06d3e4d2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:59.489793 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-2d5e9eed-5444-428a-9a58-adae06d3e4d2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:59.496235 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2d5e9eed-5444-428a-9a58-adae06d3e4d2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:59.496708 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2d5e9eed-5444-428a-9a58-adae06d3e4d2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:59.497135 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2d5e9eed-5444-428a-9a58-adae06d3e4d2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:59.497814 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2d5e9eed-5444-428a-9a58-adae06d3e4d2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:59.498295 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2d5e9eed-5444-428a-9a58-adae06d3e4d2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:59.498710 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2d5e9eed-5444-428a-9a58-adae06d3e4d2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:59.561118 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-2d5e9eed-5444-428a-9a58-adae06d3e4d2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:59.569295 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-2d5e9eed-5444-428a-9a58-adae06d3e4d2 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.084603 Sep 21 16:48:59.569851 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 709/1495] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:59 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:48:59.659781 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-8463da0b-ba26-44ae-aeb0-9d3055466a7f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:48:59.660390 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-8463da0b-ba26-44ae-aeb0-9d3055466a7f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:48:59.668149 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8463da0b-ba26-44ae-aeb0-9d3055466a7f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:59.668629 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8463da0b-ba26-44ae-aeb0-9d3055466a7f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:59.669144 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8463da0b-ba26-44ae-aeb0-9d3055466a7f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:59.669839 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8463da0b-ba26-44ae-aeb0-9d3055466a7f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:48:59.670320 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8463da0b-ba26-44ae-aeb0-9d3055466a7f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:48:59.670745 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8463da0b-ba26-44ae-aeb0-9d3055466a7f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:48:59.674837 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=100 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:48:59.732034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-8463da0b-ba26-44ae-aeb0-9d3055466a7f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:48:59.739586 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-8463da0b-ba26-44ae-aeb0-9d3055466a7f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083729 Sep 21 16:48:59.740156 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 787/1496] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:48:59 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:00.591598 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-36f40bc6-aa05-4c44-83fa-9e3a65e1894f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:00.592217 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-36f40bc6-aa05-4c44-83fa-9e3a65e1894f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:00.599237 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-36f40bc6-aa05-4c44-83fa-9e3a65e1894f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:00.599716 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-36f40bc6-aa05-4c44-83fa-9e3a65e1894f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:00.600152 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-36f40bc6-aa05-4c44-83fa-9e3a65e1894f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:00.600846 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-36f40bc6-aa05-4c44-83fa-9e3a65e1894f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:00.601298 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-36f40bc6-aa05-4c44-83fa-9e3a65e1894f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:00.601722 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-36f40bc6-aa05-4c44-83fa-9e3a65e1894f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:00.665208 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-36f40bc6-aa05-4c44-83fa-9e3a65e1894f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:00.673393 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-36f40bc6-aa05-4c44-83fa-9e3a65e1894f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.085676 Sep 21 16:49:00.673961 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 710/1497] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:00 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:00.762148 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-f76b31b8-d301-4d64-9e1f-a7883e24eb8b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:00.762700 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-f76b31b8-d301-4d64-9e1f-a7883e24eb8b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:00.769724 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f76b31b8-d301-4d64-9e1f-a7883e24eb8b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:00.770244 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f76b31b8-d301-4d64-9e1f-a7883e24eb8b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:00.770676 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f76b31b8-d301-4d64-9e1f-a7883e24eb8b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:00.771364 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f76b31b8-d301-4d64-9e1f-a7883e24eb8b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:00.771810 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f76b31b8-d301-4d64-9e1f-a7883e24eb8b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:00.772232 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f76b31b8-d301-4d64-9e1f-a7883e24eb8b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:00.833195 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-f76b31b8-d301-4d64-9e1f-a7883e24eb8b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:00.841800 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-f76b31b8-d301-4d64-9e1f-a7883e24eb8b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083459 Sep 21 16:49:00.842418 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 788/1498] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:00 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:01.696347 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-1603bed7-98d1-49cd-ab6f-3be443615a46 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:01.696986 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-1603bed7-98d1-49cd-ab6f-3be443615a46 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:01.703437 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1603bed7-98d1-49cd-ab6f-3be443615a46 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:01.703912 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1603bed7-98d1-49cd-ab6f-3be443615a46 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:01.704366 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1603bed7-98d1-49cd-ab6f-3be443615a46 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:01.705296 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1603bed7-98d1-49cd-ab6f-3be443615a46 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:01.705743 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1603bed7-98d1-49cd-ab6f-3be443615a46 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:01.706184 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1603bed7-98d1-49cd-ab6f-3be443615a46 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:01.766743 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-1603bed7-98d1-49cd-ab6f-3be443615a46 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:01.768933 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=100 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:49:01.776473 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-1603bed7-98d1-49cd-ab6f-3be443615a46 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.083926 Sep 21 16:49:01.777046 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 711/1499] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:01 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:01.865468 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-0675f08a-d795-4688-8b64-07c761671529 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:01.866089 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-0675f08a-d795-4688-8b64-07c761671529 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:01.872465 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0675f08a-d795-4688-8b64-07c761671529 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:01.872941 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0675f08a-d795-4688-8b64-07c761671529 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:01.873372 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0675f08a-d795-4688-8b64-07c761671529 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:01.874067 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0675f08a-d795-4688-8b64-07c761671529 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:01.874526 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0675f08a-d795-4688-8b64-07c761671529 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:01.874942 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0675f08a-d795-4688-8b64-07c761671529 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:01.935486 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-0675f08a-d795-4688-8b64-07c761671529 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:01.943621 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-0675f08a-d795-4688-8b64-07c761671529 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082718 Sep 21 16:49:01.944217 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 789/1500] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:01 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:02.799362 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-859f79a8-d9a6-473d-9e57-ed927d2fadce tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:02.799940 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-859f79a8-d9a6-473d-9e57-ed927d2fadce tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:02.806857 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-859f79a8-d9a6-473d-9e57-ed927d2fadce tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:02.807336 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-859f79a8-d9a6-473d-9e57-ed927d2fadce tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:02.807771 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-859f79a8-d9a6-473d-9e57-ed927d2fadce tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:02.808469 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-859f79a8-d9a6-473d-9e57-ed927d2fadce tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:02.808925 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-859f79a8-d9a6-473d-9e57-ed927d2fadce tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:02.809348 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-859f79a8-d9a6-473d-9e57-ed927d2fadce tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:02.872071 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-859f79a8-d9a6-473d-9e57-ed927d2fadce tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:02.880945 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-859f79a8-d9a6-473d-9e57-ed927d2fadce tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.085621 Sep 21 16:49:02.881510 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 712/1501] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:02 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:02.965624 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-efae42dd-4ed4-4940-9f02-cfc6a9f032b2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:02.966292 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-efae42dd-4ed4-4940-9f02-cfc6a9f032b2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:02.972629 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-efae42dd-4ed4-4940-9f02-cfc6a9f032b2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:02.973105 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-efae42dd-4ed4-4940-9f02-cfc6a9f032b2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:02.973535 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-efae42dd-4ed4-4940-9f02-cfc6a9f032b2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:02.974248 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-efae42dd-4ed4-4940-9f02-cfc6a9f032b2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:02.974697 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-efae42dd-4ed4-4940-9f02-cfc6a9f032b2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:02.975115 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-efae42dd-4ed4-4940-9f02-cfc6a9f032b2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:03.034452 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-efae42dd-4ed4-4940-9f02-cfc6a9f032b2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:03.042627 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-efae42dd-4ed4-4940-9f02-cfc6a9f032b2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.080829 Sep 21 16:49:03.043192 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 790/1502] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:02 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:03.904523 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-cf367c46-88e0-4a0f-8ee1-62676da60576 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:03.905143 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-cf367c46-88e0-4a0f-8ee1-62676da60576 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:03.912122 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cf367c46-88e0-4a0f-8ee1-62676da60576 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:03.912602 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cf367c46-88e0-4a0f-8ee1-62676da60576 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:03.913034 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cf367c46-88e0-4a0f-8ee1-62676da60576 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:03.913727 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cf367c46-88e0-4a0f-8ee1-62676da60576 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:03.914222 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cf367c46-88e0-4a0f-8ee1-62676da60576 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:03.914652 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-cf367c46-88e0-4a0f-8ee1-62676da60576 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:03.975419 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-cf367c46-88e0-4a0f-8ee1-62676da60576 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:03.983514 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-cf367c46-88e0-4a0f-8ee1-62676da60576 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.083169 Sep 21 16:49:03.984074 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 713/1503] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:03 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:04.065153 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-579194be-e4fc-4d7d-a455-8c30044cae8d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:04.065794 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-579194be-e4fc-4d7d-a455-8c30044cae8d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:04.072838 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-579194be-e4fc-4d7d-a455-8c30044cae8d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:04.073324 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-579194be-e4fc-4d7d-a455-8c30044cae8d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:04.073755 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-579194be-e4fc-4d7d-a455-8c30044cae8d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:04.074472 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-579194be-e4fc-4d7d-a455-8c30044cae8d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:04.074926 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-579194be-e4fc-4d7d-a455-8c30044cae8d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:04.075350 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-579194be-e4fc-4d7d-a455-8c30044cae8d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:04.138715 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-579194be-e4fc-4d7d-a455-8c30044cae8d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:04.147031 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-579194be-e4fc-4d7d-a455-8c30044cae8d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.085751 Sep 21 16:49:04.147626 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 791/1504] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:04 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:05.011600 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-4a0e87d1-e78f-4976-b612-257c64e5cc82 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:05.012220 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-4a0e87d1-e78f-4976-b612-257c64e5cc82 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:05.019422 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4a0e87d1-e78f-4976-b612-257c64e5cc82 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:05.020419 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4a0e87d1-e78f-4976-b612-257c64e5cc82 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:05.020861 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4a0e87d1-e78f-4976-b612-257c64e5cc82 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:05.021549 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4a0e87d1-e78f-4976-b612-257c64e5cc82 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:05.022004 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4a0e87d1-e78f-4976-b612-257c64e5cc82 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:05.022464 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4a0e87d1-e78f-4976-b612-257c64e5cc82 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:05.086936 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-4a0e87d1-e78f-4976-b612-257c64e5cc82 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:05.094864 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-4a0e87d1-e78f-4976-b612-257c64e5cc82 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.087173 Sep 21 16:49:05.095426 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 714/1505] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:05 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:05.169574 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-35952464-aa03-49e8-a213-5d4d0fdc2eb6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:05.170219 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-35952464-aa03-49e8-a213-5d4d0fdc2eb6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:05.176744 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-35952464-aa03-49e8-a213-5d4d0fdc2eb6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:05.177228 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-35952464-aa03-49e8-a213-5d4d0fdc2eb6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:05.177663 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-35952464-aa03-49e8-a213-5d4d0fdc2eb6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:05.178396 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-35952464-aa03-49e8-a213-5d4d0fdc2eb6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:05.178853 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-35952464-aa03-49e8-a213-5d4d0fdc2eb6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:05.179312 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-35952464-aa03-49e8-a213-5d4d0fdc2eb6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:05.242267 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-35952464-aa03-49e8-a213-5d4d0fdc2eb6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:05.249969 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-35952464-aa03-49e8-a213-5d4d0fdc2eb6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.084234 Sep 21 16:49:05.250568 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 792/1506] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:05 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:06.118609 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-39fd2dff-de5e-4db9-9fdf-f42d24596443 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:06.119266 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-39fd2dff-de5e-4db9-9fdf-f42d24596443 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:06.125593 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-39fd2dff-de5e-4db9-9fdf-f42d24596443 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:06.126099 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-39fd2dff-de5e-4db9-9fdf-f42d24596443 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:06.126537 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-39fd2dff-de5e-4db9-9fdf-f42d24596443 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:06.127224 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-39fd2dff-de5e-4db9-9fdf-f42d24596443 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:06.127672 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-39fd2dff-de5e-4db9-9fdf-f42d24596443 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:06.128088 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-39fd2dff-de5e-4db9-9fdf-f42d24596443 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:06.187854 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-39fd2dff-de5e-4db9-9fdf-f42d24596443 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:06.195807 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-39fd2dff-de5e-4db9-9fdf-f42d24596443 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.081027 Sep 21 16:49:06.196365 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 715/1507] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:06 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:06.272653 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-4e738a10-befb-4c82-8c35-b5f93cd016bd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:06.273259 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-4e738a10-befb-4c82-8c35-b5f93cd016bd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:06.279623 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4e738a10-befb-4c82-8c35-b5f93cd016bd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:06.280098 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4e738a10-befb-4c82-8c35-b5f93cd016bd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:06.280529 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4e738a10-befb-4c82-8c35-b5f93cd016bd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:06.281214 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4e738a10-befb-4c82-8c35-b5f93cd016bd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:06.281664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4e738a10-befb-4c82-8c35-b5f93cd016bd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:06.282106 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4e738a10-befb-4c82-8c35-b5f93cd016bd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:06.343318 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-4e738a10-befb-4c82-8c35-b5f93cd016bd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:06.351384 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-4e738a10-befb-4c82-8c35-b5f93cd016bd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082572 Sep 21 16:49:06.351951 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 793/1508] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:06 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:07.218359 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-2f33c5b8-edec-43e4-a420-8a517ef8c30f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:07.219001 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-2f33c5b8-edec-43e4-a420-8a517ef8c30f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:07.225934 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2f33c5b8-edec-43e4-a420-8a517ef8c30f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:07.226447 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2f33c5b8-edec-43e4-a420-8a517ef8c30f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:07.226878 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2f33c5b8-edec-43e4-a420-8a517ef8c30f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:07.227565 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2f33c5b8-edec-43e4-a420-8a517ef8c30f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:07.228015 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2f33c5b8-edec-43e4-a420-8a517ef8c30f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:07.228434 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2f33c5b8-edec-43e4-a420-8a517ef8c30f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:07.291730 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-2f33c5b8-edec-43e4-a420-8a517ef8c30f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:07.299778 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-2f33c5b8-edec-43e4-a420-8a517ef8c30f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.085298 Sep 21 16:49:07.300345 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 716/1509] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:07 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:07.373689 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-dae0d9f0-6685-474e-a0a1-5eaf7819c46c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:07.374316 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-dae0d9f0-6685-474e-a0a1-5eaf7819c46c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:07.380713 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dae0d9f0-6685-474e-a0a1-5eaf7819c46c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:07.381185 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dae0d9f0-6685-474e-a0a1-5eaf7819c46c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:07.381615 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dae0d9f0-6685-474e-a0a1-5eaf7819c46c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:07.382327 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dae0d9f0-6685-474e-a0a1-5eaf7819c46c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:07.382774 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dae0d9f0-6685-474e-a0a1-5eaf7819c46c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:07.383189 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dae0d9f0-6685-474e-a0a1-5eaf7819c46c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:07.539781 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-dae0d9f0-6685-474e-a0a1-5eaf7819c46c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:07.547378 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-dae0d9f0-6685-474e-a0a1-5eaf7819c46c tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.177520 Sep 21 16:49:07.547947 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 794/1510] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:07 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:08.322446 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-39703fa1-46b6-4eb1-b5b1-d0fc28e421c3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:08.323081 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-39703fa1-46b6-4eb1-b5b1-d0fc28e421c3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:08.330468 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-39703fa1-46b6-4eb1-b5b1-d0fc28e421c3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:08.330946 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-39703fa1-46b6-4eb1-b5b1-d0fc28e421c3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:08.331380 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-39703fa1-46b6-4eb1-b5b1-d0fc28e421c3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:08.332066 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-39703fa1-46b6-4eb1-b5b1-d0fc28e421c3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:08.332516 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-39703fa1-46b6-4eb1-b5b1-d0fc28e421c3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:08.332937 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-39703fa1-46b6-4eb1-b5b1-d0fc28e421c3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:08.393570 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-39703fa1-46b6-4eb1-b5b1-d0fc28e421c3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:08.401660 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-39703fa1-46b6-4eb1-b5b1-d0fc28e421c3 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.083029 Sep 21 16:49:08.402257 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 717/1511] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:08 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:08.569068 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-6bde7fff-8b15-401f-a622-4b102df9de54 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:08.569714 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-6bde7fff-8b15-401f-a622-4b102df9de54 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:08.576236 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6bde7fff-8b15-401f-a622-4b102df9de54 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:08.576718 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6bde7fff-8b15-401f-a622-4b102df9de54 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:08.577153 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6bde7fff-8b15-401f-a622-4b102df9de54 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:08.577840 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6bde7fff-8b15-401f-a622-4b102df9de54 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:08.578321 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6bde7fff-8b15-401f-a622-4b102df9de54 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:08.578766 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6bde7fff-8b15-401f-a622-4b102df9de54 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:08.641130 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-6bde7fff-8b15-401f-a622-4b102df9de54 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:08.648885 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-6bde7fff-8b15-401f-a622-4b102df9de54 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083615 Sep 21 16:49:08.649396 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 795/1512] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:08 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:09.424892 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d4805321-1cd2-4ef8-b361-ac6a8b154161 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:09.425491 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d4805321-1cd2-4ef8-b361-ac6a8b154161 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:09.432367 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d4805321-1cd2-4ef8-b361-ac6a8b154161 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:09.432850 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d4805321-1cd2-4ef8-b361-ac6a8b154161 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:09.433313 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d4805321-1cd2-4ef8-b361-ac6a8b154161 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:09.434008 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d4805321-1cd2-4ef8-b361-ac6a8b154161 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:09.434481 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d4805321-1cd2-4ef8-b361-ac6a8b154161 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:09.434903 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d4805321-1cd2-4ef8-b361-ac6a8b154161 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:09.550449 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d4805321-1cd2-4ef8-b361-ac6a8b154161 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:09.559090 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d4805321-1cd2-4ef8-b361-ac6a8b154161 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.138052 Sep 21 16:49:09.559657 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 718/1513] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:09 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:09.672336 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-14d86a7c-693e-4c90-8ed1-f67a2719f495 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:09.672946 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-14d86a7c-693e-4c90-8ed1-f67a2719f495 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:09.680192 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-14d86a7c-693e-4c90-8ed1-f67a2719f495 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:09.680620 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-14d86a7c-693e-4c90-8ed1-f67a2719f495 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:09.681055 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-14d86a7c-693e-4c90-8ed1-f67a2719f495 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:09.681754 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-14d86a7c-693e-4c90-8ed1-f67a2719f495 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:09.682236 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-14d86a7c-693e-4c90-8ed1-f67a2719f495 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:09.682660 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-14d86a7c-693e-4c90-8ed1-f67a2719f495 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:09.746262 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-14d86a7c-693e-4c90-8ed1-f67a2719f495 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:09.753983 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-14d86a7c-693e-4c90-8ed1-f67a2719f495 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.085716 Sep 21 16:49:09.755350 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 796/1514] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:09 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:10.581662 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-ede9e264-6cbc-48d6-8a3e-a03c0e14d1d4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:10.582296 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-ede9e264-6cbc-48d6-8a3e-a03c0e14d1d4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:10.589242 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ede9e264-6cbc-48d6-8a3e-a03c0e14d1d4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:10.589712 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ede9e264-6cbc-48d6-8a3e-a03c0e14d1d4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:10.590174 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ede9e264-6cbc-48d6-8a3e-a03c0e14d1d4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:10.590852 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ede9e264-6cbc-48d6-8a3e-a03c0e14d1d4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:10.591296 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ede9e264-6cbc-48d6-8a3e-a03c0e14d1d4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:10.591709 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ede9e264-6cbc-48d6-8a3e-a03c0e14d1d4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:10.651573 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-ede9e264-6cbc-48d6-8a3e-a03c0e14d1d4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:10.659608 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-ede9e264-6cbc-48d6-8a3e-a03c0e14d1d4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.082133 Sep 21 16:49:10.660170 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 719/1515] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:10 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:10.780052 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-f984d027-2e46-467c-bf87-2d23ee771ae6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:10.780620 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-f984d027-2e46-467c-bf87-2d23ee771ae6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:10.787218 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f984d027-2e46-467c-bf87-2d23ee771ae6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:10.787703 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f984d027-2e46-467c-bf87-2d23ee771ae6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:10.788136 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f984d027-2e46-467c-bf87-2d23ee771ae6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:10.788833 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f984d027-2e46-467c-bf87-2d23ee771ae6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:10.789286 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f984d027-2e46-467c-bf87-2d23ee771ae6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:10.789714 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f984d027-2e46-467c-bf87-2d23ee771ae6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:10.855621 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-f984d027-2e46-467c-bf87-2d23ee771ae6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:10.863535 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-f984d027-2e46-467c-bf87-2d23ee771ae6 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.087562 Sep 21 16:49:10.864143 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 797/1516] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:10 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:11.684647 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-6e08d472-c2b8-41fb-9699-07d6bb132a90 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:11.685235 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-6e08d472-c2b8-41fb-9699-07d6bb132a90 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:11.691498 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6e08d472-c2b8-41fb-9699-07d6bb132a90 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:11.692008 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6e08d472-c2b8-41fb-9699-07d6bb132a90 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:11.692438 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6e08d472-c2b8-41fb-9699-07d6bb132a90 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:11.693127 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6e08d472-c2b8-41fb-9699-07d6bb132a90 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:11.693576 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6e08d472-c2b8-41fb-9699-07d6bb132a90 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:11.693995 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6e08d472-c2b8-41fb-9699-07d6bb132a90 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:11.755680 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-6e08d472-c2b8-41fb-9699-07d6bb132a90 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:11.763922 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-6e08d472-c2b8-41fb-9699-07d6bb132a90 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.083909 Sep 21 16:49:11.764490 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 720/1517] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:11 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:11.886174 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ecf6057e-6845-46ed-992f-ba54d438a860 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:11.886785 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ecf6057e-6845-46ed-992f-ba54d438a860 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:11.893063 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ecf6057e-6845-46ed-992f-ba54d438a860 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:11.893539 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ecf6057e-6845-46ed-992f-ba54d438a860 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:11.893967 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ecf6057e-6845-46ed-992f-ba54d438a860 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:11.894674 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ecf6057e-6845-46ed-992f-ba54d438a860 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:11.895670 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ecf6057e-6845-46ed-992f-ba54d438a860 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:11.896089 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ecf6057e-6845-46ed-992f-ba54d438a860 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:11.955342 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ecf6057e-6845-46ed-992f-ba54d438a860 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:11.963558 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ecf6057e-6845-46ed-992f-ba54d438a860 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081296 Sep 21 16:49:11.964128 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 798/1518] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:11 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:12.787611 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-0c5014c7-5e62-4533-a0bd-2e36742e8843 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:12.788164 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-0c5014c7-5e62-4533-a0bd-2e36742e8843 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:12.794547 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0c5014c7-5e62-4533-a0bd-2e36742e8843 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:12.795029 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0c5014c7-5e62-4533-a0bd-2e36742e8843 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:12.795464 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0c5014c7-5e62-4533-a0bd-2e36742e8843 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:12.796151 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0c5014c7-5e62-4533-a0bd-2e36742e8843 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:12.796610 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0c5014c7-5e62-4533-a0bd-2e36742e8843 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:12.797030 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0c5014c7-5e62-4533-a0bd-2e36742e8843 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:12.857756 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-0c5014c7-5e62-4533-a0bd-2e36742e8843 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:12.866379 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-0c5014c7-5e62-4533-a0bd-2e36742e8843 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.083223 Sep 21 16:49:12.866945 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 721/1519] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:12 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:12.986684 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-a37ccee8-5752-4e8c-b855-20d1c3263a42 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:12.987292 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-a37ccee8-5752-4e8c-b855-20d1c3263a42 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:12.990318 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_api:SELECT=56 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:49:12.995899 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a37ccee8-5752-4e8c-b855-20d1c3263a42 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:12.996379 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a37ccee8-5752-4e8c-b855-20d1c3263a42 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:12.996807 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a37ccee8-5752-4e8c-b855-20d1c3263a42 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:12.997494 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a37ccee8-5752-4e8c-b855-20d1c3263a42 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:12.998069 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a37ccee8-5752-4e8c-b855-20d1c3263a42 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:12.998497 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a37ccee8-5752-4e8c-b855-20d1c3263a42 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:13.063496 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a37ccee8-5752-4e8c-b855-20d1c3263a42 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:13.071179 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-a37ccee8-5752-4e8c-b855-20d1c3263a42 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.088401 Sep 21 16:49:13.071751 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 799/1520] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:12 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:13.888627 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-07e02556-7090-4ea6-a88b-bb47c752907e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:13.889172 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-07e02556-7090-4ea6-a88b-bb47c752907e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:13.896250 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-07e02556-7090-4ea6-a88b-bb47c752907e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:13.896731 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-07e02556-7090-4ea6-a88b-bb47c752907e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:13.897163 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-07e02556-7090-4ea6-a88b-bb47c752907e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:13.897848 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-07e02556-7090-4ea6-a88b-bb47c752907e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:13.898333 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-07e02556-7090-4ea6-a88b-bb47c752907e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:13.898756 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-07e02556-7090-4ea6-a88b-bb47c752907e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:13.964361 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-07e02556-7090-4ea6-a88b-bb47c752907e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:13.972457 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-07e02556-7090-4ea6-a88b-bb47c752907e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.087754 Sep 21 16:49:13.973046 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 722/1521] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:13 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:14.093414 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-1f85c52f-fadf-4425-a5c0-860d2b7ef1e4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:14.094070 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-1f85c52f-fadf-4425-a5c0-860d2b7ef1e4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:14.100539 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1f85c52f-fadf-4425-a5c0-860d2b7ef1e4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:14.101019 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1f85c52f-fadf-4425-a5c0-860d2b7ef1e4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:14.101452 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1f85c52f-fadf-4425-a5c0-860d2b7ef1e4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:14.102171 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1f85c52f-fadf-4425-a5c0-860d2b7ef1e4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:14.102626 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1f85c52f-fadf-4425-a5c0-860d2b7ef1e4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:14.103046 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1f85c52f-fadf-4425-a5c0-860d2b7ef1e4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:14.162015 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-1f85c52f-fadf-4425-a5c0-860d2b7ef1e4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:14.169603 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-1f85c52f-fadf-4425-a5c0-860d2b7ef1e4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.080039 Sep 21 16:49:14.170195 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 800/1522] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:14 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:14.995815 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-ecfc9730-141c-42e8-a338-1691cc5877e7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:14.996418 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-ecfc9730-141c-42e8-a338-1691cc5877e7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:15.002739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ecfc9730-141c-42e8-a338-1691cc5877e7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:15.003222 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ecfc9730-141c-42e8-a338-1691cc5877e7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:15.003651 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ecfc9730-141c-42e8-a338-1691cc5877e7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:15.004360 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ecfc9730-141c-42e8-a338-1691cc5877e7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:15.004810 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ecfc9730-141c-42e8-a338-1691cc5877e7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:15.005227 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ecfc9730-141c-42e8-a338-1691cc5877e7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:15.065182 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-ecfc9730-141c-42e8-a338-1691cc5877e7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:15.073854 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-ecfc9730-141c-42e8-a338-1691cc5877e7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.081985 Sep 21 16:49:15.074448 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 723/1523] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:14 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:15.192943 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-626c3d5c-2ce5-4068-b232-25b2f74414bb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:15.193550 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-626c3d5c-2ce5-4068-b232-25b2f74414bb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:15.199987 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-626c3d5c-2ce5-4068-b232-25b2f74414bb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:15.200472 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-626c3d5c-2ce5-4068-b232-25b2f74414bb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:15.200905 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-626c3d5c-2ce5-4068-b232-25b2f74414bb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:15.201590 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-626c3d5c-2ce5-4068-b232-25b2f74414bb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:15.202064 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-626c3d5c-2ce5-4068-b232-25b2f74414bb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:15.202488 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-626c3d5c-2ce5-4068-b232-25b2f74414bb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:15.262358 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-626c3d5c-2ce5-4068-b232-25b2f74414bb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:15.270615 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-626c3d5c-2ce5-4068-b232-25b2f74414bb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081409 Sep 21 16:49:15.271184 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 801/1524] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:15 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:16.097465 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-0c2aa65b-0b38-48af-8567-f3879c0ef8ff tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:16.098614 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-0c2aa65b-0b38-48af-8567-f3879c0ef8ff tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:16.100977 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_api:SELECT=56 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:49:16.106324 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0c2aa65b-0b38-48af-8567-f3879c0ef8ff tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:16.106806 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0c2aa65b-0b38-48af-8567-f3879c0ef8ff tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:16.107240 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0c2aa65b-0b38-48af-8567-f3879c0ef8ff tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:16.107933 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0c2aa65b-0b38-48af-8567-f3879c0ef8ff tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:16.108390 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0c2aa65b-0b38-48af-8567-f3879c0ef8ff tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:16.108815 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0c2aa65b-0b38-48af-8567-f3879c0ef8ff tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:16.169235 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-0c2aa65b-0b38-48af-8567-f3879c0ef8ff tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:16.178085 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-0c2aa65b-0b38-48af-8567-f3879c0ef8ff tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.084529 Sep 21 16:49:16.178647 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 724/1525] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:16 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:16.293069 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-1f82d528-382d-4e62-a42e-924bc86c5955 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:16.293691 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-1f82d528-382d-4e62-a42e-924bc86c5955 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:16.300298 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1f82d528-382d-4e62-a42e-924bc86c5955 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:16.300784 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1f82d528-382d-4e62-a42e-924bc86c5955 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:16.301219 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1f82d528-382d-4e62-a42e-924bc86c5955 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:16.301909 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1f82d528-382d-4e62-a42e-924bc86c5955 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:16.302391 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1f82d528-382d-4e62-a42e-924bc86c5955 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:16.302818 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1f82d528-382d-4e62-a42e-924bc86c5955 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:16.362565 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-1f82d528-382d-4e62-a42e-924bc86c5955 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:16.370249 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-1f82d528-382d-4e62-a42e-924bc86c5955 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.080971 Sep 21 16:49:16.370822 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 802/1526] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:16 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:17.200734 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-a53052bc-f75f-43b1-9ce6-0b5a5d14892f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:17.201363 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-a53052bc-f75f-43b1-9ce6-0b5a5d14892f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:17.207968 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a53052bc-f75f-43b1-9ce6-0b5a5d14892f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:17.208447 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a53052bc-f75f-43b1-9ce6-0b5a5d14892f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:17.208879 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a53052bc-f75f-43b1-9ce6-0b5a5d14892f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:17.209569 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a53052bc-f75f-43b1-9ce6-0b5a5d14892f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:17.210023 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a53052bc-f75f-43b1-9ce6-0b5a5d14892f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:17.210472 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a53052bc-f75f-43b1-9ce6-0b5a5d14892f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:17.270339 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-a53052bc-f75f-43b1-9ce6-0b5a5d14892f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:17.278623 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-a53052bc-f75f-43b1-9ce6-0b5a5d14892f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.081701 Sep 21 16:49:17.279199 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 725/1527] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:17 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:17.393030 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-4ff49427-47c7-4b52-a4b2-d0a09d9008fc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:17.393645 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-4ff49427-47c7-4b52-a4b2-d0a09d9008fc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:17.400083 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4ff49427-47c7-4b52-a4b2-d0a09d9008fc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:17.400568 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4ff49427-47c7-4b52-a4b2-d0a09d9008fc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:17.401007 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4ff49427-47c7-4b52-a4b2-d0a09d9008fc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:17.401700 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4ff49427-47c7-4b52-a4b2-d0a09d9008fc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:17.402194 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4ff49427-47c7-4b52-a4b2-d0a09d9008fc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:17.402627 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4ff49427-47c7-4b52-a4b2-d0a09d9008fc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:17.466607 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-4ff49427-47c7-4b52-a4b2-d0a09d9008fc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:17.469971 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=100 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:49:17.475857 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-4ff49427-47c7-4b52-a4b2-d0a09d9008fc tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.086730 Sep 21 16:49:17.476429 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 803/1528] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:17 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:18.301811 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-7dbe7b2e-aa44-400a-9719-c53955229187 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:18.302446 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-7dbe7b2e-aa44-400a-9719-c53955229187 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:18.308825 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7dbe7b2e-aa44-400a-9719-c53955229187 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:18.309299 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7dbe7b2e-aa44-400a-9719-c53955229187 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:18.309728 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7dbe7b2e-aa44-400a-9719-c53955229187 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:18.310434 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7dbe7b2e-aa44-400a-9719-c53955229187 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:18.310888 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7dbe7b2e-aa44-400a-9719-c53955229187 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:18.311311 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7dbe7b2e-aa44-400a-9719-c53955229187 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:18.374317 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-7dbe7b2e-aa44-400a-9719-c53955229187 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:18.382898 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-7dbe7b2e-aa44-400a-9719-c53955229187 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.085042 Sep 21 16:49:18.383458 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 726/1529] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:18 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:18.498835 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-169f0e98-4b3b-4a9c-a60a-9002f57e5e60 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:18.499440 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-169f0e98-4b3b-4a9c-a60a-9002f57e5e60 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:18.506465 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-169f0e98-4b3b-4a9c-a60a-9002f57e5e60 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:18.506943 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-169f0e98-4b3b-4a9c-a60a-9002f57e5e60 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:18.507368 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-169f0e98-4b3b-4a9c-a60a-9002f57e5e60 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:18.508054 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-169f0e98-4b3b-4a9c-a60a-9002f57e5e60 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:18.508502 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-169f0e98-4b3b-4a9c-a60a-9002f57e5e60 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:18.508919 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-169f0e98-4b3b-4a9c-a60a-9002f57e5e60 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:18.568702 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-169f0e98-4b3b-4a9c-a60a-9002f57e5e60 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:18.576616 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-169f0e98-4b3b-4a9c-a60a-9002f57e5e60 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081823 Sep 21 16:49:18.577195 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 804/1530] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:18 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:19.407635 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-09afb2e4-fb65-4326-a525-56d356452970 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:19.408247 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-09afb2e4-fb65-4326-a525-56d356452970 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:19.417174 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-09afb2e4-fb65-4326-a525-56d356452970 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:19.417663 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-09afb2e4-fb65-4326-a525-56d356452970 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:19.418123 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-09afb2e4-fb65-4326-a525-56d356452970 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:19.418819 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-09afb2e4-fb65-4326-a525-56d356452970 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:19.419273 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-09afb2e4-fb65-4326-a525-56d356452970 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:19.419694 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-09afb2e4-fb65-4326-a525-56d356452970 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:19.480734 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-09afb2e4-fb65-4326-a525-56d356452970 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:19.489482 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-09afb2e4-fb65-4326-a525-56d356452970 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.086079 Sep 21 16:49:19.490068 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 727/1531] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:19 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:19.600147 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-e08f9233-46e5-4ba2-a31d-6e8986a169a8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:19.600764 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-e08f9233-46e5-4ba2-a31d-6e8986a169a8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:19.607439 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e08f9233-46e5-4ba2-a31d-6e8986a169a8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:19.607958 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e08f9233-46e5-4ba2-a31d-6e8986a169a8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:19.608395 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e08f9233-46e5-4ba2-a31d-6e8986a169a8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:19.609099 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e08f9233-46e5-4ba2-a31d-6e8986a169a8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:19.609559 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e08f9233-46e5-4ba2-a31d-6e8986a169a8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:19.609988 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e08f9233-46e5-4ba2-a31d-6e8986a169a8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:19.670076 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-e08f9233-46e5-4ba2-a31d-6e8986a169a8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:19.678628 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-e08f9233-46e5-4ba2-a31d-6e8986a169a8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082829 Sep 21 16:49:19.679207 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 805/1532] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:19 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:20.512778 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-9c616948-28cc-43d4-9ce7-a0a95644d8b5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:20.513449 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-9c616948-28cc-43d4-9ce7-a0a95644d8b5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:20.520495 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9c616948-28cc-43d4-9ce7-a0a95644d8b5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:20.520979 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9c616948-28cc-43d4-9ce7-a0a95644d8b5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:20.521413 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9c616948-28cc-43d4-9ce7-a0a95644d8b5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:20.522131 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9c616948-28cc-43d4-9ce7-a0a95644d8b5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:20.522583 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9c616948-28cc-43d4-9ce7-a0a95644d8b5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:20.523002 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9c616948-28cc-43d4-9ce7-a0a95644d8b5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:20.537372 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=100 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:49:20.585918 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-9c616948-28cc-43d4-9ce7-a0a95644d8b5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:20.594018 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-9c616948-28cc-43d4-9ce7-a0a95644d8b5 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.085151 Sep 21 16:49:20.594604 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 728/1533] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:20 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:20.700711 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c22268e5-4bb3-4f4c-8571-b42aee189a74 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:20.701319 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-c22268e5-4bb3-4f4c-8571-b42aee189a74 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:20.707970 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c22268e5-4bb3-4f4c-8571-b42aee189a74 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:20.708444 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c22268e5-4bb3-4f4c-8571-b42aee189a74 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:20.708869 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c22268e5-4bb3-4f4c-8571-b42aee189a74 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:20.709548 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c22268e5-4bb3-4f4c-8571-b42aee189a74 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:20.709995 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c22268e5-4bb3-4f4c-8571-b42aee189a74 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:20.710433 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c22268e5-4bb3-4f4c-8571-b42aee189a74 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:20.777616 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-c22268e5-4bb3-4f4c-8571-b42aee189a74 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:20.786318 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-c22268e5-4bb3-4f4c-8571-b42aee189a74 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.088850 Sep 21 16:49:20.786902 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 806/1534] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:20 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:21.617115 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-28f6abc5-a151-4451-b344-0ab49413d480 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:21.617729 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-28f6abc5-a151-4451-b344-0ab49413d480 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:21.624152 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-28f6abc5-a151-4451-b344-0ab49413d480 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:21.624637 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-28f6abc5-a151-4451-b344-0ab49413d480 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:21.625072 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-28f6abc5-a151-4451-b344-0ab49413d480 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:21.625762 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-28f6abc5-a151-4451-b344-0ab49413d480 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:21.626246 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-28f6abc5-a151-4451-b344-0ab49413d480 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:21.626671 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-28f6abc5-a151-4451-b344-0ab49413d480 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:21.688793 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-28f6abc5-a151-4451-b344-0ab49413d480 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:21.697815 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-28f6abc5-a151-4451-b344-0ab49413d480 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.084987 Sep 21 16:49:21.698662 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 729/1535] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:21 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:21.809118 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-1fe6d954-2e52-4a4c-aa32-fad274c5c14f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:21.809680 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-1fe6d954-2e52-4a4c-aa32-fad274c5c14f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:21.816064 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1fe6d954-2e52-4a4c-aa32-fad274c5c14f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:21.816540 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1fe6d954-2e52-4a4c-aa32-fad274c5c14f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:21.816969 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1fe6d954-2e52-4a4c-aa32-fad274c5c14f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:21.817651 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1fe6d954-2e52-4a4c-aa32-fad274c5c14f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:21.818127 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1fe6d954-2e52-4a4c-aa32-fad274c5c14f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:21.818548 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1fe6d954-2e52-4a4c-aa32-fad274c5c14f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:21.881815 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-1fe6d954-2e52-4a4c-aa32-fad274c5c14f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:21.889506 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-1fe6d954-2e52-4a4c-aa32-fad274c5c14f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.084362 Sep 21 16:49:21.890084 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 807/1536] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:21 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:22.720697 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-60d8867c-f5e4-4a49-9f1f-3f3ac4d9906c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:22.721312 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-60d8867c-f5e4-4a49-9f1f-3f3ac4d9906c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:22.728263 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-60d8867c-f5e4-4a49-9f1f-3f3ac4d9906c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:22.728744 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-60d8867c-f5e4-4a49-9f1f-3f3ac4d9906c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:22.729176 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-60d8867c-f5e4-4a49-9f1f-3f3ac4d9906c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:22.729864 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-60d8867c-f5e4-4a49-9f1f-3f3ac4d9906c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:22.730339 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-60d8867c-f5e4-4a49-9f1f-3f3ac4d9906c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:22.730761 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-60d8867c-f5e4-4a49-9f1f-3f3ac4d9906c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:22.794844 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-60d8867c-f5e4-4a49-9f1f-3f3ac4d9906c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:22.803714 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-60d8867c-f5e4-4a49-9f1f-3f3ac4d9906c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.086857 Sep 21 16:49:22.804278 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 730/1537] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:22 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:22.913009 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-d374190d-494a-4ddc-a642-41deb1ce0f48 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:22.913488 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-d374190d-494a-4ddc-a642-41deb1ce0f48 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:22.920979 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d374190d-494a-4ddc-a642-41deb1ce0f48 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:22.921463 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d374190d-494a-4ddc-a642-41deb1ce0f48 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:22.921899 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d374190d-494a-4ddc-a642-41deb1ce0f48 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:22.922624 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d374190d-494a-4ddc-a642-41deb1ce0f48 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:22.923086 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d374190d-494a-4ddc-a642-41deb1ce0f48 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:22.923508 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d374190d-494a-4ddc-a642-41deb1ce0f48 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:22.984802 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d374190d-494a-4ddc-a642-41deb1ce0f48 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:22.992500 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-d374190d-494a-4ddc-a642-41deb1ce0f48 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.084515 Sep 21 16:49:22.993068 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 808/1538] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:22 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:23.826662 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-11d629b9-e4b2-49aa-9d9b-73f3e74eb3c6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:23.827210 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-11d629b9-e4b2-49aa-9d9b-73f3e74eb3c6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:23.833715 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-11d629b9-e4b2-49aa-9d9b-73f3e74eb3c6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:23.834235 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-11d629b9-e4b2-49aa-9d9b-73f3e74eb3c6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:23.834665 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-11d629b9-e4b2-49aa-9d9b-73f3e74eb3c6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:23.835346 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-11d629b9-e4b2-49aa-9d9b-73f3e74eb3c6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:23.835792 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-11d629b9-e4b2-49aa-9d9b-73f3e74eb3c6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:23.836207 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-11d629b9-e4b2-49aa-9d9b-73f3e74eb3c6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:23.895912 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-11d629b9-e4b2-49aa-9d9b-73f3e74eb3c6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:23.903845 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-11d629b9-e4b2-49aa-9d9b-73f3e74eb3c6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.081131 Sep 21 16:49:23.904413 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 731/1539] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:23 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:24.015403 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-0bc93adf-3a79-4aa7-9b9a-f9564c2f27cd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:24.016046 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-0bc93adf-3a79-4aa7-9b9a-f9564c2f27cd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:24.022478 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0bc93adf-3a79-4aa7-9b9a-f9564c2f27cd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:24.022959 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0bc93adf-3a79-4aa7-9b9a-f9564c2f27cd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:24.023391 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0bc93adf-3a79-4aa7-9b9a-f9564c2f27cd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:24.024083 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0bc93adf-3a79-4aa7-9b9a-f9564c2f27cd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:24.024536 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0bc93adf-3a79-4aa7-9b9a-f9564c2f27cd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:24.024958 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0bc93adf-3a79-4aa7-9b9a-f9564c2f27cd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:24.084657 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-0bc93adf-3a79-4aa7-9b9a-f9564c2f27cd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:24.092258 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-0bc93adf-3a79-4aa7-9b9a-f9564c2f27cd tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.080755 Sep 21 16:49:24.092829 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 809/1540] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:24 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:24.926552 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-149a83a8-1e39-43f3-a55d-b032c2198502 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:24.927166 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-149a83a8-1e39-43f3-a55d-b032c2198502 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:24.933550 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-149a83a8-1e39-43f3-a55d-b032c2198502 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:24.934023 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-149a83a8-1e39-43f3-a55d-b032c2198502 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:24.934482 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-149a83a8-1e39-43f3-a55d-b032c2198502 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:24.935165 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-149a83a8-1e39-43f3-a55d-b032c2198502 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:24.935616 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-149a83a8-1e39-43f3-a55d-b032c2198502 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:24.936035 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-149a83a8-1e39-43f3-a55d-b032c2198502 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:24.999664 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-149a83a8-1e39-43f3-a55d-b032c2198502 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:25.008303 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-149a83a8-1e39-43f3-a55d-b032c2198502 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.085639 Sep 21 16:49:25.008858 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 732/1541] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:24 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:25.115232 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-8485c743-f37f-407f-8700-f1c9ca48b523 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:25.115940 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-8485c743-f37f-407f-8700-f1c9ca48b523 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:25.123043 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8485c743-f37f-407f-8700-f1c9ca48b523 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:25.123525 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8485c743-f37f-407f-8700-f1c9ca48b523 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:25.123951 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8485c743-f37f-407f-8700-f1c9ca48b523 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:25.124644 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8485c743-f37f-407f-8700-f1c9ca48b523 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:25.125120 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8485c743-f37f-407f-8700-f1c9ca48b523 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:25.125540 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8485c743-f37f-407f-8700-f1c9ca48b523 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:25.188761 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-8485c743-f37f-407f-8700-f1c9ca48b523 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:25.197199 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-8485c743-f37f-407f-8700-f1c9ca48b523 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.085922 Sep 21 16:49:25.197771 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 810/1542] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:25 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:49:26.031935 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-42ee9a5b-2a43-4969-99ee-c682a91a7ece tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:26.032567 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-42ee9a5b-2a43-4969-99ee-c682a91a7ece tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:26.039950 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-42ee9a5b-2a43-4969-99ee-c682a91a7ece tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:26.040429 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-42ee9a5b-2a43-4969-99ee-c682a91a7ece tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:26.040853 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-42ee9a5b-2a43-4969-99ee-c682a91a7ece tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:26.041529 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-42ee9a5b-2a43-4969-99ee-c682a91a7ece tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:26.041974 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-42ee9a5b-2a43-4969-99ee-c682a91a7ece tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:26.042414 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-42ee9a5b-2a43-4969-99ee-c682a91a7ece tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:26.103186 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-42ee9a5b-2a43-4969-99ee-c682a91a7ece tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:26.111223 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-42ee9a5b-2a43-4969-99ee-c682a91a7ece tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.083123 Sep 21 16:49:26.111790 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 733/1543] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:26 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:26.220084 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c03a52bd-1f66-48ec-8cb4-5094e8f5c47f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:26.220698 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-c03a52bd-1f66-48ec-8cb4-5094e8f5c47f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:26.227757 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c03a52bd-1f66-48ec-8cb4-5094e8f5c47f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:26.228236 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c03a52bd-1f66-48ec-8cb4-5094e8f5c47f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:26.228717 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c03a52bd-1f66-48ec-8cb4-5094e8f5c47f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:26.229395 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c03a52bd-1f66-48ec-8cb4-5094e8f5c47f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:26.229854 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c03a52bd-1f66-48ec-8cb4-5094e8f5c47f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:26.230302 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c03a52bd-1f66-48ec-8cb4-5094e8f5c47f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:26.292752 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-c03a52bd-1f66-48ec-8cb4-5094e8f5c47f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:26.300439 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-c03a52bd-1f66-48ec-8cb4-5094e8f5c47f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.084262 Sep 21 16:49:26.301099 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 811/1544] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:26 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:27.135357 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-56930b6d-3b6e-492d-82bc-5237842ddd9e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:27.135995 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-56930b6d-3b6e-492d-82bc-5237842ddd9e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:27.142393 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-56930b6d-3b6e-492d-82bc-5237842ddd9e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:27.142871 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-56930b6d-3b6e-492d-82bc-5237842ddd9e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:27.143300 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-56930b6d-3b6e-492d-82bc-5237842ddd9e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:27.143988 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-56930b6d-3b6e-492d-82bc-5237842ddd9e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:27.144433 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-56930b6d-3b6e-492d-82bc-5237842ddd9e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:27.144873 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-56930b6d-3b6e-492d-82bc-5237842ddd9e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:27.209943 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-56930b6d-3b6e-492d-82bc-5237842ddd9e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:27.218163 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-56930b6d-3b6e-492d-82bc-5237842ddd9e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.086686 Sep 21 16:49:27.218729 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 734/1545] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:27 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:27.323252 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-31cda70f-89ca-4e05-b8bf-299f22dae9ff tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:27.323860 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-31cda70f-89ca-4e05-b8bf-299f22dae9ff tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:27.330535 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-31cda70f-89ca-4e05-b8bf-299f22dae9ff tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:27.331021 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-31cda70f-89ca-4e05-b8bf-299f22dae9ff tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:27.331454 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-31cda70f-89ca-4e05-b8bf-299f22dae9ff tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:27.332145 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-31cda70f-89ca-4e05-b8bf-299f22dae9ff tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:27.333202 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-31cda70f-89ca-4e05-b8bf-299f22dae9ff tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:27.333623 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-31cda70f-89ca-4e05-b8bf-299f22dae9ff tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:27.394708 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-31cda70f-89ca-4e05-b8bf-299f22dae9ff tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:27.402890 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-31cda70f-89ca-4e05-b8bf-299f22dae9ff tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083509 Sep 21 16:49:27.403461 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 812/1546] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:27 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:28.241343 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-6f627494-cfaa-4da7-aa59-41301b968ddd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:28.241896 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-6f627494-cfaa-4da7-aa59-41301b968ddd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:28.248301 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6f627494-cfaa-4da7-aa59-41301b968ddd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:28.248784 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6f627494-cfaa-4da7-aa59-41301b968ddd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:28.249217 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6f627494-cfaa-4da7-aa59-41301b968ddd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:28.249910 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6f627494-cfaa-4da7-aa59-41301b968ddd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:28.250389 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6f627494-cfaa-4da7-aa59-41301b968ddd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:28.250819 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6f627494-cfaa-4da7-aa59-41301b968ddd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:28.314010 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-6f627494-cfaa-4da7-aa59-41301b968ddd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:28.322168 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-6f627494-cfaa-4da7-aa59-41301b968ddd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.084681 Sep 21 16:49:28.322734 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 735/1547] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:28 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:28.425508 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-2d527ee4-07a6-4730-b276-d8915dcefb78 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:28.426139 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-2d527ee4-07a6-4730-b276-d8915dcefb78 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:28.432425 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2d527ee4-07a6-4730-b276-d8915dcefb78 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:28.432897 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2d527ee4-07a6-4730-b276-d8915dcefb78 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:28.433326 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2d527ee4-07a6-4730-b276-d8915dcefb78 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:28.434007 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2d527ee4-07a6-4730-b276-d8915dcefb78 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:28.434476 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2d527ee4-07a6-4730-b276-d8915dcefb78 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:28.434902 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2d527ee4-07a6-4730-b276-d8915dcefb78 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:28.494914 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-2d527ee4-07a6-4730-b276-d8915dcefb78 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:28.502590 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-2d527ee4-07a6-4730-b276-d8915dcefb78 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.080912 Sep 21 16:49:28.503149 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 813/1548] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:28 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:29.345646 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-e0da12e5-8167-4032-b913-dbc57ea92369 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:29.346280 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-e0da12e5-8167-4032-b913-dbc57ea92369 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:29.353074 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e0da12e5-8167-4032-b913-dbc57ea92369 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:29.353552 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e0da12e5-8167-4032-b913-dbc57ea92369 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:29.353986 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e0da12e5-8167-4032-b913-dbc57ea92369 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:29.354701 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e0da12e5-8167-4032-b913-dbc57ea92369 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:29.355154 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e0da12e5-8167-4032-b913-dbc57ea92369 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:29.355572 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e0da12e5-8167-4032-b913-dbc57ea92369 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:29.416551 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-e0da12e5-8167-4032-b913-dbc57ea92369 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:29.424532 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-e0da12e5-8167-4032-b913-dbc57ea92369 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.082814 Sep 21 16:49:29.425102 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 736/1549] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:29 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:29.524637 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-1e924356-669c-4a9d-8bd1-884a3589f6ac tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:29.525245 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-1e924356-669c-4a9d-8bd1-884a3589f6ac tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:29.531706 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1e924356-669c-4a9d-8bd1-884a3589f6ac tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:29.532176 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1e924356-669c-4a9d-8bd1-884a3589f6ac tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:29.532603 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1e924356-669c-4a9d-8bd1-884a3589f6ac tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:29.533286 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1e924356-669c-4a9d-8bd1-884a3589f6ac tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:29.533733 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1e924356-669c-4a9d-8bd1-884a3589f6ac tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:29.534185 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1e924356-669c-4a9d-8bd1-884a3589f6ac tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:29.594830 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-1e924356-669c-4a9d-8bd1-884a3589f6ac tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:29.603190 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-1e924356-669c-4a9d-8bd1-884a3589f6ac tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082352 Sep 21 16:49:29.603700 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 814/1550] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:29 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:30.447563 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-e513894f-04d9-449c-90ac-1e909f26d559 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:30.448180 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-e513894f-04d9-449c-90ac-1e909f26d559 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:30.454696 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e513894f-04d9-449c-90ac-1e909f26d559 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:30.455444 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e513894f-04d9-449c-90ac-1e909f26d559 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:30.455878 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e513894f-04d9-449c-90ac-1e909f26d559 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:30.456562 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e513894f-04d9-449c-90ac-1e909f26d559 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:30.457013 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e513894f-04d9-449c-90ac-1e909f26d559 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:30.457433 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e513894f-04d9-449c-90ac-1e909f26d559 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:30.518759 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-e513894f-04d9-449c-90ac-1e909f26d559 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:30.527535 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-e513894f-04d9-449c-90ac-1e909f26d559 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.083848 Sep 21 16:49:30.528099 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 737/1551] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:30 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:30.625999 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-f91d34e7-7e90-465c-8b8d-a5b75661af9d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:30.626634 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-f91d34e7-7e90-465c-8b8d-a5b75661af9d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:30.633000 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f91d34e7-7e90-465c-8b8d-a5b75661af9d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:30.633475 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f91d34e7-7e90-465c-8b8d-a5b75661af9d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:30.633902 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f91d34e7-7e90-465c-8b8d-a5b75661af9d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:30.634608 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f91d34e7-7e90-465c-8b8d-a5b75661af9d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:30.635060 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f91d34e7-7e90-465c-8b8d-a5b75661af9d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:30.635474 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f91d34e7-7e90-465c-8b8d-a5b75661af9d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:30.699630 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-f91d34e7-7e90-465c-8b8d-a5b75661af9d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:30.708040 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-f91d34e7-7e90-465c-8b8d-a5b75661af9d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.085437 Sep 21 16:49:30.708612 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 815/1552] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:30 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:31.550646 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-6c28da5c-2f43-4592-b4f3-1d9c81b25e87 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:31.551811 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-6c28da5c-2f43-4592-b4f3-1d9c81b25e87 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:31.558360 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6c28da5c-2f43-4592-b4f3-1d9c81b25e87 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:31.558953 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6c28da5c-2f43-4592-b4f3-1d9c81b25e87 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:31.559388 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6c28da5c-2f43-4592-b4f3-1d9c81b25e87 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:31.560076 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6c28da5c-2f43-4592-b4f3-1d9c81b25e87 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:31.560524 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6c28da5c-2f43-4592-b4f3-1d9c81b25e87 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:31.560940 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6c28da5c-2f43-4592-b4f3-1d9c81b25e87 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:31.625472 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-6c28da5c-2f43-4592-b4f3-1d9c81b25e87 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:31.633550 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-6c28da5c-2f43-4592-b4f3-1d9c81b25e87 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.086778 Sep 21 16:49:31.634126 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 738/1553] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:31 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:31.730546 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-f96005b5-71ec-4740-b4bb-cf82ad5c728e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:31.731162 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-f96005b5-71ec-4740-b4bb-cf82ad5c728e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:31.737623 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f96005b5-71ec-4740-b4bb-cf82ad5c728e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:31.738067 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f96005b5-71ec-4740-b4bb-cf82ad5c728e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:31.739164 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f96005b5-71ec-4740-b4bb-cf82ad5c728e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:31.739861 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f96005b5-71ec-4740-b4bb-cf82ad5c728e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:31.740326 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f96005b5-71ec-4740-b4bb-cf82ad5c728e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:31.740754 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f96005b5-71ec-4740-b4bb-cf82ad5c728e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:31.799970 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-f96005b5-71ec-4740-b4bb-cf82ad5c728e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:31.808314 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-f96005b5-71ec-4740-b4bb-cf82ad5c728e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081673 Sep 21 16:49:31.808890 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 816/1554] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:31 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:32.656172 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-702ba297-9783-40fe-94de-5ec5fc18a23f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:32.656812 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-702ba297-9783-40fe-94de-5ec5fc18a23f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:32.663288 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-702ba297-9783-40fe-94de-5ec5fc18a23f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:32.663770 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-702ba297-9783-40fe-94de-5ec5fc18a23f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:32.664202 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-702ba297-9783-40fe-94de-5ec5fc18a23f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:32.664888 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-702ba297-9783-40fe-94de-5ec5fc18a23f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:32.665341 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-702ba297-9783-40fe-94de-5ec5fc18a23f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:32.665761 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-702ba297-9783-40fe-94de-5ec5fc18a23f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:32.726711 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-702ba297-9783-40fe-94de-5ec5fc18a23f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:32.734779 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-702ba297-9783-40fe-94de-5ec5fc18a23f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.082511 Sep 21 16:49:32.735346 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 739/1555] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:32 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:32.831187 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-a2f8defe-4202-4d27-a1e1-62e3772d66d5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:32.831829 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-a2f8defe-4202-4d27-a1e1-62e3772d66d5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:32.838525 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a2f8defe-4202-4d27-a1e1-62e3772d66d5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:32.839010 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a2f8defe-4202-4d27-a1e1-62e3772d66d5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:32.839444 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a2f8defe-4202-4d27-a1e1-62e3772d66d5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:32.840141 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a2f8defe-4202-4d27-a1e1-62e3772d66d5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:32.840595 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a2f8defe-4202-4d27-a1e1-62e3772d66d5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:32.841017 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a2f8defe-4202-4d27-a1e1-62e3772d66d5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:32.901987 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a2f8defe-4202-4d27-a1e1-62e3772d66d5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:32.909614 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-a2f8defe-4202-4d27-a1e1-62e3772d66d5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082657 Sep 21 16:49:32.910204 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 817/1556] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:32 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:33.758714 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-6c31b535-9a9c-432d-b0e9-d8da6176e144 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:33.759374 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-6c31b535-9a9c-432d-b0e9-d8da6176e144 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:33.765615 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6c31b535-9a9c-432d-b0e9-d8da6176e144 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:33.766109 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6c31b535-9a9c-432d-b0e9-d8da6176e144 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:33.766537 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6c31b535-9a9c-432d-b0e9-d8da6176e144 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:33.767218 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6c31b535-9a9c-432d-b0e9-d8da6176e144 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:33.767659 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6c31b535-9a9c-432d-b0e9-d8da6176e144 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:33.768072 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6c31b535-9a9c-432d-b0e9-d8da6176e144 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:33.828215 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-6c31b535-9a9c-432d-b0e9-d8da6176e144 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:33.837139 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-6c31b535-9a9c-432d-b0e9-d8da6176e144 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.083138 Sep 21 16:49:33.837698 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 740/1557] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:33 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:33.933714 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-b0dc40d7-b069-45f5-9566-4a2e0c1c9d82 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:33.934359 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-b0dc40d7-b069-45f5-9566-4a2e0c1c9d82 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:33.940835 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b0dc40d7-b069-45f5-9566-4a2e0c1c9d82 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:33.941311 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b0dc40d7-b069-45f5-9566-4a2e0c1c9d82 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:33.941739 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b0dc40d7-b069-45f5-9566-4a2e0c1c9d82 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:33.942459 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b0dc40d7-b069-45f5-9566-4a2e0c1c9d82 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:33.943442 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b0dc40d7-b069-45f5-9566-4a2e0c1c9d82 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:33.943847 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b0dc40d7-b069-45f5-9566-4a2e0c1c9d82 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:34.003228 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-b0dc40d7-b069-45f5-9566-4a2e0c1c9d82 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:34.011363 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-b0dc40d7-b069-45f5-9566-4a2e0c1c9d82 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081429 Sep 21 16:49:34.011871 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 818/1558] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:33 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:34.859768 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-ce5e9641-84eb-4cf9-bc56-bb00a06421c7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:34.860315 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-ce5e9641-84eb-4cf9-bc56-bb00a06421c7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:34.867447 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ce5e9641-84eb-4cf9-bc56-bb00a06421c7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:34.867933 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ce5e9641-84eb-4cf9-bc56-bb00a06421c7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:34.868371 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ce5e9641-84eb-4cf9-bc56-bb00a06421c7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:34.869066 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ce5e9641-84eb-4cf9-bc56-bb00a06421c7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:34.869523 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ce5e9641-84eb-4cf9-bc56-bb00a06421c7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:34.869947 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ce5e9641-84eb-4cf9-bc56-bb00a06421c7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:34.935456 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-ce5e9641-84eb-4cf9-bc56-bb00a06421c7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:34.947957 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-ce5e9641-84eb-4cf9-bc56-bb00a06421c7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.092116 Sep 21 16:49:34.948639 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 741/1559] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:34 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:35.034679 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-37d5757a-008d-41f9-aa30-91d51bb69d4d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:35.035293 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-37d5757a-008d-41f9-aa30-91d51bb69d4d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:35.042403 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-37d5757a-008d-41f9-aa30-91d51bb69d4d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:35.042890 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-37d5757a-008d-41f9-aa30-91d51bb69d4d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:35.043326 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-37d5757a-008d-41f9-aa30-91d51bb69d4d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:35.044032 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-37d5757a-008d-41f9-aa30-91d51bb69d4d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:35.044490 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-37d5757a-008d-41f9-aa30-91d51bb69d4d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:35.044920 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-37d5757a-008d-41f9-aa30-91d51bb69d4d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:35.111305 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-37d5757a-008d-41f9-aa30-91d51bb69d4d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:35.119185 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-37d5757a-008d-41f9-aa30-91d51bb69d4d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.088292 Sep 21 16:49:35.119784 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 819/1560] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:35 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:35.970968 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-f9c3f557-eea9-43c8-a52d-397c9d07894d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:35.971585 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-f9c3f557-eea9-43c8-a52d-397c9d07894d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:35.978617 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f9c3f557-eea9-43c8-a52d-397c9d07894d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:35.979096 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f9c3f557-eea9-43c8-a52d-397c9d07894d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:35.979533 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f9c3f557-eea9-43c8-a52d-397c9d07894d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:35.980221 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f9c3f557-eea9-43c8-a52d-397c9d07894d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:35.980666 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f9c3f557-eea9-43c8-a52d-397c9d07894d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:35.981083 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f9c3f557-eea9-43c8-a52d-397c9d07894d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:36.047541 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-f9c3f557-eea9-43c8-a52d-397c9d07894d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:36.055740 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-f9c3f557-eea9-43c8-a52d-397c9d07894d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.088632 Sep 21 16:49:36.056307 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 742/1561] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:35 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:36.142267 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-7eb119c9-1d32-4605-8182-cd86c1f6a39d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:36.142867 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-7eb119c9-1d32-4605-8182-cd86c1f6a39d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:36.149873 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7eb119c9-1d32-4605-8182-cd86c1f6a39d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:36.150384 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7eb119c9-1d32-4605-8182-cd86c1f6a39d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:36.150810 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7eb119c9-1d32-4605-8182-cd86c1f6a39d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:36.151488 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7eb119c9-1d32-4605-8182-cd86c1f6a39d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:36.151934 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7eb119c9-1d32-4605-8182-cd86c1f6a39d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:36.152357 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7eb119c9-1d32-4605-8182-cd86c1f6a39d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:36.169999 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=100 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:49:36.214543 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-7eb119c9-1d32-4605-8182-cd86c1f6a39d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:36.222244 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-7eb119c9-1d32-4605-8182-cd86c1f6a39d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083813 Sep 21 16:49:36.222755 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 820/1562] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:36 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:49:37.079175 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-dece669c-1f51-4ebd-9f7d-8363f2aaa9d1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:37.079979 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-dece669c-1f51-4ebd-9f7d-8363f2aaa9d1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:37.085964 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dece669c-1f51-4ebd-9f7d-8363f2aaa9d1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:37.086468 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dece669c-1f51-4ebd-9f7d-8363f2aaa9d1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:37.086903 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dece669c-1f51-4ebd-9f7d-8363f2aaa9d1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:37.087581 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dece669c-1f51-4ebd-9f7d-8363f2aaa9d1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:37.088021 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dece669c-1f51-4ebd-9f7d-8363f2aaa9d1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:37.088444 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-dece669c-1f51-4ebd-9f7d-8363f2aaa9d1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:37.149324 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-dece669c-1f51-4ebd-9f7d-8363f2aaa9d1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:37.158524 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-dece669c-1f51-4ebd-9f7d-8363f2aaa9d1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.083551 Sep 21 16:49:37.159184 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 743/1563] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:37 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:37.245804 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-7a810500-118c-4dc8-a869-331d4ce4791d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:37.246455 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-7a810500-118c-4dc8-a869-331d4ce4791d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:37.252854 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7a810500-118c-4dc8-a869-331d4ce4791d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:37.253334 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7a810500-118c-4dc8-a869-331d4ce4791d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:37.253774 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7a810500-118c-4dc8-a869-331d4ce4791d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:37.254498 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7a810500-118c-4dc8-a869-331d4ce4791d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:37.254941 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7a810500-118c-4dc8-a869-331d4ce4791d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:37.255367 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7a810500-118c-4dc8-a869-331d4ce4791d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:37.315291 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-7a810500-118c-4dc8-a869-331d4ce4791d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:37.322880 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-7a810500-118c-4dc8-a869-331d4ce4791d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081593 Sep 21 16:49:37.323448 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 821/1564] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:37 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:38.181556 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-5acf2b73-141e-4094-8be0-6259cba4a82f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:38.182196 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-5acf2b73-141e-4094-8be0-6259cba4a82f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:38.188044 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5acf2b73-141e-4094-8be0-6259cba4a82f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:38.188531 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5acf2b73-141e-4094-8be0-6259cba4a82f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:38.188959 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5acf2b73-141e-4094-8be0-6259cba4a82f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:38.189647 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5acf2b73-141e-4094-8be0-6259cba4a82f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:38.190128 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5acf2b73-141e-4094-8be0-6259cba4a82f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:38.190548 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5acf2b73-141e-4094-8be0-6259cba4a82f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:38.251258 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-5acf2b73-141e-4094-8be0-6259cba4a82f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:38.259857 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-5acf2b73-141e-4094-8be0-6259cba4a82f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.082373 Sep 21 16:49:38.260418 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 744/1565] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:38 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:38.345891 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c8304bc8-fa45-43e9-a9fc-1fa8f1ac5c4a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:38.346540 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-c8304bc8-fa45-43e9-a9fc-1fa8f1ac5c4a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:38.352929 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c8304bc8-fa45-43e9-a9fc-1fa8f1ac5c4a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:38.353418 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c8304bc8-fa45-43e9-a9fc-1fa8f1ac5c4a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:38.353853 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c8304bc8-fa45-43e9-a9fc-1fa8f1ac5c4a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:38.354596 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c8304bc8-fa45-43e9-a9fc-1fa8f1ac5c4a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:38.355057 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c8304bc8-fa45-43e9-a9fc-1fa8f1ac5c4a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:38.355513 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c8304bc8-fa45-43e9-a9fc-1fa8f1ac5c4a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:38.417990 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-c8304bc8-fa45-43e9-a9fc-1fa8f1ac5c4a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:38.425691 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-c8304bc8-fa45-43e9-a9fc-1fa8f1ac5c4a tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083615 Sep 21 16:49:38.426301 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 822/1566] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:38 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:39.283380 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-6aa27ebe-67b4-48c3-8145-df0b333e070e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:39.284004 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-6aa27ebe-67b4-48c3-8145-df0b333e070e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:39.290920 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6aa27ebe-67b4-48c3-8145-df0b333e070e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:39.291402 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6aa27ebe-67b4-48c3-8145-df0b333e070e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:39.291835 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6aa27ebe-67b4-48c3-8145-df0b333e070e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:39.292549 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6aa27ebe-67b4-48c3-8145-df0b333e070e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:39.293001 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6aa27ebe-67b4-48c3-8145-df0b333e070e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:39.293424 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6aa27ebe-67b4-48c3-8145-df0b333e070e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:39.295957 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=100 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:49:39.355013 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-6aa27ebe-67b4-48c3-8145-df0b333e070e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:39.363033 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-6aa27ebe-67b4-48c3-8145-df0b333e070e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.083555 Sep 21 16:49:39.363596 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 745/1567] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:39 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:39.449291 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-4df5b0d2-5b93-4e25-a1c3-93cf7874a444 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:39.449901 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-4df5b0d2-5b93-4e25-a1c3-93cf7874a444 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:39.456912 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4df5b0d2-5b93-4e25-a1c3-93cf7874a444 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:39.457391 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4df5b0d2-5b93-4e25-a1c3-93cf7874a444 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:39.457821 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4df5b0d2-5b93-4e25-a1c3-93cf7874a444 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:39.459046 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4df5b0d2-5b93-4e25-a1c3-93cf7874a444 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:39.459525 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4df5b0d2-5b93-4e25-a1c3-93cf7874a444 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:39.459941 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4df5b0d2-5b93-4e25-a1c3-93cf7874a444 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:39.523817 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-4df5b0d2-5b93-4e25-a1c3-93cf7874a444 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:39.531491 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-4df5b0d2-5b93-4e25-a1c3-93cf7874a444 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.086107 Sep 21 16:49:39.532092 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 823/1568] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:39 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:40.387170 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-ded84da1-291a-4f1d-b2ea-83c5e8b182ff tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:40.387775 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-ded84da1-291a-4f1d-b2ea-83c5e8b182ff tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:40.394170 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ded84da1-291a-4f1d-b2ea-83c5e8b182ff tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:40.394911 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ded84da1-291a-4f1d-b2ea-83c5e8b182ff tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:40.395344 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ded84da1-291a-4f1d-b2ea-83c5e8b182ff tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:40.396027 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ded84da1-291a-4f1d-b2ea-83c5e8b182ff tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:40.396471 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ded84da1-291a-4f1d-b2ea-83c5e8b182ff tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:40.396890 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ded84da1-291a-4f1d-b2ea-83c5e8b182ff tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:40.465011 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-ded84da1-291a-4f1d-b2ea-83c5e8b182ff tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:40.474432 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-ded84da1-291a-4f1d-b2ea-83c5e8b182ff tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.091329 Sep 21 16:49:40.475007 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 746/1569] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:40 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:40.554984 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-5bdc42ae-d812-4495-8197-6eda9d6d1d89 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:40.555596 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-5bdc42ae-d812-4495-8197-6eda9d6d1d89 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:40.561980 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5bdc42ae-d812-4495-8197-6eda9d6d1d89 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:40.562496 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5bdc42ae-d812-4495-8197-6eda9d6d1d89 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:40.562950 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5bdc42ae-d812-4495-8197-6eda9d6d1d89 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:40.563640 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5bdc42ae-d812-4495-8197-6eda9d6d1d89 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:40.564092 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5bdc42ae-d812-4495-8197-6eda9d6d1d89 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:40.564513 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5bdc42ae-d812-4495-8197-6eda9d6d1d89 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:40.624984 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5bdc42ae-d812-4495-8197-6eda9d6d1d89 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:40.632755 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-5bdc42ae-d812-4495-8197-6eda9d6d1d89 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082290 Sep 21 16:49:40.633319 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 824/1570] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:40 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:41.499780 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-af56ff6a-feb8-4708-8bb1-db2835ba8401 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:41.500388 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-af56ff6a-feb8-4708-8bb1-db2835ba8401 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:41.507354 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-af56ff6a-feb8-4708-8bb1-db2835ba8401 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:41.507831 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-af56ff6a-feb8-4708-8bb1-db2835ba8401 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:41.508259 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-af56ff6a-feb8-4708-8bb1-db2835ba8401 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:41.508944 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-af56ff6a-feb8-4708-8bb1-db2835ba8401 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:41.509386 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-af56ff6a-feb8-4708-8bb1-db2835ba8401 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:41.509805 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-af56ff6a-feb8-4708-8bb1-db2835ba8401 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:41.570370 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-af56ff6a-feb8-4708-8bb1-db2835ba8401 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:41.578404 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-af56ff6a-feb8-4708-8bb1-db2835ba8401 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.082638 Sep 21 16:49:41.579003 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 747/1571] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:41 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:41.654284 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-67710997-d33d-4ff1-a96f-433b2815906b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:41.654905 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-67710997-d33d-4ff1-a96f-433b2815906b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:41.661339 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-67710997-d33d-4ff1-a96f-433b2815906b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:41.661826 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-67710997-d33d-4ff1-a96f-433b2815906b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:41.662299 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-67710997-d33d-4ff1-a96f-433b2815906b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:41.662993 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-67710997-d33d-4ff1-a96f-433b2815906b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:41.663449 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-67710997-d33d-4ff1-a96f-433b2815906b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:41.663877 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-67710997-d33d-4ff1-a96f-433b2815906b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:41.729708 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-67710997-d33d-4ff1-a96f-433b2815906b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:41.737710 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-67710997-d33d-4ff1-a96f-433b2815906b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.087284 Sep 21 16:49:41.738267 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 825/1572] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:41 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:42.602684 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-7ec56773-49e6-498b-9eff-639021ebf8bb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:42.603293 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-7ec56773-49e6-498b-9eff-639021ebf8bb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:42.609637 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7ec56773-49e6-498b-9eff-639021ebf8bb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:42.610145 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7ec56773-49e6-498b-9eff-639021ebf8bb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:42.610586 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7ec56773-49e6-498b-9eff-639021ebf8bb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:42.611285 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7ec56773-49e6-498b-9eff-639021ebf8bb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:42.611734 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7ec56773-49e6-498b-9eff-639021ebf8bb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:42.612156 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7ec56773-49e6-498b-9eff-639021ebf8bb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:42.672332 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-7ec56773-49e6-498b-9eff-639021ebf8bb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:42.680990 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-7ec56773-49e6-498b-9eff-639021ebf8bb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.082877 Sep 21 16:49:42.681559 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 748/1573] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:42 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:42.760919 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-13ab5139-8f07-402c-a19b-4b06c6bf12bf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:42.761456 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-13ab5139-8f07-402c-a19b-4b06c6bf12bf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:42.767837 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-13ab5139-8f07-402c-a19b-4b06c6bf12bf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:42.768306 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-13ab5139-8f07-402c-a19b-4b06c6bf12bf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:42.768730 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-13ab5139-8f07-402c-a19b-4b06c6bf12bf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:42.769411 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-13ab5139-8f07-402c-a19b-4b06c6bf12bf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:42.769861 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-13ab5139-8f07-402c-a19b-4b06c6bf12bf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:42.770303 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-13ab5139-8f07-402c-a19b-4b06c6bf12bf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:42.834220 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-13ab5139-8f07-402c-a19b-4b06c6bf12bf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:42.841742 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-13ab5139-8f07-402c-a19b-4b06c6bf12bf tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.084737 Sep 21 16:49:42.842341 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 826/1574] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:42 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:49:43.704023 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-805dfc07-b10f-4ed7-8cae-3c832f12c040 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:43.704632 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-805dfc07-b10f-4ed7-8cae-3c832f12c040 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:43.711972 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-805dfc07-b10f-4ed7-8cae-3c832f12c040 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:43.712442 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-805dfc07-b10f-4ed7-8cae-3c832f12c040 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:43.712870 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-805dfc07-b10f-4ed7-8cae-3c832f12c040 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:43.713544 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-805dfc07-b10f-4ed7-8cae-3c832f12c040 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:43.713988 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-805dfc07-b10f-4ed7-8cae-3c832f12c040 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:43.714424 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-805dfc07-b10f-4ed7-8cae-3c832f12c040 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:43.776540 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-805dfc07-b10f-4ed7-8cae-3c832f12c040 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:43.784668 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-805dfc07-b10f-4ed7-8cae-3c832f12c040 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.084485 Sep 21 16:49:43.785241 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 749/1575] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:43 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:43.864521 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-304800a9-b69e-41b2-a46c-260db1da444d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:43.865508 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-304800a9-b69e-41b2-a46c-260db1da444d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:43.867795 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_api:SELECT=56 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:49:43.873009 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-304800a9-b69e-41b2-a46c-260db1da444d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:43.873483 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-304800a9-b69e-41b2-a46c-260db1da444d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:43.873912 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-304800a9-b69e-41b2-a46c-260db1da444d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:43.874622 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-304800a9-b69e-41b2-a46c-260db1da444d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:43.875073 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-304800a9-b69e-41b2-a46c-260db1da444d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:43.875487 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-304800a9-b69e-41b2-a46c-260db1da444d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:43.939055 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-304800a9-b69e-41b2-a46c-260db1da444d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:43.947524 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-304800a9-b69e-41b2-a46c-260db1da444d tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.086804 Sep 21 16:49:43.948086 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 827/1576] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:43 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:44.807828 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-4df70efa-2a8a-447f-aea0-a85ea30df462 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:44.808573 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-4df70efa-2a8a-447f-aea0-a85ea30df462 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:44.814796 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4df70efa-2a8a-447f-aea0-a85ea30df462 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:44.815274 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4df70efa-2a8a-447f-aea0-a85ea30df462 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:44.815704 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4df70efa-2a8a-447f-aea0-a85ea30df462 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:44.816395 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4df70efa-2a8a-447f-aea0-a85ea30df462 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:44.816846 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4df70efa-2a8a-447f-aea0-a85ea30df462 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:44.817266 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4df70efa-2a8a-447f-aea0-a85ea30df462 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:44.881725 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-4df70efa-2a8a-447f-aea0-a85ea30df462 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:44.889925 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-4df70efa-2a8a-447f-aea0-a85ea30df462 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.086026 Sep 21 16:49:44.890522 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 750/1577] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:44 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:44.970069 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-2e317a27-20d0-4cfb-8029-44e939eb8857 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:44.970717 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-2e317a27-20d0-4cfb-8029-44e939eb8857 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:44.977057 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2e317a27-20d0-4cfb-8029-44e939eb8857 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:44.977539 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2e317a27-20d0-4cfb-8029-44e939eb8857 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:44.977966 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2e317a27-20d0-4cfb-8029-44e939eb8857 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:44.978675 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2e317a27-20d0-4cfb-8029-44e939eb8857 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:44.979124 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2e317a27-20d0-4cfb-8029-44e939eb8857 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:44.979539 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2e317a27-20d0-4cfb-8029-44e939eb8857 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:45.040759 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-2e317a27-20d0-4cfb-8029-44e939eb8857 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:45.048455 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-2e317a27-20d0-4cfb-8029-44e939eb8857 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082259 Sep 21 16:49:45.049021 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 828/1578] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:44 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:45.913251 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-f480d16a-70ef-4c9d-9f5f-8f92f046c56b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:45.913866 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-f480d16a-70ef-4c9d-9f5f-8f92f046c56b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:45.920306 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f480d16a-70ef-4c9d-9f5f-8f92f046c56b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:45.920787 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f480d16a-70ef-4c9d-9f5f-8f92f046c56b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:45.921226 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f480d16a-70ef-4c9d-9f5f-8f92f046c56b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:45.921910 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f480d16a-70ef-4c9d-9f5f-8f92f046c56b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:45.922400 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f480d16a-70ef-4c9d-9f5f-8f92f046c56b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:45.922823 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f480d16a-70ef-4c9d-9f5f-8f92f046c56b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:45.983302 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-f480d16a-70ef-4c9d-9f5f-8f92f046c56b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:45.991923 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-f480d16a-70ef-4c9d-9f5f-8f92f046c56b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.083132 Sep 21 16:49:45.992483 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 751/1579] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:45 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:46.072153 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-1492c04b-a767-438a-8b63-f96fbe801a97 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:46.072757 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-1492c04b-a767-438a-8b63-f96fbe801a97 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:46.079110 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1492c04b-a767-438a-8b63-f96fbe801a97 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:46.079589 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1492c04b-a767-438a-8b63-f96fbe801a97 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:46.080016 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1492c04b-a767-438a-8b63-f96fbe801a97 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:46.080955 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1492c04b-a767-438a-8b63-f96fbe801a97 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:46.081405 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1492c04b-a767-438a-8b63-f96fbe801a97 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:46.081827 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1492c04b-a767-438a-8b63-f96fbe801a97 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:46.141947 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-1492c04b-a767-438a-8b63-f96fbe801a97 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:46.150231 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-1492c04b-a767-438a-8b63-f96fbe801a97 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082612 Sep 21 16:49:46.150795 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 829/1580] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:46 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:47.014315 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-ed54c7cc-f4ac-4696-a689-19ccb2f33c18 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:47.014924 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-ed54c7cc-f4ac-4696-a689-19ccb2f33c18 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:47.017290 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_api:SELECT=56 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:49:47.022615 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ed54c7cc-f4ac-4696-a689-19ccb2f33c18 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:47.023087 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ed54c7cc-f4ac-4696-a689-19ccb2f33c18 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:47.023514 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ed54c7cc-f4ac-4696-a689-19ccb2f33c18 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:47.024195 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ed54c7cc-f4ac-4696-a689-19ccb2f33c18 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:47.024639 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ed54c7cc-f4ac-4696-a689-19ccb2f33c18 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:47.025055 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ed54c7cc-f4ac-4696-a689-19ccb2f33c18 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:47.085727 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-ed54c7cc-f4ac-4696-a689-19ccb2f33c18 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:47.093815 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-ed54c7cc-f4ac-4696-a689-19ccb2f33c18 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.083359 Sep 21 16:49:47.094411 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 752/1581] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:47 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:47.172920 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-76d42ea1-3ecb-4fb8-bafe-1c3c3136ebe3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:47.173529 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-76d42ea1-3ecb-4fb8-bafe-1c3c3136ebe3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:47.180456 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-76d42ea1-3ecb-4fb8-bafe-1c3c3136ebe3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:47.180933 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-76d42ea1-3ecb-4fb8-bafe-1c3c3136ebe3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:47.181364 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-76d42ea1-3ecb-4fb8-bafe-1c3c3136ebe3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:47.182074 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-76d42ea1-3ecb-4fb8-bafe-1c3c3136ebe3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:47.182516 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-76d42ea1-3ecb-4fb8-bafe-1c3c3136ebe3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:47.182934 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-76d42ea1-3ecb-4fb8-bafe-1c3c3136ebe3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:47.243822 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-76d42ea1-3ecb-4fb8-bafe-1c3c3136ebe3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:47.251440 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-76d42ea1-3ecb-4fb8-bafe-1c3c3136ebe3 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082640 Sep 21 16:49:47.251995 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 830/1582] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:47 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:48.117193 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-9462dd2d-e252-4dc8-9fc9-443ca2b3565f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:48.117805 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-9462dd2d-e252-4dc8-9fc9-443ca2b3565f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:48.124226 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9462dd2d-e252-4dc8-9fc9-443ca2b3565f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:48.124717 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9462dd2d-e252-4dc8-9fc9-443ca2b3565f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:48.125145 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9462dd2d-e252-4dc8-9fc9-443ca2b3565f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:48.125830 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9462dd2d-e252-4dc8-9fc9-443ca2b3565f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:48.126306 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9462dd2d-e252-4dc8-9fc9-443ca2b3565f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:48.126731 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9462dd2d-e252-4dc8-9fc9-443ca2b3565f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:48.186723 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-9462dd2d-e252-4dc8-9fc9-443ca2b3565f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:48.194713 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-9462dd2d-e252-4dc8-9fc9-443ca2b3565f tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.082070 Sep 21 16:49:48.195278 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 753/1583] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:48 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:48.274949 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-2b3eca16-9085-499b-82bc-8a3a5cb816fe tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:48.275554 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-2b3eca16-9085-499b-82bc-8a3a5cb816fe tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:48.282224 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2b3eca16-9085-499b-82bc-8a3a5cb816fe tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:48.282964 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2b3eca16-9085-499b-82bc-8a3a5cb816fe tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:48.283400 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2b3eca16-9085-499b-82bc-8a3a5cb816fe tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:48.284086 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2b3eca16-9085-499b-82bc-8a3a5cb816fe tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:48.284541 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2b3eca16-9085-499b-82bc-8a3a5cb816fe tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:48.284962 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2b3eca16-9085-499b-82bc-8a3a5cb816fe tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:48.352716 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-2b3eca16-9085-499b-82bc-8a3a5cb816fe tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:48.360422 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-2b3eca16-9085-499b-82bc-8a3a5cb816fe tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.089912 Sep 21 16:49:48.360989 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 831/1584] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:48 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:49.217611 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-00c8ee50-4edc-45cc-96bf-9f7080130b2d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:49.218267 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-00c8ee50-4edc-45cc-96bf-9f7080130b2d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:49.224873 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-00c8ee50-4edc-45cc-96bf-9f7080130b2d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:49.225359 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-00c8ee50-4edc-45cc-96bf-9f7080130b2d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:49.225794 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-00c8ee50-4edc-45cc-96bf-9f7080130b2d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:49.226556 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-00c8ee50-4edc-45cc-96bf-9f7080130b2d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:49.227018 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-00c8ee50-4edc-45cc-96bf-9f7080130b2d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:49.227443 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-00c8ee50-4edc-45cc-96bf-9f7080130b2d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:49.289990 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-00c8ee50-4edc-45cc-96bf-9f7080130b2d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:49.298154 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-00c8ee50-4edc-45cc-96bf-9f7080130b2d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.084514 Sep 21 16:49:49.298753 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 754/1585] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:49 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:49.384259 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-fc0cab62-ff88-4bb5-9e90-be04add95023 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:49.384868 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-fc0cab62-ff88-4bb5-9e90-be04add95023 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:49.391337 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fc0cab62-ff88-4bb5-9e90-be04add95023 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:49.391816 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fc0cab62-ff88-4bb5-9e90-be04add95023 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:49.392246 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fc0cab62-ff88-4bb5-9e90-be04add95023 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:49.392934 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fc0cab62-ff88-4bb5-9e90-be04add95023 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:49.393383 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fc0cab62-ff88-4bb5-9e90-be04add95023 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:49.394116 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fc0cab62-ff88-4bb5-9e90-be04add95023 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:49.456724 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-fc0cab62-ff88-4bb5-9e90-be04add95023 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:49.464248 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-fc0cab62-ff88-4bb5-9e90-be04add95023 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.084473 Sep 21 16:49:49.464807 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 832/1586] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:49 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:50.321543 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-aa14d133-44f7-4501-98e1-038a9ca46b65 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:50.322292 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-aa14d133-44f7-4501-98e1-038a9ca46b65 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:50.328688 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-aa14d133-44f7-4501-98e1-038a9ca46b65 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:50.329163 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-aa14d133-44f7-4501-98e1-038a9ca46b65 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:50.329591 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-aa14d133-44f7-4501-98e1-038a9ca46b65 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:50.330305 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-aa14d133-44f7-4501-98e1-038a9ca46b65 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:50.331017 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-aa14d133-44f7-4501-98e1-038a9ca46b65 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:50.331437 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-aa14d133-44f7-4501-98e1-038a9ca46b65 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:50.395456 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-aa14d133-44f7-4501-98e1-038a9ca46b65 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:50.403703 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-aa14d133-44f7-4501-98e1-038a9ca46b65 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.086159 Sep 21 16:49:50.404263 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 755/1587] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:50 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:50.486415 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-8f24ad5e-ea8e-4ba6-a5d9-8abb4b235b7b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:50.487450 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-8f24ad5e-ea8e-4ba6-a5d9-8abb4b235b7b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:50.494279 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8f24ad5e-ea8e-4ba6-a5d9-8abb4b235b7b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:50.494769 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8f24ad5e-ea8e-4ba6-a5d9-8abb4b235b7b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:50.495204 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8f24ad5e-ea8e-4ba6-a5d9-8abb4b235b7b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:50.495903 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8f24ad5e-ea8e-4ba6-a5d9-8abb4b235b7b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:50.496357 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8f24ad5e-ea8e-4ba6-a5d9-8abb4b235b7b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:50.496783 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8f24ad5e-ea8e-4ba6-a5d9-8abb4b235b7b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:50.556314 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-8f24ad5e-ea8e-4ba6-a5d9-8abb4b235b7b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:50.563851 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-8f24ad5e-ea8e-4ba6-a5d9-8abb4b235b7b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081242 Sep 21 16:49:50.564423 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 833/1588] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:50 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:51.426149 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-120793e2-965c-4409-8ef5-3688e593b1a9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:51.426751 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-120793e2-965c-4409-8ef5-3688e593b1a9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:51.433822 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-120793e2-965c-4409-8ef5-3688e593b1a9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:51.434339 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-120793e2-965c-4409-8ef5-3688e593b1a9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:51.434774 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-120793e2-965c-4409-8ef5-3688e593b1a9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:51.435454 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-120793e2-965c-4409-8ef5-3688e593b1a9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:51.435900 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-120793e2-965c-4409-8ef5-3688e593b1a9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:51.436318 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-120793e2-965c-4409-8ef5-3688e593b1a9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:51.498257 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-120793e2-965c-4409-8ef5-3688e593b1a9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:51.507313 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-120793e2-965c-4409-8ef5-3688e593b1a9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.085040 Sep 21 16:49:51.507889 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 756/1589] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:51 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:49:51.587224 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-7fe676c7-0c1d-4cee-9187-d8fcfbfa5626 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:51.587842 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-7fe676c7-0c1d-4cee-9187-d8fcfbfa5626 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:51.594501 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7fe676c7-0c1d-4cee-9187-d8fcfbfa5626 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:51.594981 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7fe676c7-0c1d-4cee-9187-d8fcfbfa5626 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:51.595414 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7fe676c7-0c1d-4cee-9187-d8fcfbfa5626 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:51.596106 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7fe676c7-0c1d-4cee-9187-d8fcfbfa5626 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:51.596560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7fe676c7-0c1d-4cee-9187-d8fcfbfa5626 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:51.596983 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7fe676c7-0c1d-4cee-9187-d8fcfbfa5626 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:51.657930 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-7fe676c7-0c1d-4cee-9187-d8fcfbfa5626 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:51.666348 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-7fe676c7-0c1d-4cee-9187-d8fcfbfa5626 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083083 Sep 21 16:49:51.666926 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 834/1590] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:51 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:52.529741 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-df3e07cb-7f3c-4445-b94c-3746b3d140b9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:52.530412 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-df3e07cb-7f3c-4445-b94c-3746b3d140b9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:52.536801 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-df3e07cb-7f3c-4445-b94c-3746b3d140b9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:52.537300 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-df3e07cb-7f3c-4445-b94c-3746b3d140b9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:52.537726 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-df3e07cb-7f3c-4445-b94c-3746b3d140b9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:52.538427 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-df3e07cb-7f3c-4445-b94c-3746b3d140b9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:52.538872 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-df3e07cb-7f3c-4445-b94c-3746b3d140b9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:52.539284 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-df3e07cb-7f3c-4445-b94c-3746b3d140b9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:52.600857 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-df3e07cb-7f3c-4445-b94c-3746b3d140b9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:52.609102 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-df3e07cb-7f3c-4445-b94c-3746b3d140b9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.083198 Sep 21 16:49:52.609694 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 757/1591] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:52 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:52.688573 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-aa5f255c-51db-4d8d-82ac-fa802d4548f4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:52.689204 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-aa5f255c-51db-4d8d-82ac-fa802d4548f4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:52.696317 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-aa5f255c-51db-4d8d-82ac-fa802d4548f4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:52.696796 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-aa5f255c-51db-4d8d-82ac-fa802d4548f4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:52.697225 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-aa5f255c-51db-4d8d-82ac-fa802d4548f4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:52.697908 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-aa5f255c-51db-4d8d-82ac-fa802d4548f4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:52.698388 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-aa5f255c-51db-4d8d-82ac-fa802d4548f4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:52.698811 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-aa5f255c-51db-4d8d-82ac-fa802d4548f4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:52.761927 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-aa5f255c-51db-4d8d-82ac-fa802d4548f4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:52.769644 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-aa5f255c-51db-4d8d-82ac-fa802d4548f4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.084908 Sep 21 16:49:52.770237 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 835/1592] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:52 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:53.632350 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-2425c35d-3297-440d-a0b0-cb70c74f4e2a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:53.632965 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-2425c35d-3297-440d-a0b0-cb70c74f4e2a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:53.639358 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2425c35d-3297-440d-a0b0-cb70c74f4e2a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:53.639838 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2425c35d-3297-440d-a0b0-cb70c74f4e2a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:53.640276 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2425c35d-3297-440d-a0b0-cb70c74f4e2a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:53.640967 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2425c35d-3297-440d-a0b0-cb70c74f4e2a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:53.641418 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2425c35d-3297-440d-a0b0-cb70c74f4e2a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:53.641836 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2425c35d-3297-440d-a0b0-cb70c74f4e2a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:53.705871 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-2425c35d-3297-440d-a0b0-cb70c74f4e2a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:53.713911 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-2425c35d-3297-440d-a0b0-cb70c74f4e2a tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.086021 Sep 21 16:49:53.714507 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 758/1593] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:53 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:53.791515 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-1da49ff7-38f3-41ba-acb1-61a36ada36f8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:53.792042 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-1da49ff7-38f3-41ba-acb1-61a36ada36f8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:53.798504 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1da49ff7-38f3-41ba-acb1-61a36ada36f8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:53.798979 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1da49ff7-38f3-41ba-acb1-61a36ada36f8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:53.799433 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1da49ff7-38f3-41ba-acb1-61a36ada36f8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:53.800118 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1da49ff7-38f3-41ba-acb1-61a36ada36f8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:53.800565 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1da49ff7-38f3-41ba-acb1-61a36ada36f8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:53.800981 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1da49ff7-38f3-41ba-acb1-61a36ada36f8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:53.861973 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-1da49ff7-38f3-41ba-acb1-61a36ada36f8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:53.869494 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-1da49ff7-38f3-41ba-acb1-61a36ada36f8 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081887 Sep 21 16:49:53.870068 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 836/1594] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:53 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:54.736366 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-1c7c1f1e-4e69-4d75-b460-f8a58b45be3d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:54.737021 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-1c7c1f1e-4e69-4d75-b460-f8a58b45be3d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:54.743835 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1c7c1f1e-4e69-4d75-b460-f8a58b45be3d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:54.744308 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1c7c1f1e-4e69-4d75-b460-f8a58b45be3d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:54.744735 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1c7c1f1e-4e69-4d75-b460-f8a58b45be3d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:54.745417 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1c7c1f1e-4e69-4d75-b460-f8a58b45be3d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:54.745859 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1c7c1f1e-4e69-4d75-b460-f8a58b45be3d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:54.746299 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1c7c1f1e-4e69-4d75-b460-f8a58b45be3d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:54.808046 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-1c7c1f1e-4e69-4d75-b460-f8a58b45be3d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:54.816070 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-1c7c1f1e-4e69-4d75-b460-f8a58b45be3d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.083549 Sep 21 16:49:54.816636 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 759/1595] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:54 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:54.892201 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-dfc6d2cb-139b-4c05-9bd1-e0e7b1740c6f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:54.892810 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-dfc6d2cb-139b-4c05-9bd1-e0e7b1740c6f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:54.899185 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dfc6d2cb-139b-4c05-9bd1-e0e7b1740c6f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:54.899661 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dfc6d2cb-139b-4c05-9bd1-e0e7b1740c6f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:54.900096 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dfc6d2cb-139b-4c05-9bd1-e0e7b1740c6f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:54.900779 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dfc6d2cb-139b-4c05-9bd1-e0e7b1740c6f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:54.901228 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dfc6d2cb-139b-4c05-9bd1-e0e7b1740c6f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:54.901648 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dfc6d2cb-139b-4c05-9bd1-e0e7b1740c6f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:54.905515 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=100 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:49:54.963333 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-dfc6d2cb-139b-4c05-9bd1-e0e7b1740c6f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:54.970912 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-dfc6d2cb-139b-4c05-9bd1-e0e7b1740c6f tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.082629 Sep 21 16:49:54.971480 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 837/1596] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:54 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:55.838951 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-6cc1da24-2087-4838-967e-fa1e498d75b7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:55.839510 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-6cc1da24-2087-4838-967e-fa1e498d75b7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:55.845819 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6cc1da24-2087-4838-967e-fa1e498d75b7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:55.846340 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6cc1da24-2087-4838-967e-fa1e498d75b7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:55.846775 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6cc1da24-2087-4838-967e-fa1e498d75b7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:55.847469 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6cc1da24-2087-4838-967e-fa1e498d75b7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:55.847923 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6cc1da24-2087-4838-967e-fa1e498d75b7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:55.848345 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6cc1da24-2087-4838-967e-fa1e498d75b7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:55.909926 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-6cc1da24-2087-4838-967e-fa1e498d75b7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:55.918845 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-6cc1da24-2087-4838-967e-fa1e498d75b7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.083932 Sep 21 16:49:55.919420 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 760/1597] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:55 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:55.992885 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-fcb38985-79b9-44f4-80b6-ba59d8bf37f5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:55.993489 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-fcb38985-79b9-44f4-80b6-ba59d8bf37f5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:56.000004 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fcb38985-79b9-44f4-80b6-ba59d8bf37f5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:56.000489 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fcb38985-79b9-44f4-80b6-ba59d8bf37f5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:56.000924 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fcb38985-79b9-44f4-80b6-ba59d8bf37f5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:56.001617 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fcb38985-79b9-44f4-80b6-ba59d8bf37f5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:56.002095 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fcb38985-79b9-44f4-80b6-ba59d8bf37f5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:56.002527 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fcb38985-79b9-44f4-80b6-ba59d8bf37f5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:56.063026 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-fcb38985-79b9-44f4-80b6-ba59d8bf37f5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:56.071681 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-fcb38985-79b9-44f4-80b6-ba59d8bf37f5 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083185 Sep 21 16:49:56.072266 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 838/1598] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:55 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:56.942070 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-a6775bb4-7432-44b8-8a07-9ebc58a46e91 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:56.942701 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-a6775bb4-7432-44b8-8a07-9ebc58a46e91 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:56.949114 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a6775bb4-7432-44b8-8a07-9ebc58a46e91 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:56.949597 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a6775bb4-7432-44b8-8a07-9ebc58a46e91 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:56.950029 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a6775bb4-7432-44b8-8a07-9ebc58a46e91 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:56.950739 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a6775bb4-7432-44b8-8a07-9ebc58a46e91 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:56.951189 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a6775bb4-7432-44b8-8a07-9ebc58a46e91 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:56.951606 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a6775bb4-7432-44b8-8a07-9ebc58a46e91 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:57.015836 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-a6775bb4-7432-44b8-8a07-9ebc58a46e91 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:57.018333 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=100 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:49:57.026290 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-a6775bb4-7432-44b8-8a07-9ebc58a46e91 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.088018 Sep 21 16:49:57.026858 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 761/1599] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:56 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:57.097553 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-5be29310-2b56-43a6-b9ad-04d74f9ccca7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:57.098230 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-5be29310-2b56-43a6-b9ad-04d74f9ccca7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:57.104761 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5be29310-2b56-43a6-b9ad-04d74f9ccca7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:57.105242 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5be29310-2b56-43a6-b9ad-04d74f9ccca7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:57.105676 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5be29310-2b56-43a6-b9ad-04d74f9ccca7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:57.106405 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5be29310-2b56-43a6-b9ad-04d74f9ccca7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:57.106863 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5be29310-2b56-43a6-b9ad-04d74f9ccca7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:57.107285 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-5be29310-2b56-43a6-b9ad-04d74f9ccca7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:57.172995 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-5be29310-2b56-43a6-b9ad-04d74f9ccca7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:57.180842 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-5be29310-2b56-43a6-b9ad-04d74f9ccca7 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.087195 Sep 21 16:49:57.181415 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 839/1600] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:57 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:58.048716 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-f0ef2500-46a4-4be4-b724-cc674c2e5fdf tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:58.049323 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-f0ef2500-46a4-4be4-b724-cc674c2e5fdf tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:58.056359 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f0ef2500-46a4-4be4-b724-cc674c2e5fdf tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:58.056834 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f0ef2500-46a4-4be4-b724-cc674c2e5fdf tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:58.057264 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f0ef2500-46a4-4be4-b724-cc674c2e5fdf tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:58.057944 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f0ef2500-46a4-4be4-b724-cc674c2e5fdf tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:58.058416 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f0ef2500-46a4-4be4-b724-cc674c2e5fdf tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:58.058830 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f0ef2500-46a4-4be4-b724-cc674c2e5fdf tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:58.123580 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-f0ef2500-46a4-4be4-b724-cc674c2e5fdf tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:58.131688 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-f0ef2500-46a4-4be4-b724-cc674c2e5fdf tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.086802 Sep 21 16:49:58.132273 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 762/1601] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:58 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:49:58.203551 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-d61d9204-75dc-45b1-8d45-13187908e0eb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:58.204162 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-d61d9204-75dc-45b1-8d45-13187908e0eb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:58.211353 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d61d9204-75dc-45b1-8d45-13187908e0eb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:58.211832 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d61d9204-75dc-45b1-8d45-13187908e0eb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:58.212268 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d61d9204-75dc-45b1-8d45-13187908e0eb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:58.212956 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d61d9204-75dc-45b1-8d45-13187908e0eb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:58.213418 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d61d9204-75dc-45b1-8d45-13187908e0eb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:58.213841 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d61d9204-75dc-45b1-8d45-13187908e0eb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:58.273661 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d61d9204-75dc-45b1-8d45-13187908e0eb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:58.281411 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-d61d9204-75dc-45b1-8d45-13187908e0eb tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081675 Sep 21 16:49:58.282078 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 840/1602] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:58 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:49:59.155053 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-e9d1d4d8-c1e5-4306-9b46-d725d9bd57be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:59.155842 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-e9d1d4d8-c1e5-4306-9b46-d725d9bd57be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:59.162280 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e9d1d4d8-c1e5-4306-9b46-d725d9bd57be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:59.162765 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e9d1d4d8-c1e5-4306-9b46-d725d9bd57be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:59.163199 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e9d1d4d8-c1e5-4306-9b46-d725d9bd57be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:59.163890 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e9d1d4d8-c1e5-4306-9b46-d725d9bd57be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:59.164343 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e9d1d4d8-c1e5-4306-9b46-d725d9bd57be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:59.164766 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e9d1d4d8-c1e5-4306-9b46-d725d9bd57be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:59.225081 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-e9d1d4d8-c1e5-4306-9b46-d725d9bd57be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:59.233289 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-e9d1d4d8-c1e5-4306-9b46-d725d9bd57be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.082052 Sep 21 16:49:59.233804 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 763/1603] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:59 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:49:59.305267 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-b2a23873-70d2-4ac1-a42f-c073b37c7006 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:49:59.305874 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-b2a23873-70d2-4ac1-a42f-c073b37c7006 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:49:59.312398 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b2a23873-70d2-4ac1-a42f-c073b37c7006 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:59.312864 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b2a23873-70d2-4ac1-a42f-c073b37c7006 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:59.313296 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b2a23873-70d2-4ac1-a42f-c073b37c7006 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:59.313987 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b2a23873-70d2-4ac1-a42f-c073b37c7006 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:49:59.314475 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b2a23873-70d2-4ac1-a42f-c073b37c7006 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:49:59.314899 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b2a23873-70d2-4ac1-a42f-c073b37c7006 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:49:59.374609 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-b2a23873-70d2-4ac1-a42f-c073b37c7006 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:49:59.382257 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-b2a23873-70d2-4ac1-a42f-c073b37c7006 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081445 Sep 21 16:49:59.382825 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 841/1604] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:49:59 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:00.256871 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-fabe121b-1009-4a3b-85a3-375de6b9d2fc tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:00.257485 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-fabe121b-1009-4a3b-85a3-375de6b9d2fc tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:00.263892 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fabe121b-1009-4a3b-85a3-375de6b9d2fc tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:00.264371 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fabe121b-1009-4a3b-85a3-375de6b9d2fc tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:00.264801 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fabe121b-1009-4a3b-85a3-375de6b9d2fc tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:00.265489 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fabe121b-1009-4a3b-85a3-375de6b9d2fc tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:00.265940 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fabe121b-1009-4a3b-85a3-375de6b9d2fc tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:00.266387 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-fabe121b-1009-4a3b-85a3-375de6b9d2fc tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:00.326386 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-fabe121b-1009-4a3b-85a3-375de6b9d2fc tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:00.335217 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-fabe121b-1009-4a3b-85a3-375de6b9d2fc tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.082687 Sep 21 16:50:00.335777 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 764/1605] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:00 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:00.404161 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-13d95906-8ddc-4c93-89e5-805327151917 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:00.404822 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-13d95906-8ddc-4c93-89e5-805327151917 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:00.411152 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-13d95906-8ddc-4c93-89e5-805327151917 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:00.411634 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-13d95906-8ddc-4c93-89e5-805327151917 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:00.412096 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-13d95906-8ddc-4c93-89e5-805327151917 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:00.412786 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-13d95906-8ddc-4c93-89e5-805327151917 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:00.413244 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-13d95906-8ddc-4c93-89e5-805327151917 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:00.413664 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-13d95906-8ddc-4c93-89e5-805327151917 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:00.473001 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-13d95906-8ddc-4c93-89e5-805327151917 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:00.480719 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-13d95906-8ddc-4c93-89e5-805327151917 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.080365 Sep 21 16:50:00.481285 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 842/1606] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:00 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:01.357686 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-35569363-e37e-435f-b6b0-98ec57dc3974 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:01.358316 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-35569363-e37e-435f-b6b0-98ec57dc3974 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:01.364729 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-35569363-e37e-435f-b6b0-98ec57dc3974 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:01.365245 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-35569363-e37e-435f-b6b0-98ec57dc3974 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:01.365676 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-35569363-e37e-435f-b6b0-98ec57dc3974 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:01.366376 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-35569363-e37e-435f-b6b0-98ec57dc3974 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:01.366824 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-35569363-e37e-435f-b6b0-98ec57dc3974 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:01.367241 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-35569363-e37e-435f-b6b0-98ec57dc3974 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:01.429054 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-35569363-e37e-435f-b6b0-98ec57dc3974 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:01.437252 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-35569363-e37e-435f-b6b0-98ec57dc3974 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.083374 Sep 21 16:50:01.437819 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 765/1607] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:01 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:01.505131 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-92c820a9-4b36-4a18-b834-8315676310a4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:01.506330 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-92c820a9-4b36-4a18-b834-8315676310a4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:01.513031 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-92c820a9-4b36-4a18-b834-8315676310a4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:01.513524 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-92c820a9-4b36-4a18-b834-8315676310a4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:01.513958 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-92c820a9-4b36-4a18-b834-8315676310a4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:01.514854 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-92c820a9-4b36-4a18-b834-8315676310a4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:01.515492 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-92c820a9-4b36-4a18-b834-8315676310a4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:01.516098 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-92c820a9-4b36-4a18-b834-8315676310a4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:01.579319 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-92c820a9-4b36-4a18-b834-8315676310a4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:01.587393 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-92c820a9-4b36-4a18-b834-8315676310a4 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.086355 Sep 21 16:50:01.588005 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 843/1608] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:01 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:02.460783 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-7f5b441b-10f9-43a5-a00e-c4a94d266e3c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:02.461404 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-7f5b441b-10f9-43a5-a00e-c4a94d266e3c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:02.467835 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7f5b441b-10f9-43a5-a00e-c4a94d266e3c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:02.468319 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7f5b441b-10f9-43a5-a00e-c4a94d266e3c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:02.468744 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7f5b441b-10f9-43a5-a00e-c4a94d266e3c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:02.469424 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7f5b441b-10f9-43a5-a00e-c4a94d266e3c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:02.469870 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7f5b441b-10f9-43a5-a00e-c4a94d266e3c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:02.470311 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7f5b441b-10f9-43a5-a00e-c4a94d266e3c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:02.533490 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-7f5b441b-10f9-43a5-a00e-c4a94d266e3c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:02.542116 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-7f5b441b-10f9-43a5-a00e-c4a94d266e3c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.086016 Sep 21 16:50:02.542682 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 766/1609] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:02 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:02.610732 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-26b0c14a-d836-4448-b9cb-c6c121442eef tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:02.611344 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-26b0c14a-d836-4448-b9cb-c6c121442eef tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:02.618498 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-26b0c14a-d836-4448-b9cb-c6c121442eef tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:02.618981 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-26b0c14a-d836-4448-b9cb-c6c121442eef tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:02.619420 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-26b0c14a-d836-4448-b9cb-c6c121442eef tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:02.620110 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-26b0c14a-d836-4448-b9cb-c6c121442eef tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:02.620564 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-26b0c14a-d836-4448-b9cb-c6c121442eef tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:02.620987 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-26b0c14a-d836-4448-b9cb-c6c121442eef tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:02.680682 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-26b0c14a-d836-4448-b9cb-c6c121442eef tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:02.688370 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-26b0c14a-d836-4448-b9cb-c6c121442eef tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.081502 Sep 21 16:50:02.688940 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 844/1610] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:02 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:03.565142 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-9674ffa1-b2b8-40b4-82b1-029e1ec0b81d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:03.565754 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-9674ffa1-b2b8-40b4-82b1-029e1ec0b81d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:03.572802 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9674ffa1-b2b8-40b4-82b1-029e1ec0b81d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:03.573286 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9674ffa1-b2b8-40b4-82b1-029e1ec0b81d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:03.573720 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9674ffa1-b2b8-40b4-82b1-029e1ec0b81d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:03.574443 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9674ffa1-b2b8-40b4-82b1-029e1ec0b81d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:03.574893 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9674ffa1-b2b8-40b4-82b1-029e1ec0b81d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:03.575312 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9674ffa1-b2b8-40b4-82b1-029e1ec0b81d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:03.635810 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-9674ffa1-b2b8-40b4-82b1-029e1ec0b81d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:03.643915 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-9674ffa1-b2b8-40b4-82b1-029e1ec0b81d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.082645 Sep 21 16:50:03.644489 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 767/1611] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:03 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:03.711097 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ee94da07-28a8-49c9-aecb-bc3407fedf1e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:03.711705 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ee94da07-28a8-49c9-aecb-bc3407fedf1e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:03.718010 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ee94da07-28a8-49c9-aecb-bc3407fedf1e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:03.718510 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ee94da07-28a8-49c9-aecb-bc3407fedf1e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:03.718964 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ee94da07-28a8-49c9-aecb-bc3407fedf1e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:03.719642 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ee94da07-28a8-49c9-aecb-bc3407fedf1e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:03.720090 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ee94da07-28a8-49c9-aecb-bc3407fedf1e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:03.720506 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ee94da07-28a8-49c9-aecb-bc3407fedf1e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:03.782570 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ee94da07-28a8-49c9-aecb-bc3407fedf1e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:03.790748 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ee94da07-28a8-49c9-aecb-bc3407fedf1e tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.083508 Sep 21 16:50:03.791310 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 845/1612] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:03 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:04.667771 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-11adebae-ae6c-43ec-80dd-ff7aab8dfc39 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:04.668379 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-11adebae-ae6c-43ec-80dd-ff7aab8dfc39 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:04.674747 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-11adebae-ae6c-43ec-80dd-ff7aab8dfc39 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:04.675225 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-11adebae-ae6c-43ec-80dd-ff7aab8dfc39 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:04.675659 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-11adebae-ae6c-43ec-80dd-ff7aab8dfc39 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:04.676342 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-11adebae-ae6c-43ec-80dd-ff7aab8dfc39 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:04.676792 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-11adebae-ae6c-43ec-80dd-ff7aab8dfc39 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:04.677211 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-11adebae-ae6c-43ec-80dd-ff7aab8dfc39 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:04.739681 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-11adebae-ae6c-43ec-80dd-ff7aab8dfc39 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:04.748305 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-11adebae-ae6c-43ec-80dd-ff7aab8dfc39 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.084474 Sep 21 16:50:04.748863 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 768/1613] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:04 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:04.812864 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-0d2dde50-a386-40e6-ad5a-539fb156b162 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:04.813495 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-0d2dde50-a386-40e6-ad5a-539fb156b162 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:04.819878 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0d2dde50-a386-40e6-ad5a-539fb156b162 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:04.820352 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0d2dde50-a386-40e6-ad5a-539fb156b162 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:04.820778 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0d2dde50-a386-40e6-ad5a-539fb156b162 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:04.821462 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0d2dde50-a386-40e6-ad5a-539fb156b162 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:04.821909 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0d2dde50-a386-40e6-ad5a-539fb156b162 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:04.822352 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0d2dde50-a386-40e6-ad5a-539fb156b162 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:04.881369 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-0d2dde50-a386-40e6-ad5a-539fb156b162 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:04.888937 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-0d2dde50-a386-40e6-ad5a-539fb156b162 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.079929 Sep 21 16:50:04.889507 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 846/1614] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:04 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:05.770866 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-0e34c52f-c327-4376-8043-b26b4f1bad46 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:05.771415 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-0e34c52f-c327-4376-8043-b26b4f1bad46 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:05.777789 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0e34c52f-c327-4376-8043-b26b4f1bad46 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:05.778298 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0e34c52f-c327-4376-8043-b26b4f1bad46 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:05.778731 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0e34c52f-c327-4376-8043-b26b4f1bad46 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:05.779416 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0e34c52f-c327-4376-8043-b26b4f1bad46 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:05.779864 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0e34c52f-c327-4376-8043-b26b4f1bad46 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:05.780281 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0e34c52f-c327-4376-8043-b26b4f1bad46 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:05.916434 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-e1f09b61-4f9d-4bc5-95d6-b0cd34332fc9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:05.917152 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-e1f09b61-4f9d-4bc5-95d6-b0cd34332fc9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:05.923806 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e1f09b61-4f9d-4bc5-95d6-b0cd34332fc9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:05.924288 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e1f09b61-4f9d-4bc5-95d6-b0cd34332fc9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:05.924717 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e1f09b61-4f9d-4bc5-95d6-b0cd34332fc9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:05.925441 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e1f09b61-4f9d-4bc5-95d6-b0cd34332fc9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:05.925887 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e1f09b61-4f9d-4bc5-95d6-b0cd34332fc9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:05.926325 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e1f09b61-4f9d-4bc5-95d6-b0cd34332fc9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:05.991130 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-e1f09b61-4f9d-4bc5-95d6-b0cd34332fc9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:05.992293 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-0e34c52f-c327-4376-8043-b26b4f1bad46 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:05.999185 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-e1f09b61-4f9d-4bc5-95d6-b0cd34332fc9 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.087532 Sep 21 16:50:05.999760 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 847/1615] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:05 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:50:06.000278 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-0e34c52f-c327-4376-8043-b26b4f1bad46 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.233364 Sep 21 16:50:06.000924 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 769/1616] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:05 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:07.022514 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-8370c12f-a324-4d0f-acc1-d6659b0b82ec tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:07.023198 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-4aa0d581-34b8-49c9-a2a9-174f1a167b4d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:07.023198 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-4aa0d581-34b8-49c9-a2a9-174f1a167b4d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:07.023682 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-8370c12f-a324-4d0f-acc1-d6659b0b82ec tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 15ec6390-e13e-4e88-8bdc-62507b36a9a6] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:07.029573 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8370c12f-a324-4d0f-acc1-d6659b0b82ec tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:07.029739 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4aa0d581-34b8-49c9-a2a9-174f1a167b4d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:07.030075 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4aa0d581-34b8-49c9-a2a9-174f1a167b4d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:07.030214 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8370c12f-a324-4d0f-acc1-d6659b0b82ec tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:07.030514 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8370c12f-a324-4d0f-acc1-d6659b0b82ec tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:07.030643 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4aa0d581-34b8-49c9-a2a9-174f1a167b4d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:07.031205 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8370c12f-a324-4d0f-acc1-d6659b0b82ec tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:07.031315 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4aa0d581-34b8-49c9-a2a9-174f1a167b4d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:07.031656 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8370c12f-a324-4d0f-acc1-d6659b0b82ec tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:07.031797 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4aa0d581-34b8-49c9-a2a9-174f1a167b4d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:07.032071 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8370c12f-a324-4d0f-acc1-d6659b0b82ec tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:07.032183 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4aa0d581-34b8-49c9-a2a9-174f1a167b4d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:07.095379 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-4aa0d581-34b8-49c9-a2a9-174f1a167b4d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:07.097518 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-8370c12f-a324-4d0f-acc1-d6659b0b82ec tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f619261c21204ea3b5ba624177eb8747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd529e1f3de6944f881c7fc572b1dc78e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:07.103656 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-4aa0d581-34b8-49c9-a2a9-174f1a167b4d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.085036 Sep 21 16:50:07.104235 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 848/1617] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:07 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:07.105460 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-8370c12f-a324-4d0f-acc1-d6659b0b82ec tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6" status: 200 len: 1225 microversion: 2.1 time: 0.086738 Sep 21 16:50:07.106017 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 770/1618] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:07 2022] GET /compute/v2.1/servers/15ec6390-e13e-4e88-8bdc-62507b36a9a6 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:07.559759 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-429bf24e-2ef6-46f5-9154-3dae1d0b681b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:07.560254 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-429bf24e-2ef6-46f5-9154-3dae1d0b681b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 19567338-1f72-414d-b6d7-7ab9d4fe94bc] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:07.566244 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-429bf24e-2ef6-46f5-9154-3dae1d0b681b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:07.566728 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-429bf24e-2ef6-46f5-9154-3dae1d0b681b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:07.567165 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-429bf24e-2ef6-46f5-9154-3dae1d0b681b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:07.567885 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-429bf24e-2ef6-46f5-9154-3dae1d0b681b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:07.568340 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-429bf24e-2ef6-46f5-9154-3dae1d0b681b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:07.569312 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-429bf24e-2ef6-46f5-9154-3dae1d0b681b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:07.582552 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.wsgi [None req-429bf24e-2ef6-46f5-9154-3dae1d0b681b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] HTTP exception thrown: Instance 19567338-1f72-414d-b6d7-7ab9d4fe94bc could not be found. Sep 21 16:50:07.584186 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-429bf24e-2ef6-46f5-9154-3dae1d0b681b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Request method failure captured: Sep 21 16:50:07.584186 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: request: DELETE /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc HTTP/1.1 Sep 21 16:50:07.584186 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept: application/json Sep 21 16:50:07.584186 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept-Encoding: identity Sep 21 16:50:07.584186 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Connection: close Sep 21 16:50:07.584186 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Length: 0 Sep 21 16:50:07.584186 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Type: application/json Sep 21 16:50:07.584186 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Host: 10.222.0.64 Sep 21 16:50:07.584186 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Openstack-System-Scope: None Sep 21 16:50:07.584186 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: User-Agent: python-urllib3/1.26.12 Sep 21 16:50:07.584186 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Auth-Token: gAAAAABjKzswReFXUCd2I6gYmAtuJKe-A30QC38r39VuIRSGH95-VeJj-q9GnTRzSMMpi3tNsql0eq27wTbWXqMmSi1d60OfmexRFQJb0BK3uINxIMTGd_q9vbKD8_vryruFXNT9Kt1ZGfc9HDH-jN_m0KZ0qmIqF-JBWnzYSq7JN2QsTqjQ3cM Sep 21 16:50:07.584186 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Id: None Sep 21 16:50:07.584186 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Name: None Sep 21 16:50:07.584186 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Identity-Status: Confirmed Sep 21 16:50:07.584186 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Is-Admin-Project: True Sep 21 16:50:07.584186 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Id: default Sep 21 16:50:07.584186 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Name: Default Sep 21 16:50:07.584186 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Id: d529e1f3de6944f881c7fc572b1dc78e Sep 21 16:50:07.584186 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Name: tempest-TestVolumeBootPattern-1127138919 Sep 21 16:50:07.584186 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Role: member,reader Sep 21 16:50:07.584186 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Roles: member,reader Sep 21 16:50:07.586761 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/d529e1f3de6944f881c7fc572b1dc78e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d529e1f3de6944f881c7fc572b1dc78e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_d529e1f3de6944f881c7fc572b1dc78e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d529e1f3de6944f881c7fc572b1dc78e"}]}] Sep 21 16:50:07.586761 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant: tempest-TestVolumeBootPattern-1127138919 Sep 21 16:50:07.586761 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Id: d529e1f3de6944f881c7fc572b1dc78e Sep 21 16:50:07.586761 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Name: tempest-TestVolumeBootPattern-1127138919 Sep 21 16:50:07.586761 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User: tempest-TestVolumeBootPattern-1127138919-project Sep 21 16:50:07.586761 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Id: default Sep 21 16:50:07.586761 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Name: Default Sep 21 16:50:07.586761 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Id: f619261c21204ea3b5ba624177eb8747 Sep 21 16:50:07.586761 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Name: tempest-TestVolumeBootPattern-1127138919-project Sep 21 16:50:07.586761 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: method: > Sep 21 16:50:07.586761 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: exception: Instance 19567338-1f72-414d-b6d7-7ab9d4fe94bc could not be found. Sep 21 16:50:07.586761 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: action_args: {'id': '19567338-1f72-414d-b6d7-7ab9d4fe94bc'} Sep 21 16:50:07.587700 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:50:07.587700 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:50:07.587700 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 16:50:07.587700 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 16:50:07.587700 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 16:50:07.587700 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 16:50:07.587700 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 16:50:07.587700 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 16:50:07.587700 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 16:50:07.587700 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 16:50:07.587700 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19567338-1f72-414d-b6d7-7ab9d4fe94bc could not be found. Sep 21 16:50:07.587700 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:50:07.587700 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:50:07.587700 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:50:07.587700 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:50:07.587700 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:50:07.587700 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:50:07.587700 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:50:07.587700 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:50:07.587700 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:50:07.589241 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:50:07.589241 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 21 16:50:07.589241 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 21 16:50:07.589241 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 21 16:50:07.589241 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 21 16:50:07.589241 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 16:50:07.589241 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 16:50:07.589241 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 16:50:07.589241 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:50:07.589241 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19567338-1f72-414d-b6d7-7ab9d4fe94bc could not be found. Sep 21 16:50:07.589241 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:50:07.589241 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:50:07.589241 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:50:07.589241 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:50:07.589241 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:50:07.589241 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:50:07.589241 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:50:07.589241 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:50:07.589241 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19567338-1f72-414d-b6d7-7ab9d4fe94bc could not be found. Sep 21 16:50:07.589241 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 16:50:07.590782 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-429bf24e-2ef6-46f5-9154-3dae1d0b681b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Returning 404 to user: Instance 19567338-1f72-414d-b6d7-7ab9d4fe94bc could not be found. {{(pid=120532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:50:07.590782 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-429bf24e-2ef6-46f5-9154-3dae1d0b681b tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "DELETE /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc" status: 404 len: 111 microversion: 2.1 time: 0.030298 Sep 21 16:50:07.590782 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 849/1619] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Sep 21 16:50:07 2022] DELETE /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 16:50:07.594679 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-443f3f62-ccc0-4a23-9a5f-0899bdb051b2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:07.595332 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-443f3f62-ccc0-4a23-9a5f-0899bdb051b2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] [instance: 19567338-1f72-414d-b6d7-7ab9d4fe94bc] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:07.601362 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-443f3f62-ccc0-4a23-9a5f-0899bdb051b2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:07.601868 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-443f3f62-ccc0-4a23-9a5f-0899bdb051b2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:07.602334 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-443f3f62-ccc0-4a23-9a5f-0899bdb051b2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:07.603024 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-443f3f62-ccc0-4a23-9a5f-0899bdb051b2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:07.603480 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-443f3f62-ccc0-4a23-9a5f-0899bdb051b2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:07.603902 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-443f3f62-ccc0-4a23-9a5f-0899bdb051b2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:07.616825 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.wsgi [None req-443f3f62-ccc0-4a23-9a5f-0899bdb051b2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] HTTP exception thrown: Instance 19567338-1f72-414d-b6d7-7ab9d4fe94bc could not be found. Sep 21 16:50:07.618471 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-443f3f62-ccc0-4a23-9a5f-0899bdb051b2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Request method failure captured: Sep 21 16:50:07.618471 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: request: GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc HTTP/1.1 Sep 21 16:50:07.618471 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept: application/json Sep 21 16:50:07.618471 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept-Encoding: identity Sep 21 16:50:07.618471 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Connection: close Sep 21 16:50:07.618471 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Length: 0 Sep 21 16:50:07.618471 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Type: application/json Sep 21 16:50:07.618471 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Host: 10.222.0.64 Sep 21 16:50:07.618471 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Openstack-System-Scope: None Sep 21 16:50:07.618471 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: User-Agent: python-urllib3/1.26.12 Sep 21 16:50:07.618471 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Auth-Token: gAAAAABjKzswReFXUCd2I6gYmAtuJKe-A30QC38r39VuIRSGH95-VeJj-q9GnTRzSMMpi3tNsql0eq27wTbWXqMmSi1d60OfmexRFQJb0BK3uINxIMTGd_q9vbKD8_vryruFXNT9Kt1ZGfc9HDH-jN_m0KZ0qmIqF-JBWnzYSq7JN2QsTqjQ3cM Sep 21 16:50:07.618471 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Id: None Sep 21 16:50:07.618471 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Name: None Sep 21 16:50:07.618471 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Identity-Status: Confirmed Sep 21 16:50:07.618471 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Is-Admin-Project: True Sep 21 16:50:07.618471 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Id: default Sep 21 16:50:07.618471 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Name: Default Sep 21 16:50:07.618471 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Id: d529e1f3de6944f881c7fc572b1dc78e Sep 21 16:50:07.618471 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Name: tempest-TestVolumeBootPattern-1127138919 Sep 21 16:50:07.618471 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Role: member,reader Sep 21 16:50:07.618471 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Roles: member,reader Sep 21 16:50:07.620249 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/d529e1f3de6944f881c7fc572b1dc78e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d529e1f3de6944f881c7fc572b1dc78e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_d529e1f3de6944f881c7fc572b1dc78e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d529e1f3de6944f881c7fc572b1dc78e"}]}] Sep 21 16:50:07.620249 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant: tempest-TestVolumeBootPattern-1127138919 Sep 21 16:50:07.620249 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Id: d529e1f3de6944f881c7fc572b1dc78e Sep 21 16:50:07.620249 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Name: tempest-TestVolumeBootPattern-1127138919 Sep 21 16:50:07.620249 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User: tempest-TestVolumeBootPattern-1127138919-project Sep 21 16:50:07.620249 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Id: default Sep 21 16:50:07.620249 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Name: Default Sep 21 16:50:07.620249 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Id: f619261c21204ea3b5ba624177eb8747 Sep 21 16:50:07.620249 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Name: tempest-TestVolumeBootPattern-1127138919-project Sep 21 16:50:07.620249 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: method: > Sep 21 16:50:07.620249 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: exception: Instance 19567338-1f72-414d-b6d7-7ab9d4fe94bc could not be found. Sep 21 16:50:07.620249 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: action_args: {'id': '19567338-1f72-414d-b6d7-7ab9d4fe94bc'} Sep 21 16:50:07.621352 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 16:50:07.621352 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:50:07.621352 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 16:50:07.621352 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 16:50:07.621352 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 16:50:07.621352 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 16:50:07.621352 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 16:50:07.621352 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 16:50:07.621352 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 16:50:07.621352 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 16:50:07.621352 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19567338-1f72-414d-b6d7-7ab9d4fe94bc could not be found. Sep 21 16:50:07.621352 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:50:07.621352 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:50:07.621352 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:50:07.621352 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:50:07.621352 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:50:07.621352 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:50:07.621352 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 16:50:07.621352 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 16:50:07.621352 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 16:50:07.623125 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 16:50:07.623125 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 16:50:07.623125 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 16:50:07.623125 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 16:50:07.623125 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 16:50:07.623125 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 16:50:07.623125 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 16:50:07.623125 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19567338-1f72-414d-b6d7-7ab9d4fe94bc could not be found. Sep 21 16:50:07.623125 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:50:07.623125 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 16:50:07.623125 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:50:07.623125 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 16:50:07.623125 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 16:50:07.623125 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 16:50:07.623125 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 16:50:07.623125 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 16:50:07.623125 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19567338-1f72-414d-b6d7-7ab9d4fe94bc could not be found. Sep 21 16:50:07.623125 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 16:50:07.624668 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-443f3f62-ccc0-4a23-9a5f-0899bdb051b2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Returning 404 to user: Instance 19567338-1f72-414d-b6d7-7ab9d4fe94bc could not be found. {{(pid=120531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 16:50:07.624668 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-443f3f62-ccc0-4a23-9a5f-0899bdb051b2 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc" status: 404 len: 111 microversion: 2.1 time: 0.028950 Sep 21 16:50:07.624668 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 771/1620] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:07 2022] GET /compute/v2.1/servers/19567338-1f72-414d-b6d7-7ab9d4fe94bc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 16:50:08.129157 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-d9b8b892-f697-40b1-872d-889479d51acb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:08.129786 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-d9b8b892-f697-40b1-872d-889479d51acb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:08.136197 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d9b8b892-f697-40b1-872d-889479d51acb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:08.136676 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d9b8b892-f697-40b1-872d-889479d51acb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:08.137110 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d9b8b892-f697-40b1-872d-889479d51acb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:08.137798 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d9b8b892-f697-40b1-872d-889479d51acb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:08.138291 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d9b8b892-f697-40b1-872d-889479d51acb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:08.138713 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d9b8b892-f697-40b1-872d-889479d51acb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:08.199021 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-d9b8b892-f697-40b1-872d-889479d51acb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:08.207569 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-d9b8b892-f697-40b1-872d-889479d51acb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.083393 Sep 21 16:50:08.208177 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 850/1621] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:08 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:09.230930 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-3e794e24-3783-4f45-be28-a9304947a73c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:09.231499 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-3e794e24-3783-4f45-be28-a9304947a73c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:09.237771 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3e794e24-3783-4f45-be28-a9304947a73c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:09.238281 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3e794e24-3783-4f45-be28-a9304947a73c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:09.238715 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3e794e24-3783-4f45-be28-a9304947a73c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:09.239404 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3e794e24-3783-4f45-be28-a9304947a73c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:09.239851 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3e794e24-3783-4f45-be28-a9304947a73c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:09.240270 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3e794e24-3783-4f45-be28-a9304947a73c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:09.300923 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-3e794e24-3783-4f45-be28-a9304947a73c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:09.308981 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-3e794e24-3783-4f45-be28-a9304947a73c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.082012 Sep 21 16:50:09.309546 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 772/1622] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:09 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:10.332771 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-2fff814a-71c3-4bf3-9316-42793931cc39 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:10.333368 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-2fff814a-71c3-4bf3-9316-42793931cc39 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:10.339619 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2fff814a-71c3-4bf3-9316-42793931cc39 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:10.340098 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2fff814a-71c3-4bf3-9316-42793931cc39 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:10.340530 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2fff814a-71c3-4bf3-9316-42793931cc39 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:10.341224 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2fff814a-71c3-4bf3-9316-42793931cc39 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:10.341678 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2fff814a-71c3-4bf3-9316-42793931cc39 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:10.342127 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2fff814a-71c3-4bf3-9316-42793931cc39 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:10.406344 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-2fff814a-71c3-4bf3-9316-42793931cc39 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:10.414633 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-2fff814a-71c3-4bf3-9316-42793931cc39 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.086084 Sep 21 16:50:10.415202 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 851/1623] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:10 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:11.437964 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-e658dcd8-d88b-4ed0-838e-c637e0112b33 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:11.438609 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-e658dcd8-d88b-4ed0-838e-c637e0112b33 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:11.448348 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e658dcd8-d88b-4ed0-838e-c637e0112b33 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:11.448834 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e658dcd8-d88b-4ed0-838e-c637e0112b33 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:11.449274 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e658dcd8-d88b-4ed0-838e-c637e0112b33 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:11.449966 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e658dcd8-d88b-4ed0-838e-c637e0112b33 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:11.450446 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e658dcd8-d88b-4ed0-838e-c637e0112b33 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:11.450867 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e658dcd8-d88b-4ed0-838e-c637e0112b33 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:11.515809 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-e658dcd8-d88b-4ed0-838e-c637e0112b33 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:11.524690 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-e658dcd8-d88b-4ed0-838e-c637e0112b33 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.090696 Sep 21 16:50:11.525248 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 773/1624] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:11 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:12.547497 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-fe2db661-12e7-4de7-a1c4-50f7dd6b3fa9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:12.548111 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-fe2db661-12e7-4de7-a1c4-50f7dd6b3fa9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:12.555076 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fe2db661-12e7-4de7-a1c4-50f7dd6b3fa9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:12.555560 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fe2db661-12e7-4de7-a1c4-50f7dd6b3fa9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:12.555994 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fe2db661-12e7-4de7-a1c4-50f7dd6b3fa9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:12.556684 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fe2db661-12e7-4de7-a1c4-50f7dd6b3fa9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:12.557137 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fe2db661-12e7-4de7-a1c4-50f7dd6b3fa9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:12.557557 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fe2db661-12e7-4de7-a1c4-50f7dd6b3fa9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:12.620662 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-fe2db661-12e7-4de7-a1c4-50f7dd6b3fa9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:12.628827 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-fe2db661-12e7-4de7-a1c4-50f7dd6b3fa9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.085298 Sep 21 16:50:12.629409 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 852/1625] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:12 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:13.652958 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-359ff9d4-4cc7-4464-ab0a-8f9812183b8d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:13.653573 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-359ff9d4-4cc7-4464-ab0a-8f9812183b8d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:13.660062 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-359ff9d4-4cc7-4464-ab0a-8f9812183b8d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:13.660545 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-359ff9d4-4cc7-4464-ab0a-8f9812183b8d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:13.660984 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-359ff9d4-4cc7-4464-ab0a-8f9812183b8d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:13.661680 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-359ff9d4-4cc7-4464-ab0a-8f9812183b8d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:13.662162 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-359ff9d4-4cc7-4464-ab0a-8f9812183b8d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:13.662621 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-359ff9d4-4cc7-4464-ab0a-8f9812183b8d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:13.727224 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-359ff9d4-4cc7-4464-ab0a-8f9812183b8d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:13.735369 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-359ff9d4-4cc7-4464-ab0a-8f9812183b8d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.086309 Sep 21 16:50:13.735926 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 774/1626] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:13 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:14.757893 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-b228f23d-9ff2-44d9-9854-ab1159fb0bd9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:14.758470 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-b228f23d-9ff2-44d9-9854-ab1159fb0bd9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:14.760835 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_api:SELECT=52 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:50:14.766386 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b228f23d-9ff2-44d9-9854-ab1159fb0bd9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:14.766869 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b228f23d-9ff2-44d9-9854-ab1159fb0bd9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:14.767303 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b228f23d-9ff2-44d9-9854-ab1159fb0bd9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:14.767997 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b228f23d-9ff2-44d9-9854-ab1159fb0bd9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:14.768458 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b228f23d-9ff2-44d9-9854-ab1159fb0bd9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:14.768880 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b228f23d-9ff2-44d9-9854-ab1159fb0bd9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:14.830505 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-b228f23d-9ff2-44d9-9854-ab1159fb0bd9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:14.839401 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-b228f23d-9ff2-44d9-9854-ab1159fb0bd9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.086196 Sep 21 16:50:14.839973 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 853/1627] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:14 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:50:15.862862 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-25898291-4b81-4abb-89c1-1a22c83e00f9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:15.863414 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-25898291-4b81-4abb-89c1-1a22c83e00f9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:15.870453 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-25898291-4b81-4abb-89c1-1a22c83e00f9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:15.870920 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-25898291-4b81-4abb-89c1-1a22c83e00f9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:15.871349 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-25898291-4b81-4abb-89c1-1a22c83e00f9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:15.872033 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-25898291-4b81-4abb-89c1-1a22c83e00f9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:15.872485 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-25898291-4b81-4abb-89c1-1a22c83e00f9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:15.872904 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-25898291-4b81-4abb-89c1-1a22c83e00f9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:15.937622 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-25898291-4b81-4abb-89c1-1a22c83e00f9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:15.946377 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-25898291-4b81-4abb-89c1-1a22c83e00f9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.087374 Sep 21 16:50:15.946947 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 775/1628] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:15 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:16.970186 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-87cdd04e-3a51-4f08-b475-9aedaa3e26be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:16.971093 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-87cdd04e-3a51-4f08-b475-9aedaa3e26be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:16.977565 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-87cdd04e-3a51-4f08-b475-9aedaa3e26be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:16.978057 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-87cdd04e-3a51-4f08-b475-9aedaa3e26be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:16.978512 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-87cdd04e-3a51-4f08-b475-9aedaa3e26be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:16.979203 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-87cdd04e-3a51-4f08-b475-9aedaa3e26be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:16.979659 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-87cdd04e-3a51-4f08-b475-9aedaa3e26be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:16.980085 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-87cdd04e-3a51-4f08-b475-9aedaa3e26be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:16.998141 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=100 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:50:17.040980 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-87cdd04e-3a51-4f08-b475-9aedaa3e26be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:17.049075 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-87cdd04e-3a51-4f08-b475-9aedaa3e26be tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.082857 Sep 21 16:50:17.049651 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 854/1629] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:16 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:18.072691 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-56691c4e-a01e-44b9-ab24-60fd683181c8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:18.073297 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-56691c4e-a01e-44b9-ab24-60fd683181c8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:18.075941 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_api:SELECT=48 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:50:18.081748 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-56691c4e-a01e-44b9-ab24-60fd683181c8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:18.082253 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-56691c4e-a01e-44b9-ab24-60fd683181c8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:18.082682 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-56691c4e-a01e-44b9-ab24-60fd683181c8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:18.083359 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-56691c4e-a01e-44b9-ab24-60fd683181c8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:18.083806 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-56691c4e-a01e-44b9-ab24-60fd683181c8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:18.084221 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-56691c4e-a01e-44b9-ab24-60fd683181c8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:18.144300 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-56691c4e-a01e-44b9-ab24-60fd683181c8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:18.152832 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-56691c4e-a01e-44b9-ab24-60fd683181c8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.084569 Sep 21 16:50:18.153387 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 776/1630] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:18 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:19.175523 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-612e7c78-f9a5-4cd1-af73-4106a81eac87 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:19.176139 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-612e7c78-f9a5-4cd1-af73-4106a81eac87 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:19.183364 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-612e7c78-f9a5-4cd1-af73-4106a81eac87 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:19.183850 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-612e7c78-f9a5-4cd1-af73-4106a81eac87 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:19.184291 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-612e7c78-f9a5-4cd1-af73-4106a81eac87 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:19.184989 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-612e7c78-f9a5-4cd1-af73-4106a81eac87 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:19.185449 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-612e7c78-f9a5-4cd1-af73-4106a81eac87 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:19.185879 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-612e7c78-f9a5-4cd1-af73-4106a81eac87 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:19.248469 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-612e7c78-f9a5-4cd1-af73-4106a81eac87 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:19.256592 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-612e7c78-f9a5-4cd1-af73-4106a81eac87 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.084931 Sep 21 16:50:19.257160 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 855/1631] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:19 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:20.280402 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-84b1a885-3eab-4f73-a57a-67dd531f409b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:20.281318 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-84b1a885-3eab-4f73-a57a-67dd531f409b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:20.288754 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-84b1a885-3eab-4f73-a57a-67dd531f409b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:20.289448 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-84b1a885-3eab-4f73-a57a-67dd531f409b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:20.290115 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-84b1a885-3eab-4f73-a57a-67dd531f409b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:20.291106 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-84b1a885-3eab-4f73-a57a-67dd531f409b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:20.291737 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-84b1a885-3eab-4f73-a57a-67dd531f409b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:20.292370 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-84b1a885-3eab-4f73-a57a-67dd531f409b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:20.353703 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-84b1a885-3eab-4f73-a57a-67dd531f409b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:20.361786 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-84b1a885-3eab-4f73-a57a-67dd531f409b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.085893 Sep 21 16:50:20.362381 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 777/1632] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:20 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:21.385393 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-bb4d7ade-4069-4f26-9db5-2815bd5b1c0b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:21.385998 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-bb4d7ade-4069-4f26-9db5-2815bd5b1c0b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:21.392457 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb4d7ade-4069-4f26-9db5-2815bd5b1c0b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:21.392917 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb4d7ade-4069-4f26-9db5-2815bd5b1c0b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:21.393352 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb4d7ade-4069-4f26-9db5-2815bd5b1c0b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:21.394038 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb4d7ade-4069-4f26-9db5-2815bd5b1c0b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:21.394509 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb4d7ade-4069-4f26-9db5-2815bd5b1c0b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:21.394925 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bb4d7ade-4069-4f26-9db5-2815bd5b1c0b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:21.457572 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-bb4d7ade-4069-4f26-9db5-2815bd5b1c0b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:21.466695 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-bb4d7ade-4069-4f26-9db5-2815bd5b1c0b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.085668 Sep 21 16:50:21.467552 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 856/1633] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:21 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:22.490622 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-ec295275-1cf5-4f78-b351-e95f8e78b623 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:22.491237 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-ec295275-1cf5-4f78-b351-e95f8e78b623 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:22.497716 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ec295275-1cf5-4f78-b351-e95f8e78b623 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:22.498243 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ec295275-1cf5-4f78-b351-e95f8e78b623 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:22.498682 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ec295275-1cf5-4f78-b351-e95f8e78b623 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:22.499379 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ec295275-1cf5-4f78-b351-e95f8e78b623 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:22.499838 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ec295275-1cf5-4f78-b351-e95f8e78b623 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:22.500260 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ec295275-1cf5-4f78-b351-e95f8e78b623 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:22.560727 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-ec295275-1cf5-4f78-b351-e95f8e78b623 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:22.568682 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-ec295275-1cf5-4f78-b351-e95f8e78b623 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.081958 Sep 21 16:50:22.569231 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 778/1634] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:22 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:23.591468 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c2b54ad7-5860-454d-9a9a-de57305bdf4d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:23.592091 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-c2b54ad7-5860-454d-9a9a-de57305bdf4d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:23.598586 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c2b54ad7-5860-454d-9a9a-de57305bdf4d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:23.599063 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c2b54ad7-5860-454d-9a9a-de57305bdf4d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:23.599494 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c2b54ad7-5860-454d-9a9a-de57305bdf4d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:23.600176 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c2b54ad7-5860-454d-9a9a-de57305bdf4d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:23.600625 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c2b54ad7-5860-454d-9a9a-de57305bdf4d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:23.601041 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c2b54ad7-5860-454d-9a9a-de57305bdf4d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:23.661044 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-c2b54ad7-5860-454d-9a9a-de57305bdf4d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:23.669739 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-c2b54ad7-5860-454d-9a9a-de57305bdf4d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.082119 Sep 21 16:50:23.670333 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 857/1635] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:23 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:24.692450 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-f933818e-e6b7-4f60-b7d8-17de5c518eef tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:24.693047 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-f933818e-e6b7-4f60-b7d8-17de5c518eef tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:24.699991 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f933818e-e6b7-4f60-b7d8-17de5c518eef tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:24.700466 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f933818e-e6b7-4f60-b7d8-17de5c518eef tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:24.700890 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f933818e-e6b7-4f60-b7d8-17de5c518eef tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:24.701570 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f933818e-e6b7-4f60-b7d8-17de5c518eef tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:24.702013 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f933818e-e6b7-4f60-b7d8-17de5c518eef tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:24.702454 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f933818e-e6b7-4f60-b7d8-17de5c518eef tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:24.704914 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=100 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:50:24.766957 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-f933818e-e6b7-4f60-b7d8-17de5c518eef tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:24.775705 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-f933818e-e6b7-4f60-b7d8-17de5c518eef tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.087138 Sep 21 16:50:24.776260 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 779/1636] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:24 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:25.798868 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-cdf98d2a-3433-4c20-a378-0837e0f5de74 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:25.799434 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-cdf98d2a-3433-4c20-a378-0837e0f5de74 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:25.806482 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cdf98d2a-3433-4c20-a378-0837e0f5de74 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:25.806959 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cdf98d2a-3433-4c20-a378-0837e0f5de74 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:25.807384 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cdf98d2a-3433-4c20-a378-0837e0f5de74 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:25.808062 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cdf98d2a-3433-4c20-a378-0837e0f5de74 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:25.808508 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cdf98d2a-3433-4c20-a378-0837e0f5de74 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:25.808922 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-cdf98d2a-3433-4c20-a378-0837e0f5de74 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:25.869173 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-cdf98d2a-3433-4c20-a378-0837e0f5de74 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:25.877221 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-cdf98d2a-3433-4c20-a378-0837e0f5de74 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.082315 Sep 21 16:50:25.877786 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 858/1637] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:25 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:26.900131 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-a8f7246e-4665-4097-ab75-647766046084 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:26.900688 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-a8f7246e-4665-4097-ab75-647766046084 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:26.907110 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a8f7246e-4665-4097-ab75-647766046084 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:26.907592 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a8f7246e-4665-4097-ab75-647766046084 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:26.908028 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a8f7246e-4665-4097-ab75-647766046084 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:26.908722 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a8f7246e-4665-4097-ab75-647766046084 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:26.909179 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a8f7246e-4665-4097-ab75-647766046084 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:26.909601 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a8f7246e-4665-4097-ab75-647766046084 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:26.970563 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-a8f7246e-4665-4097-ab75-647766046084 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:26.979155 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-a8f7246e-4665-4097-ab75-647766046084 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.083548 Sep 21 16:50:26.979721 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 780/1638] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:26 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:28.002901 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-4352655d-3985-4a77-96d5-207b81a5d27c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:28.003543 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-4352655d-3985-4a77-96d5-207b81a5d27c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:28.010581 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4352655d-3985-4a77-96d5-207b81a5d27c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:28.011060 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4352655d-3985-4a77-96d5-207b81a5d27c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:28.011496 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4352655d-3985-4a77-96d5-207b81a5d27c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:28.012182 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4352655d-3985-4a77-96d5-207b81a5d27c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:28.012641 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4352655d-3985-4a77-96d5-207b81a5d27c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:28.013061 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-4352655d-3985-4a77-96d5-207b81a5d27c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:28.075566 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-4352655d-3985-4a77-96d5-207b81a5d27c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:28.083917 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-4352655d-3985-4a77-96d5-207b81a5d27c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.084977 Sep 21 16:50:28.084491 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 859/1639] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:27 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:29.106357 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-9b586008-f827-4d36-816e-3e22a5621c5b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:29.106968 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-9b586008-f827-4d36-816e-3e22a5621c5b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:29.113615 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9b586008-f827-4d36-816e-3e22a5621c5b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:29.114275 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9b586008-f827-4d36-816e-3e22a5621c5b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:29.114931 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9b586008-f827-4d36-816e-3e22a5621c5b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:29.115641 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9b586008-f827-4d36-816e-3e22a5621c5b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:29.116090 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9b586008-f827-4d36-816e-3e22a5621c5b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:29.116510 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9b586008-f827-4d36-816e-3e22a5621c5b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:29.178099 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-9b586008-f827-4d36-816e-3e22a5621c5b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:29.189919 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-9b586008-f827-4d36-816e-3e22a5621c5b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.087986 Sep 21 16:50:29.190502 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 781/1640] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:29 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:30.213171 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-bfdce98c-674c-4901-87f4-0f172f89df76 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:30.213889 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-bfdce98c-674c-4901-87f4-0f172f89df76 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:30.220370 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bfdce98c-674c-4901-87f4-0f172f89df76 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:30.220842 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bfdce98c-674c-4901-87f4-0f172f89df76 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:30.221270 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bfdce98c-674c-4901-87f4-0f172f89df76 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:30.221948 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bfdce98c-674c-4901-87f4-0f172f89df76 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:30.222420 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bfdce98c-674c-4901-87f4-0f172f89df76 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:30.222837 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bfdce98c-674c-4901-87f4-0f172f89df76 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:30.287187 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-bfdce98c-674c-4901-87f4-0f172f89df76 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:30.295249 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-bfdce98c-674c-4901-87f4-0f172f89df76 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.086010 Sep 21 16:50:30.295812 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 860/1641] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:30 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:31.317571 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-26d39270-78fe-4012-bdd5-8c13d3bc6ddd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:31.318194 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-26d39270-78fe-4012-bdd5-8c13d3bc6ddd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:31.324517 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-26d39270-78fe-4012-bdd5-8c13d3bc6ddd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:31.324991 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-26d39270-78fe-4012-bdd5-8c13d3bc6ddd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:31.325416 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-26d39270-78fe-4012-bdd5-8c13d3bc6ddd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:31.326126 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-26d39270-78fe-4012-bdd5-8c13d3bc6ddd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:31.326569 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-26d39270-78fe-4012-bdd5-8c13d3bc6ddd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:31.327006 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-26d39270-78fe-4012-bdd5-8c13d3bc6ddd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:31.388110 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-26d39270-78fe-4012-bdd5-8c13d3bc6ddd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:31.396081 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-26d39270-78fe-4012-bdd5-8c13d3bc6ddd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.082380 Sep 21 16:50:31.396636 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 782/1642] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:31 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:32.420370 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-708cef44-7e7f-4f2d-97da-e4b7e1fb46d7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:32.420982 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-708cef44-7e7f-4f2d-97da-e4b7e1fb46d7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:32.427700 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-708cef44-7e7f-4f2d-97da-e4b7e1fb46d7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:32.428185 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-708cef44-7e7f-4f2d-97da-e4b7e1fb46d7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:32.428618 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-708cef44-7e7f-4f2d-97da-e4b7e1fb46d7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:32.429307 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-708cef44-7e7f-4f2d-97da-e4b7e1fb46d7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:32.429762 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-708cef44-7e7f-4f2d-97da-e4b7e1fb46d7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:32.430779 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-708cef44-7e7f-4f2d-97da-e4b7e1fb46d7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:32.491387 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-708cef44-7e7f-4f2d-97da-e4b7e1fb46d7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:32.499618 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-708cef44-7e7f-4f2d-97da-e4b7e1fb46d7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.083184 Sep 21 16:50:32.500193 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 861/1643] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:32 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:33.522787 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-e2d6ff9a-37a7-477e-8e72-985989c6b845 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:33.523430 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-e2d6ff9a-37a7-477e-8e72-985989c6b845 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:33.530363 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e2d6ff9a-37a7-477e-8e72-985989c6b845 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:33.530840 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e2d6ff9a-37a7-477e-8e72-985989c6b845 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:33.531265 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e2d6ff9a-37a7-477e-8e72-985989c6b845 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:33.531947 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e2d6ff9a-37a7-477e-8e72-985989c6b845 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:33.532392 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e2d6ff9a-37a7-477e-8e72-985989c6b845 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:33.532806 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e2d6ff9a-37a7-477e-8e72-985989c6b845 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:33.598317 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-e2d6ff9a-37a7-477e-8e72-985989c6b845 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:33.608925 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-e2d6ff9a-37a7-477e-8e72-985989c6b845 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.089859 Sep 21 16:50:33.609638 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 783/1644] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:33 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:34.631644 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-2f0f81bb-a325-498f-8c72-02f226b9c9ed tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:34.632251 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-2f0f81bb-a325-498f-8c72-02f226b9c9ed tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:34.639144 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2f0f81bb-a325-498f-8c72-02f226b9c9ed tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:34.639620 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2f0f81bb-a325-498f-8c72-02f226b9c9ed tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:34.640048 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2f0f81bb-a325-498f-8c72-02f226b9c9ed tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:34.640730 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2f0f81bb-a325-498f-8c72-02f226b9c9ed tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:34.641179 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2f0f81bb-a325-498f-8c72-02f226b9c9ed tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:34.641591 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2f0f81bb-a325-498f-8c72-02f226b9c9ed tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:34.701526 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-2f0f81bb-a325-498f-8c72-02f226b9c9ed tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:34.709752 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-2f0f81bb-a325-498f-8c72-02f226b9c9ed tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.082051 Sep 21 16:50:34.710345 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 862/1645] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:34 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:35.732545 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-8dbd58c0-3683-47fe-911c-0c62ae25a895 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:35.733145 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-8dbd58c0-3683-47fe-911c-0c62ae25a895 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:35.739630 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8dbd58c0-3683-47fe-911c-0c62ae25a895 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:35.740057 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8dbd58c0-3683-47fe-911c-0c62ae25a895 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:35.740489 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8dbd58c0-3683-47fe-911c-0c62ae25a895 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:35.741177 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8dbd58c0-3683-47fe-911c-0c62ae25a895 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:35.741633 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8dbd58c0-3683-47fe-911c-0c62ae25a895 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:35.742109 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8dbd58c0-3683-47fe-911c-0c62ae25a895 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:35.802009 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-8dbd58c0-3683-47fe-911c-0c62ae25a895 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:35.810567 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-8dbd58c0-3683-47fe-911c-0c62ae25a895 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.081923 Sep 21 16:50:35.811126 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 784/1646] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:35 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:36.833961 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-b88b85c9-0f1e-45ef-ab68-c0c86a74e20c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:36.834539 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-b88b85c9-0f1e-45ef-ab68-c0c86a74e20c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:36.841791 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b88b85c9-0f1e-45ef-ab68-c0c86a74e20c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:36.842304 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b88b85c9-0f1e-45ef-ab68-c0c86a74e20c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:36.842753 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b88b85c9-0f1e-45ef-ab68-c0c86a74e20c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:36.843441 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b88b85c9-0f1e-45ef-ab68-c0c86a74e20c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:36.843887 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b88b85c9-0f1e-45ef-ab68-c0c86a74e20c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:36.844302 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b88b85c9-0f1e-45ef-ab68-c0c86a74e20c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:36.904596 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-b88b85c9-0f1e-45ef-ab68-c0c86a74e20c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:36.912660 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-b88b85c9-0f1e-45ef-ab68-c0c86a74e20c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.082882 Sep 21 16:50:36.913223 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 863/1647] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:36 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:37.938661 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-414080a4-0ccb-42f9-bab0-dbb7c29cc354 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:37.939273 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-414080a4-0ccb-42f9-bab0-dbb7c29cc354 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:37.945413 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-414080a4-0ccb-42f9-bab0-dbb7c29cc354 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:37.946525 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-414080a4-0ccb-42f9-bab0-dbb7c29cc354 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:37.946958 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-414080a4-0ccb-42f9-bab0-dbb7c29cc354 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:37.947644 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-414080a4-0ccb-42f9-bab0-dbb7c29cc354 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:37.948091 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-414080a4-0ccb-42f9-bab0-dbb7c29cc354 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:37.948506 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-414080a4-0ccb-42f9-bab0-dbb7c29cc354 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:38.010595 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-414080a4-0ccb-42f9-bab0-dbb7c29cc354 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:38.018645 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-414080a4-0ccb-42f9-bab0-dbb7c29cc354 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.083868 Sep 21 16:50:38.019209 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 785/1648] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:37 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:39.041654 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-f15c8fa9-b8e7-4b1f-8ad1-52f1e204614b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:39.042316 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-f15c8fa9-b8e7-4b1f-8ad1-52f1e204614b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:39.048283 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f15c8fa9-b8e7-4b1f-8ad1-52f1e204614b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:39.048759 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f15c8fa9-b8e7-4b1f-8ad1-52f1e204614b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:39.049188 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f15c8fa9-b8e7-4b1f-8ad1-52f1e204614b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:39.049868 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f15c8fa9-b8e7-4b1f-8ad1-52f1e204614b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:39.050342 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f15c8fa9-b8e7-4b1f-8ad1-52f1e204614b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:39.050788 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f15c8fa9-b8e7-4b1f-8ad1-52f1e204614b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:39.114292 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-f15c8fa9-b8e7-4b1f-8ad1-52f1e204614b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:39.122479 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-f15c8fa9-b8e7-4b1f-8ad1-52f1e204614b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.084813 Sep 21 16:50:39.123054 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 864/1649] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:39 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:40.145849 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-21111f69-d07f-4c01-8109-295f230f32d7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:40.146491 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-21111f69-d07f-4c01-8109-295f230f32d7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:40.153056 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-21111f69-d07f-4c01-8109-295f230f32d7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:40.153534 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-21111f69-d07f-4c01-8109-295f230f32d7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:40.153961 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-21111f69-d07f-4c01-8109-295f230f32d7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:40.154672 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-21111f69-d07f-4c01-8109-295f230f32d7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:40.155118 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-21111f69-d07f-4c01-8109-295f230f32d7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:40.155530 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-21111f69-d07f-4c01-8109-295f230f32d7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:40.216287 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-21111f69-d07f-4c01-8109-295f230f32d7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:40.224189 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-21111f69-d07f-4c01-8109-295f230f32d7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.082283 Sep 21 16:50:40.224743 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 786/1650] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:40 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:41.247318 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c4c3b10c-0b1c-40c2-b160-701c82931ce1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:41.247926 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-c4c3b10c-0b1c-40c2-b160-701c82931ce1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:41.254536 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c4c3b10c-0b1c-40c2-b160-701c82931ce1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:41.255020 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c4c3b10c-0b1c-40c2-b160-701c82931ce1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:41.255457 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c4c3b10c-0b1c-40c2-b160-701c82931ce1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:41.256149 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c4c3b10c-0b1c-40c2-b160-701c82931ce1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:41.256605 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c4c3b10c-0b1c-40c2-b160-701c82931ce1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:41.257051 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c4c3b10c-0b1c-40c2-b160-701c82931ce1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:41.317388 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-c4c3b10c-0b1c-40c2-b160-701c82931ce1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:41.325988 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-c4c3b10c-0b1c-40c2-b160-701c82931ce1 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.082617 Sep 21 16:50:41.326583 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 865/1651] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:41 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:42.349414 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-9f4acd79-999f-40c0-b557-ab2f8e34fb66 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:42.350150 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-9f4acd79-999f-40c0-b557-ab2f8e34fb66 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:42.356442 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9f4acd79-999f-40c0-b557-ab2f8e34fb66 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:42.356921 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9f4acd79-999f-40c0-b557-ab2f8e34fb66 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:42.357353 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9f4acd79-999f-40c0-b557-ab2f8e34fb66 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:42.358061 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9f4acd79-999f-40c0-b557-ab2f8e34fb66 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:42.358515 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9f4acd79-999f-40c0-b557-ab2f8e34fb66 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:42.358936 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9f4acd79-999f-40c0-b557-ab2f8e34fb66 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:42.421125 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-9f4acd79-999f-40c0-b557-ab2f8e34fb66 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:42.429170 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-9f4acd79-999f-40c0-b557-ab2f8e34fb66 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.083613 Sep 21 16:50:42.429727 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 787/1652] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:42 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:43.453343 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-2ca02a67-f794-42f4-9d8d-11901fd8a834 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:43.453964 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-2ca02a67-f794-42f4-9d8d-11901fd8a834 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:43.460761 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2ca02a67-f794-42f4-9d8d-11901fd8a834 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:43.461268 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2ca02a67-f794-42f4-9d8d-11901fd8a834 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:43.461702 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2ca02a67-f794-42f4-9d8d-11901fd8a834 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:43.462431 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2ca02a67-f794-42f4-9d8d-11901fd8a834 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:43.462885 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2ca02a67-f794-42f4-9d8d-11901fd8a834 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:43.463308 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2ca02a67-f794-42f4-9d8d-11901fd8a834 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:43.526226 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-2ca02a67-f794-42f4-9d8d-11901fd8a834 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:43.534359 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-2ca02a67-f794-42f4-9d8d-11901fd8a834 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.084927 Sep 21 16:50:43.534935 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 866/1653] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:43 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:44.556613 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-5b7929e9-4a01-4e86-8497-61c28f919436 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:44.557220 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-5b7929e9-4a01-4e86-8497-61c28f919436 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:44.563620 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5b7929e9-4a01-4e86-8497-61c28f919436 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:44.564089 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5b7929e9-4a01-4e86-8497-61c28f919436 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:44.564517 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5b7929e9-4a01-4e86-8497-61c28f919436 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:44.565196 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5b7929e9-4a01-4e86-8497-61c28f919436 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:44.565641 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5b7929e9-4a01-4e86-8497-61c28f919436 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:44.566068 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-5b7929e9-4a01-4e86-8497-61c28f919436 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:44.626074 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-5b7929e9-4a01-4e86-8497-61c28f919436 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:44.634009 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-5b7929e9-4a01-4e86-8497-61c28f919436 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.081237 Sep 21 16:50:44.634583 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 788/1654] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:44 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:45.656592 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-1a3e9567-b30d-4eb5-8735-23359297d18b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:45.657209 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-1a3e9567-b30d-4eb5-8735-23359297d18b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:45.659666 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_api:SELECT=28 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:50:45.664976 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1a3e9567-b30d-4eb5-8735-23359297d18b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:45.665955 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1a3e9567-b30d-4eb5-8735-23359297d18b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:45.666416 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1a3e9567-b30d-4eb5-8735-23359297d18b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:45.667206 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1a3e9567-b30d-4eb5-8735-23359297d18b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:45.667687 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1a3e9567-b30d-4eb5-8735-23359297d18b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:45.668109 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-1a3e9567-b30d-4eb5-8735-23359297d18b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:45.727266 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-1a3e9567-b30d-4eb5-8735-23359297d18b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:45.735854 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-1a3e9567-b30d-4eb5-8735-23359297d18b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.083145 Sep 21 16:50:45.736490 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 867/1655] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:45 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:46.758553 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-6253df4b-6842-4dd0-a538-92c466abbca8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:46.759619 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-6253df4b-6842-4dd0-a538-92c466abbca8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:46.766001 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6253df4b-6842-4dd0-a538-92c466abbca8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:46.766509 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6253df4b-6842-4dd0-a538-92c466abbca8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:46.766940 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6253df4b-6842-4dd0-a538-92c466abbca8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:46.767624 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6253df4b-6842-4dd0-a538-92c466abbca8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:46.768073 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6253df4b-6842-4dd0-a538-92c466abbca8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:46.768499 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6253df4b-6842-4dd0-a538-92c466abbca8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:46.830401 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-6253df4b-6842-4dd0-a538-92c466abbca8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:46.838668 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-6253df4b-6842-4dd0-a538-92c466abbca8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.084051 Sep 21 16:50:46.839228 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 789/1656] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:46 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:47.863132 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-3db70c4b-c94c-4e17-b4da-24969a035a2c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:47.863680 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-3db70c4b-c94c-4e17-b4da-24969a035a2c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:47.870622 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3db70c4b-c94c-4e17-b4da-24969a035a2c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:47.871095 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3db70c4b-c94c-4e17-b4da-24969a035a2c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:47.871529 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3db70c4b-c94c-4e17-b4da-24969a035a2c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:47.872210 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3db70c4b-c94c-4e17-b4da-24969a035a2c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:47.872659 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3db70c4b-c94c-4e17-b4da-24969a035a2c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:47.873073 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-3db70c4b-c94c-4e17-b4da-24969a035a2c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:47.875580 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=81 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:50:47.938410 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-3db70c4b-c94c-4e17-b4da-24969a035a2c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:47.946553 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-3db70c4b-c94c-4e17-b4da-24969a035a2c tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.087391 Sep 21 16:50:47.947162 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 868/1657] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:47 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:48.969450 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-03276f89-6f7c-43d1-8306-4935c2de87a6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:48.970069 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-03276f89-6f7c-43d1-8306-4935c2de87a6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:48.972474 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 21 16:50:48.972623 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Wed Sep 21 16:50:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db (ip 10.222.0.64) !!! Sep 21 16:50:48.973641 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 21 16:50:48.973849 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Wed Sep 21 16:50:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db (ip 10.222.0.64) !!! Sep 21 16:50:48.974902 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 21 16:50:48.975013 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Wed Sep 21 16:50:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db (ip 10.222.0.64) !!! Sep 21 16:50:48.975846 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_api:SELECT=28 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:50:48.986831 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-03276f89-6f7c-43d1-8306-4935c2de87a6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:48.987317 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-03276f89-6f7c-43d1-8306-4935c2de87a6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:48.987755 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-03276f89-6f7c-43d1-8306-4935c2de87a6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:48.988455 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-03276f89-6f7c-43d1-8306-4935c2de87a6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:48.988907 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-03276f89-6f7c-43d1-8306-4935c2de87a6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:48.989327 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-03276f89-6f7c-43d1-8306-4935c2de87a6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:49.050271 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-03276f89-6f7c-43d1-8306-4935c2de87a6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:49.058413 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-03276f89-6f7c-43d1-8306-4935c2de87a6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.092736 Sep 21 16:50:49.058983 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 790/1658] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:48 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:50.080890 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ed7c6298-243f-4b59-b172-a897461c487e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:50.081488 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ed7c6298-243f-4b59-b172-a897461c487e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:50.084172 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 21 16:50:50.084301 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Wed Sep 21 16:50:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db (ip 10.222.0.64) !!! Sep 21 16:50:50.086446 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 21 16:50:50.086604 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Wed Sep 21 16:50:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db (ip 10.222.0.64) !!! Sep 21 16:50:50.094692 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ed7c6298-243f-4b59-b172-a897461c487e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:50.095174 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ed7c6298-243f-4b59-b172-a897461c487e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:50.095608 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ed7c6298-243f-4b59-b172-a897461c487e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:50.096303 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ed7c6298-243f-4b59-b172-a897461c487e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:50.096759 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ed7c6298-243f-4b59-b172-a897461c487e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:50.097184 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ed7c6298-243f-4b59-b172-a897461c487e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:50.160021 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ed7c6298-243f-4b59-b172-a897461c487e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:50.168711 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ed7c6298-243f-4b59-b172-a897461c487e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.091762 Sep 21 16:50:50.169279 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 869/1659] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:50 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:51.192008 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-bbdfe2f9-9b1c-4e33-8348-d08cc14d47f6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:51.192648 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-bbdfe2f9-9b1c-4e33-8348-d08cc14d47f6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:51.199324 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bbdfe2f9-9b1c-4e33-8348-d08cc14d47f6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:51.199796 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bbdfe2f9-9b1c-4e33-8348-d08cc14d47f6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:51.200224 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bbdfe2f9-9b1c-4e33-8348-d08cc14d47f6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:51.200905 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bbdfe2f9-9b1c-4e33-8348-d08cc14d47f6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:51.201358 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bbdfe2f9-9b1c-4e33-8348-d08cc14d47f6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:51.201772 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bbdfe2f9-9b1c-4e33-8348-d08cc14d47f6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:51.266342 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-bbdfe2f9-9b1c-4e33-8348-d08cc14d47f6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:51.274938 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-bbdfe2f9-9b1c-4e33-8348-d08cc14d47f6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.086298 Sep 21 16:50:51.275516 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 791/1660] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:51 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:52.297784 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-9da76f5d-ade6-417b-bd91-9005d06c6d4e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:52.298434 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-9da76f5d-ade6-417b-bd91-9005d06c6d4e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:52.304928 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9da76f5d-ade6-417b-bd91-9005d06c6d4e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:52.305406 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9da76f5d-ade6-417b-bd91-9005d06c6d4e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:52.306377 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9da76f5d-ade6-417b-bd91-9005d06c6d4e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:52.307070 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9da76f5d-ade6-417b-bd91-9005d06c6d4e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:52.307526 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9da76f5d-ade6-417b-bd91-9005d06c6d4e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:52.307947 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9da76f5d-ade6-417b-bd91-9005d06c6d4e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:52.367370 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-9da76f5d-ade6-417b-bd91-9005d06c6d4e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:52.375989 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-9da76f5d-ade6-417b-bd91-9005d06c6d4e tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.082139 Sep 21 16:50:52.376572 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 870/1661] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:52 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:53.399394 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-e373edba-42e4-4fc0-ac83-c052dd6871ea tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:53.400591 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-e373edba-42e4-4fc0-ac83-c052dd6871ea tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:53.406933 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e373edba-42e4-4fc0-ac83-c052dd6871ea tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:53.407404 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e373edba-42e4-4fc0-ac83-c052dd6871ea tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:53.407830 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e373edba-42e4-4fc0-ac83-c052dd6871ea tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:53.408506 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e373edba-42e4-4fc0-ac83-c052dd6871ea tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:53.408949 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e373edba-42e4-4fc0-ac83-c052dd6871ea tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:53.409360 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e373edba-42e4-4fc0-ac83-c052dd6871ea tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:53.469237 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-e373edba-42e4-4fc0-ac83-c052dd6871ea tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:53.477261 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-e373edba-42e4-4fc0-ac83-c052dd6871ea tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.081755 Sep 21 16:50:53.477868 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 792/1662] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:53 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:54.500449 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-03e1fdec-c758-4e6d-a7cf-9741a8e49b20 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:54.501060 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-03e1fdec-c758-4e6d-a7cf-9741a8e49b20 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:54.507472 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-03e1fdec-c758-4e6d-a7cf-9741a8e49b20 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:54.507945 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-03e1fdec-c758-4e6d-a7cf-9741a8e49b20 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:54.508371 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-03e1fdec-c758-4e6d-a7cf-9741a8e49b20 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:54.509655 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-03e1fdec-c758-4e6d-a7cf-9741a8e49b20 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:54.510132 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-03e1fdec-c758-4e6d-a7cf-9741a8e49b20 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:54.510550 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-03e1fdec-c758-4e6d-a7cf-9741a8e49b20 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:54.569677 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-03e1fdec-c758-4e6d-a7cf-9741a8e49b20 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:54.578349 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-03e1fdec-c758-4e6d-a7cf-9741a8e49b20 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.081783 Sep 21 16:50:54.578914 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 871/1663] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:54 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:55.601172 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-b5778bd9-a8fa-4839-9466-9c6edb09593d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:55.601785 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-b5778bd9-a8fa-4839-9466-9c6edb09593d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:55.608246 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b5778bd9-a8fa-4839-9466-9c6edb09593d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:55.608723 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b5778bd9-a8fa-4839-9466-9c6edb09593d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:55.609156 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b5778bd9-a8fa-4839-9466-9c6edb09593d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:55.609843 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b5778bd9-a8fa-4839-9466-9c6edb09593d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:55.610333 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b5778bd9-a8fa-4839-9466-9c6edb09593d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:55.610752 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b5778bd9-a8fa-4839-9466-9c6edb09593d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:55.613237 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=84 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:50:55.672143 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-b5778bd9-a8fa-4839-9466-9c6edb09593d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:55.680197 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-b5778bd9-a8fa-4839-9466-9c6edb09593d tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.082924 Sep 21 16:50:55.680802 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 793/1664] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:55 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 16:50:56.702719 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-6c09aa9e-61fc-468a-8aec-f88e89412191 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:50:56.703342 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-6c09aa9e-61fc-468a-8aec-f88e89412191 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: f0026951-8625-4521-a6fa-7583577348db] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 16:50:56.710036 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6c09aa9e-61fc-468a-8aec-f88e89412191 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:56.710548 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6c09aa9e-61fc-468a-8aec-f88e89412191 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:56.711007 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6c09aa9e-61fc-468a-8aec-f88e89412191 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:56.711682 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6c09aa9e-61fc-468a-8aec-f88e89412191 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 16:50:56.712681 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6c09aa9e-61fc-468a-8aec-f88e89412191 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 16:50:56.713110 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6c09aa9e-61fc-468a-8aec-f88e89412191 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 16:50:56.775307 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-6c09aa9e-61fc-468a-8aec-f88e89412191 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 16:50:56.786296 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-6c09aa9e-61fc-468a-8aec-f88e89412191 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db" status: 200 len: 1348 microversion: 2.1 time: 0.087120 Sep 21 16:50:56.787358 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 872/1665] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 16:50:56 2022] GET /compute/v2.1/servers/f0026951-8625-4521-a6fa-7583577348db => generated 1348 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 16:56:09.499940 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR oslo.messaging._drivers.impl_rabbit [-] [553ea9c1-57dc-451e-b10a-7e2f64159847] AMQP server on 10.222.0.64:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 21 16:56:09.500748 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_api:SELECT=7 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:56:09.501619 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=5 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 16:56:09.502596 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 21 16:56:09.502723 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Wed Sep 21 16:56:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1166440784 (ip 10.222.0.64) !!! Sep 21 16:56:09.504319 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 21 16:56:09.504422 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Wed Sep 21 16:56:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1166440784 (ip 10.222.0.64) !!! Sep 21 16:56:09.505718 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 21 16:56:09.505848 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Wed Sep 21 16:56:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1166440784 (ip 10.222.0.64) !!! Sep 21 16:56:09.513066 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-a9e372f6-9d5d-4753-b8e1-20f9dd936b39 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] Calling method '.version_select at 0x7fdb88d93f70>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 16:56:09.544227 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-a9e372f6-9d5d-4753-b8e1-20f9dd936b39 tempest-TestVolumeBootPattern-1127138919 tempest-TestVolumeBootPattern-1127138919-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1166440784" status: 202 len: 0 microversion: 2.1 time: 0.046108 Sep 21 16:56:09.544864 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 794/1666] 10.222.0.64 () {58 vars in 1263 bytes} [Wed Sep 21 16:56:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1166440784 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 21 17:03:02.849420 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5869e334-ec9b-4aec-be58-31127dba4f24] AMQP server on 10.222.0.64:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 21 17:03:02.849982 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_api:SELECT=11 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 17:03:02.850936 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=29 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 17:03:02.851815 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 21 17:03:02.852096 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Wed Sep 21 17:03:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.64) !!! Sep 21 17:03:02.853283 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 21 17:03:02.853388 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Wed Sep 21 17:03:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.64) !!! Sep 21 17:03:02.855217 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 21 17:03:02.855360 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Wed Sep 21 17:03:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.64) !!! Sep 21 17:03:02.860460 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-474bb298-7430-40c8-b5d6-634f2cdb6ac7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-533876631", "imageRef": "600db436-ed6c-41b7-89f7-7dd31852a1a7", "flavorRef": "452", "networks": [{"uuid": "80abbf7f-d658-47d0-bdcc-452a6546b53d"}]}} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 17:03:03.144239 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.network.neutron [None req-474bb298-7430-40c8-b5d6-634f2cdb6ac7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] validate_networks() for [('80abbf7f-d658-47d0-bdcc-452a6546b53d', None, None, None, None, None)] {{(pid=120532) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 17:03:03.592749 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-474bb298-7430-40c8-b5d6-634f2cdb6ac7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Flavor limits 0:0:0 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 17:03:03.593196 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-474bb298-7430-40c8-b5d6-634f2cdb6ac7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Image limits 0:0:0 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 17:03:03.593669 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-474bb298-7430-40c8-b5d6-634f2cdb6ac7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Flavor pref 0:0:0 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 17:03:03.594106 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-474bb298-7430-40c8-b5d6-634f2cdb6ac7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Image pref 0:0:0 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 17:03:03.594523 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.virt.hardware [None req-474bb298-7430-40c8-b5d6-634f2cdb6ac7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 17:03:03.603258 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-474bb298-7430-40c8-b5d6-634f2cdb6ac7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:03:03.603733 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-474bb298-7430-40c8-b5d6-634f2cdb6ac7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:03:03.604162 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-474bb298-7430-40c8-b5d6-634f2cdb6ac7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:03:03.604923 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-474bb298-7430-40c8-b5d6-634f2cdb6ac7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:03:03.605374 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-474bb298-7430-40c8-b5d6-634f2cdb6ac7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:03:03.605794 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-474bb298-7430-40c8-b5d6-634f2cdb6ac7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:03:03.622520 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.quota [None req-474bb298-7430-40c8-b5d6-634f2cdb6ac7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Getting quotas for project 5eb1e42761a74d7eb8509ac0f4d1c1db. Resources: {'cores', 'ram', 'instances'} {{(pid=120532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 17:03:03.626351 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.quota [None req-474bb298-7430-40c8-b5d6-634f2cdb6ac7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Getting quotas for user 10f2730695454358bc1707dd0815d880 and project 5eb1e42761a74d7eb8509ac0f4d1c1db. Resources: {'cores', 'ram', 'instances'} {{(pid=120532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 17:03:03.637513 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-474bb298-7430-40c8-b5d6-634f2cdb6ac7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Going to run 1 instances... {{(pid=120532) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 17:03:03.639779 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-474bb298-7430-40c8-b5d6-634f2cdb6ac7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: 4302c3a5-1a69-46ee-8771-c08fd50f4134] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='600db436-ed6c-41b7-89f7-7dd31852a1a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120532) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 17:03:03.687835 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-474bb298-7430-40c8-b5d6-634f2cdb6ac7 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.840327 Sep 21 17:03:03.688576 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 873/1667] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Sep 21 17:03:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 21 17:03:03.697384 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 17:03:03.699097 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 21 17:03:03.699223 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Wed Sep 21 17:03:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134 (ip 10.222.0.64) !!! Sep 21 17:03:03.700395 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 21 17:03:03.700505 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Wed Sep 21 17:03:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134 (ip 10.222.0.64) !!! Sep 21 17:03:03.702272 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 21 17:03:03.702393 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Wed Sep 21 17:03:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134 (ip 10.222.0.64) !!! Sep 21 17:03:03.711258 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-ebb59e4d-ec8a-41e7-8ed3-5902f5c25b13 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:03:03.711410 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-ebb59e4d-ec8a-41e7-8ed3-5902f5c25b13 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: 4302c3a5-1a69-46ee-8771-c08fd50f4134] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:03:03.725327 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO oslo.messaging._drivers.impl_rabbit [-] [553ea9c1-57dc-451e-b10a-7e2f64159847] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 39602. Sep 21 17:03:03.822965 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-ebb59e4d-ec8a-41e7-8ed3-5902f5c25b13 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:03:03.830349 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-ebb59e4d-ec8a-41e7-8ed3-5902f5c25b13 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134" status: 200 len: 1218 microversion: 2.1 time: 0.134701 Sep 21 17:03:03.830905 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 795/1668] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:03:03 2022] GET /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134 => generated 1218 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:03:04.854243 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-2423ff46-063f-4156-8ac5-70bea2a6925b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:03:04.855356 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-2423ff46-063f-4156-8ac5-70bea2a6925b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: 4302c3a5-1a69-46ee-8771-c08fd50f4134] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:03:04.864926 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO oslo.messaging._drivers.impl_rabbit [-] [5869e334-ec9b-4aec-be58-31127dba4f24] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 39622. Sep 21 17:03:04.914976 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-2423ff46-063f-4156-8ac5-70bea2a6925b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:03:04.922327 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-2423ff46-063f-4156-8ac5-70bea2a6925b tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134" status: 200 len: 1218 microversion: 2.1 time: 0.073523 Sep 21 17:03:04.922897 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 874/1669] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:03:04 2022] GET /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134 => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:03:05.944458 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-fb8152b2-62ed-498b-b587-8b29cb4e6e36 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:03:05.945070 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-fb8152b2-62ed-498b-b587-8b29cb4e6e36 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: 4302c3a5-1a69-46ee-8771-c08fd50f4134] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:03:05.998812 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-fb8152b2-62ed-498b-b587-8b29cb4e6e36 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:03:06.005616 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-fb8152b2-62ed-498b-b587-8b29cb4e6e36 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134" status: 200 len: 1218 microversion: 2.1 time: 0.065017 Sep 21 17:03:06.006193 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 796/1670] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:03:05 2022] GET /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134 => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:03:07.032600 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-fb35cc1d-e466-4c85-a013-ac8051623401 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:03:07.033256 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-fb35cc1d-e466-4c85-a013-ac8051623401 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: 4302c3a5-1a69-46ee-8771-c08fd50f4134] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:03:07.091656 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-fb35cc1d-e466-4c85-a013-ac8051623401 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:03:07.099892 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-fb35cc1d-e466-4c85-a013-ac8051623401 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134" status: 200 len: 1218 microversion: 2.1 time: 0.075023 Sep 21 17:03:07.100779 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 875/1671] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:03:07 2022] GET /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134 => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:03:08.123759 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-8d33c242-1bed-4581-8082-fd2d3f5a9625 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:03:08.124400 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-8d33c242-1bed-4581-8082-fd2d3f5a9625 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: 4302c3a5-1a69-46ee-8771-c08fd50f4134] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:03:08.130836 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8d33c242-1bed-4581-8082-fd2d3f5a9625 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:03:08.131325 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8d33c242-1bed-4581-8082-fd2d3f5a9625 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:03:08.131760 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8d33c242-1bed-4581-8082-fd2d3f5a9625 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:03:08.132451 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8d33c242-1bed-4581-8082-fd2d3f5a9625 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:03:08.132906 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8d33c242-1bed-4581-8082-fd2d3f5a9625 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:03:08.133330 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8d33c242-1bed-4581-8082-fd2d3f5a9625 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:03:08.200857 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-8d33c242-1bed-4581-8082-fd2d3f5a9625 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:03:08.208570 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-8d33c242-1bed-4581-8082-fd2d3f5a9625 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134" status: 200 len: 1222 microversion: 2.1 time: 0.089227 Sep 21 17:03:08.209153 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 797/1672] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:03:08 2022] GET /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:03:09.231614 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-0fb74afd-4d2e-416c-9d48-0797e382bbbb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:03:09.232262 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-0fb74afd-4d2e-416c-9d48-0797e382bbbb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: 4302c3a5-1a69-46ee-8771-c08fd50f4134] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:03:09.239520 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0fb74afd-4d2e-416c-9d48-0797e382bbbb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:03:09.240005 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0fb74afd-4d2e-416c-9d48-0797e382bbbb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:03:09.240466 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0fb74afd-4d2e-416c-9d48-0797e382bbbb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:03:09.241157 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0fb74afd-4d2e-416c-9d48-0797e382bbbb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:03:09.241610 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0fb74afd-4d2e-416c-9d48-0797e382bbbb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:03:09.242031 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-0fb74afd-4d2e-416c-9d48-0797e382bbbb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:03:09.374034 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-0fb74afd-4d2e-416c-9d48-0797e382bbbb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:03:09.381939 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-0fb74afd-4d2e-416c-9d48-0797e382bbbb tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134" status: 200 len: 1318 microversion: 2.1 time: 0.154274 Sep 21 17:03:09.382573 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 876/1673] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:03:09 2022] GET /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:03:10.143754 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-86c8a10a-a822-432b-a7ab-306e6c6b1890 req-dd7f7282-e82e-4a7d-836f-17265d703a2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4302c3a5-1a69-46ee-8771-c08fd50f4134", "tag": "88bfdff5-96fb-4c66-96c1-47e44befa84b"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 17:03:10.153816 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-86c8a10a-a822-432b-a7ab-306e6c6b1890 req-dd7f7282-e82e-4a7d-836f-17265d703a2d service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:03:10.154689 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-86c8a10a-a822-432b-a7ab-306e6c6b1890 req-dd7f7282-e82e-4a7d-836f-17265d703a2d service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:03:10.155184 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-86c8a10a-a822-432b-a7ab-306e6c6b1890 req-dd7f7282-e82e-4a7d-836f-17265d703a2d service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:03:10.166784 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-86c8a10a-a822-432b-a7ab-306e6c6b1890 req-dd7f7282-e82e-4a7d-836f-17265d703a2d service nova] Creating event network-changed:88bfdff5-96fb-4c66-96c1-47e44befa84b for instance 4302c3a5-1a69-46ee-8771-c08fd50f4134 on hv-cinder-85862 Sep 21 17:03:10.173608 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-86c8a10a-a822-432b-a7ab-306e6c6b1890 req-dd7f7282-e82e-4a7d-836f-17265d703a2d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094063 Sep 21 17:03:10.174244 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 798/1674] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 17:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 17:03:10.404978 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-fdc0fcef-4038-4861-8c04-ab2b0c7f34d4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:03:10.405588 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-fdc0fcef-4038-4861-8c04-ab2b0c7f34d4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: 4302c3a5-1a69-46ee-8771-c08fd50f4134] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:03:10.411889 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fdc0fcef-4038-4861-8c04-ab2b0c7f34d4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:03:10.412367 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fdc0fcef-4038-4861-8c04-ab2b0c7f34d4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:03:10.412826 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fdc0fcef-4038-4861-8c04-ab2b0c7f34d4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:03:10.413509 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fdc0fcef-4038-4861-8c04-ab2b0c7f34d4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:03:10.413989 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fdc0fcef-4038-4861-8c04-ab2b0c7f34d4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:03:10.414428 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-fdc0fcef-4038-4861-8c04-ab2b0c7f34d4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:03:10.543196 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-fdc0fcef-4038-4861-8c04-ab2b0c7f34d4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:03:10.551317 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-fdc0fcef-4038-4861-8c04-ab2b0c7f34d4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134" status: 200 len: 1318 microversion: 2.1 time: 0.150263 Sep 21 17:03:10.551954 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 877/1675] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:03:10 2022] GET /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:03:11.575497 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-4b944578-ca62-457f-be65-918004e276dd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:03:11.576194 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-4b944578-ca62-457f-be65-918004e276dd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: 4302c3a5-1a69-46ee-8771-c08fd50f4134] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:03:11.582600 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4b944578-ca62-457f-be65-918004e276dd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:03:11.583072 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4b944578-ca62-457f-be65-918004e276dd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:03:11.583496 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4b944578-ca62-457f-be65-918004e276dd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:03:11.584171 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4b944578-ca62-457f-be65-918004e276dd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:03:11.584899 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4b944578-ca62-457f-be65-918004e276dd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:03:11.585301 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-4b944578-ca62-457f-be65-918004e276dd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:03:11.730658 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-4b944578-ca62-457f-be65-918004e276dd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:03:11.738202 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-4b944578-ca62-457f-be65-918004e276dd tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134" status: 200 len: 1318 microversion: 2.1 time: 0.167845 Sep 21 17:03:11.738761 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 799/1676] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:03:11 2022] GET /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:03:12.761347 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-399f1094-e8fa-4b5b-92c8-c733633fa290 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:03:12.761924 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-399f1094-e8fa-4b5b-92c8-c733633fa290 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: 4302c3a5-1a69-46ee-8771-c08fd50f4134] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:03:12.768307 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-399f1094-e8fa-4b5b-92c8-c733633fa290 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:03:12.768819 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-399f1094-e8fa-4b5b-92c8-c733633fa290 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:03:12.769254 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-399f1094-e8fa-4b5b-92c8-c733633fa290 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:03:12.769965 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-399f1094-e8fa-4b5b-92c8-c733633fa290 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:03:12.770445 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-399f1094-e8fa-4b5b-92c8-c733633fa290 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:03:12.770868 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-399f1094-e8fa-4b5b-92c8-c733633fa290 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:03:12.900118 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-399f1094-e8fa-4b5b-92c8-c733633fa290 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:03:12.907935 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-399f1094-e8fa-4b5b-92c8-c733633fa290 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134" status: 200 len: 1318 microversion: 2.1 time: 0.150895 Sep 21 17:03:12.908535 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 878/1677] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:03:12 2022] GET /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:03:13.930316 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-bbb422f6-db98-43b6-9780-bd0ad9a05ed8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:03:13.930961 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-bbb422f6-db98-43b6-9780-bd0ad9a05ed8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: 4302c3a5-1a69-46ee-8771-c08fd50f4134] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:03:13.938107 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bbb422f6-db98-43b6-9780-bd0ad9a05ed8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:03:13.938588 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bbb422f6-db98-43b6-9780-bd0ad9a05ed8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:03:13.939025 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bbb422f6-db98-43b6-9780-bd0ad9a05ed8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:03:13.939712 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bbb422f6-db98-43b6-9780-bd0ad9a05ed8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:03:13.940163 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bbb422f6-db98-43b6-9780-bd0ad9a05ed8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:03:13.940586 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bbb422f6-db98-43b6-9780-bd0ad9a05ed8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:03:14.065031 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-bbb422f6-db98-43b6-9780-bd0ad9a05ed8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:03:14.072595 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-bbb422f6-db98-43b6-9780-bd0ad9a05ed8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134" status: 200 len: 1318 microversion: 2.1 time: 0.146152 Sep 21 17:03:14.073170 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 800/1678] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:03:13 2022] GET /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:03:15.095376 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ddaada0c-ab47-4ddb-89bf-5e9f1fdd7fe6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:03:15.095985 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ddaada0c-ab47-4ddb-89bf-5e9f1fdd7fe6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: 4302c3a5-1a69-46ee-8771-c08fd50f4134] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:03:15.097829 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell0:SELECT=2 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 17:03:15.104444 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ddaada0c-ab47-4ddb-89bf-5e9f1fdd7fe6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:03:15.104444 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ddaada0c-ab47-4ddb-89bf-5e9f1fdd7fe6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:03:15.104685 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ddaada0c-ab47-4ddb-89bf-5e9f1fdd7fe6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:03:15.105336 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ddaada0c-ab47-4ddb-89bf-5e9f1fdd7fe6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:03:15.105782 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ddaada0c-ab47-4ddb-89bf-5e9f1fdd7fe6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:03:15.106235 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ddaada0c-ab47-4ddb-89bf-5e9f1fdd7fe6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:03:15.243490 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ddaada0c-ab47-4ddb-89bf-5e9f1fdd7fe6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:03:15.252416 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ddaada0c-ab47-4ddb-89bf-5e9f1fdd7fe6 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134" status: 200 len: 1318 microversion: 2.1 time: 0.160853 Sep 21 17:03:15.253281 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 879/1679] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:03:15 2022] GET /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:03:15.327055 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-2c2901c4-e592-4fee-b317-a209b316e1e9 req-65ef7e5e-ab71-4045-952e-d16f18998b79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4302c3a5-1a69-46ee-8771-c08fd50f4134", "name": "network-vif-plugged", "status": "completed", "tag": "88bfdff5-96fb-4c66-96c1-47e44befa84b"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 17:03:15.337207 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-2c2901c4-e592-4fee-b317-a209b316e1e9 req-65ef7e5e-ab71-4045-952e-d16f18998b79 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:03:15.337207 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-2c2901c4-e592-4fee-b317-a209b316e1e9 req-65ef7e5e-ab71-4045-952e-d16f18998b79 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:03:15.337485 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-2c2901c4-e592-4fee-b317-a209b316e1e9 req-65ef7e5e-ab71-4045-952e-d16f18998b79 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:03:15.348152 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-2c2901c4-e592-4fee-b317-a209b316e1e9 req-65ef7e5e-ab71-4045-952e-d16f18998b79 service nova] Creating event network-vif-plugged:88bfdff5-96fb-4c66-96c1-47e44befa84b for instance 4302c3a5-1a69-46ee-8771-c08fd50f4134 on hv-cinder-85862 Sep 21 17:03:15.353159 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-2c2901c4-e592-4fee-b317-a209b316e1e9 req-65ef7e5e-ab71-4045-952e-d16f18998b79 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084538 Sep 21 17:03:15.353823 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 801/1680] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 17:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 17:03:16.274868 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c8d7735e-8e4c-4fd9-b483-81445f72c5ef tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:03:16.275482 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-c8d7735e-8e4c-4fd9-b483-81445f72c5ef tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: 4302c3a5-1a69-46ee-8771-c08fd50f4134] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:03:16.281886 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c8d7735e-8e4c-4fd9-b483-81445f72c5ef tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:03:16.282385 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c8d7735e-8e4c-4fd9-b483-81445f72c5ef tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:03:16.282815 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c8d7735e-8e4c-4fd9-b483-81445f72c5ef tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:03:16.283494 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c8d7735e-8e4c-4fd9-b483-81445f72c5ef tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:03:16.283942 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c8d7735e-8e4c-4fd9-b483-81445f72c5ef tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:03:16.284361 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c8d7735e-8e4c-4fd9-b483-81445f72c5ef tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:03:16.409750 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-c8d7735e-8e4c-4fd9-b483-81445f72c5ef tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:03:16.417901 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-c8d7735e-8e4c-4fd9-b483-81445f72c5ef tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134" status: 200 len: 1318 microversion: 2.1 time: 0.146948 Sep 21 17:03:16.418502 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 880/1681] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:03:16 2022] GET /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:03:17.437910 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell0:SELECT=4 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 17:03:17.442649 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-18aa7895-9a0b-4550-85b6-9e7247465ec9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:03:17.443348 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-18aa7895-9a0b-4550-85b6-9e7247465ec9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: 4302c3a5-1a69-46ee-8771-c08fd50f4134] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:03:17.450211 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-18aa7895-9a0b-4550-85b6-9e7247465ec9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:03:17.450688 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-18aa7895-9a0b-4550-85b6-9e7247465ec9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:03:17.451114 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-18aa7895-9a0b-4550-85b6-9e7247465ec9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:03:17.451789 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-18aa7895-9a0b-4550-85b6-9e7247465ec9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:03:17.452234 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-18aa7895-9a0b-4550-85b6-9e7247465ec9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:03:17.452652 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-18aa7895-9a0b-4550-85b6-9e7247465ec9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:03:17.577674 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-18aa7895-9a0b-4550-85b6-9e7247465ec9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:03:17.585207 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-18aa7895-9a0b-4550-85b6-9e7247465ec9 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134" status: 200 len: 1508 microversion: 2.1 time: 0.148254 Sep 21 17:03:17.585769 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 802/1682] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:03:17 2022] GET /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 17:03:17.607999 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-8803a717-c963-49d5-aabd-7f939d3cb297 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e40dbb79-62d3-4314-95f0-97a0ef5be598", "device": "/dev/sdb"}} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 17:03:17.610489 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-8803a717-c963-49d5-aabd-7f939d3cb297 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: 4302c3a5-1a69-46ee-8771-c08fd50f4134] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:03:17.612291 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell0:SELECT=10 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 17:03:17.617896 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8803a717-c963-49d5-aabd-7f939d3cb297 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:03:17.618403 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8803a717-c963-49d5-aabd-7f939d3cb297 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:03:17.618832 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8803a717-c963-49d5-aabd-7f939d3cb297 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:03:17.619511 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8803a717-c963-49d5-aabd-7f939d3cb297 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:03:17.620355 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8803a717-c963-49d5-aabd-7f939d3cb297 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:03:17.620779 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-8803a717-c963-49d5-aabd-7f939d3cb297 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:03:17.864871 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-8803a717-c963-49d5-aabd-7f939d3cb297 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "POST /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260689 Sep 21 17:03:17.865644 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 881/1683] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Sep 21 17:03:17 2022] POST /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 17:03:36.188831 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-3d89b18f-4c2d-4f52-b983-4085c5f0a3ab tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:03:36.189320 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-3d89b18f-4c2d-4f52-b983-4085c5f0a3ab tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: 4302c3a5-1a69-46ee-8771-c08fd50f4134] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:03:36.191279 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_api:SELECT=20 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 17:03:36.191969 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=28 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 17:03:36.197448 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3d89b18f-4c2d-4f52-b983-4085c5f0a3ab tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:03:36.197924 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3d89b18f-4c2d-4f52-b983-4085c5f0a3ab tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:03:36.198382 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3d89b18f-4c2d-4f52-b983-4085c5f0a3ab tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:03:36.199060 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3d89b18f-4c2d-4f52-b983-4085c5f0a3ab tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:03:36.199505 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3d89b18f-4c2d-4f52-b983-4085c5f0a3ab tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:03:36.199945 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-3d89b18f-4c2d-4f52-b983-4085c5f0a3ab tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:03:36.277724 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.objects.instance [None req-3d89b18f-4c2d-4f52-b983-4085c5f0a3ab tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lazy-loading 'services' on Instance uuid 4302c3a5-1a69-46ee-8771-c08fd50f4134 {{(pid=120531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 17:03:36.350247 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-3d89b18f-4c2d-4f52-b983-4085c5f0a3ab tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "DELETE /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134/os-volume_attachments/e40dbb79-62d3-4314-95f0-97a0ef5be598" status: 202 len: 0 microversion: 2.1 time: 0.165149 Sep 21 17:03:36.350817 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 803/1684] 10.222.0.64 () {58 vars in 1416 bytes} [Wed Sep 21 17:03:36 2022] DELETE /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134/os-volume_attachments/e40dbb79-62d3-4314-95f0-97a0ef5be598 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 17:03:37.470174 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 17:03:37.470904 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 17:03:37.474976 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-279430f7-8096-43cb-8140-c685291835e8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:03:37.475561 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-279430f7-8096-43cb-8140-c685291835e8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: 4302c3a5-1a69-46ee-8771-c08fd50f4134] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:03:37.483093 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-279430f7-8096-43cb-8140-c685291835e8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:03:37.483616 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-279430f7-8096-43cb-8140-c685291835e8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:03:37.484055 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-279430f7-8096-43cb-8140-c685291835e8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:03:37.484795 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-279430f7-8096-43cb-8140-c685291835e8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:03:37.485253 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-279430f7-8096-43cb-8140-c685291835e8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:03:37.485678 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-279430f7-8096-43cb-8140-c685291835e8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:03:37.512535 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-279430f7-8096-43cb-8140-c685291835e8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: 4302c3a5-1a69-46ee-8771-c08fd50f4134] Going to try to terminate instance {{(pid=120532) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 17:03:37.588277 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-279430f7-8096-43cb-8140-c685291835e8 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "DELETE /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134" status: 204 len: 0 microversion: 2.1 time: 0.119247 Sep 21 17:03:37.589031 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 882/1685] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Sep 21 17:03:37 2022] DELETE /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 21 17:03:37.598597 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-2e8cac3c-e65b-4206-8609-8f31c1fefba4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:03:37.599312 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-2e8cac3c-e65b-4206-8609-8f31c1fefba4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: 4302c3a5-1a69-46ee-8771-c08fd50f4134] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:03:37.605525 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2e8cac3c-e65b-4206-8609-8f31c1fefba4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:03:37.606010 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2e8cac3c-e65b-4206-8609-8f31c1fefba4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:03:37.606503 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2e8cac3c-e65b-4206-8609-8f31c1fefba4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:03:37.607198 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2e8cac3c-e65b-4206-8609-8f31c1fefba4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:03:37.607653 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2e8cac3c-e65b-4206-8609-8f31c1fefba4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:03:37.608078 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2e8cac3c-e65b-4206-8609-8f31c1fefba4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:03:37.740257 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-2e8cac3c-e65b-4206-8609-8f31c1fefba4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:03:37.748510 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-2e8cac3c-e65b-4206-8609-8f31c1fefba4 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134" status: 200 len: 1514 microversion: 2.1 time: 0.154676 Sep 21 17:03:37.749086 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 804/1686] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:03:37 2022] GET /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:03:38.775643 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-e56e962d-d168-4d4d-ba6e-41e36709d001 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:03:38.776338 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-e56e962d-d168-4d4d-ba6e-41e36709d001 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: 4302c3a5-1a69-46ee-8771-c08fd50f4134] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:03:38.783276 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e56e962d-d168-4d4d-ba6e-41e36709d001 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:03:38.783754 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e56e962d-d168-4d4d-ba6e-41e36709d001 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:03:38.784179 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e56e962d-d168-4d4d-ba6e-41e36709d001 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:03:38.784861 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e56e962d-d168-4d4d-ba6e-41e36709d001 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:03:38.785309 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e56e962d-d168-4d4d-ba6e-41e36709d001 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:03:38.785731 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-e56e962d-d168-4d4d-ba6e-41e36709d001 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:03:38.916053 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-e56e962d-d168-4d4d-ba6e-41e36709d001 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:03:38.924373 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-e56e962d-d168-4d4d-ba6e-41e36709d001 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134" status: 200 len: 1514 microversion: 2.1 time: 0.153036 Sep 21 17:03:38.924941 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 883/1687] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:03:38 2022] GET /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:03:39.741625 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-1c7a3cb2-37cf-4dce-bbd2-bc346807bc5d req-657bcb10-ecda-4ea3-a7db-6c7739d373a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4302c3a5-1a69-46ee-8771-c08fd50f4134", "name": "network-vif-deleted", "tag": "88bfdff5-96fb-4c66-96c1-47e44befa84b"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 17:03:39.752707 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-1c7a3cb2-37cf-4dce-bbd2-bc346807bc5d req-657bcb10-ecda-4ea3-a7db-6c7739d373a1 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:03:39.753184 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-1c7a3cb2-37cf-4dce-bbd2-bc346807bc5d req-657bcb10-ecda-4ea3-a7db-6c7739d373a1 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:03:39.753605 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-1c7a3cb2-37cf-4dce-bbd2-bc346807bc5d req-657bcb10-ecda-4ea3-a7db-6c7739d373a1 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:03:39.765908 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-1c7a3cb2-37cf-4dce-bbd2-bc346807bc5d req-657bcb10-ecda-4ea3-a7db-6c7739d373a1 service nova] Creating event network-vif-deleted:88bfdff5-96fb-4c66-96c1-47e44befa84b for instance 4302c3a5-1a69-46ee-8771-c08fd50f4134 on hv-cinder-85862 Sep 21 17:03:39.771101 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-1c7a3cb2-37cf-4dce-bbd2-bc346807bc5d req-657bcb10-ecda-4ea3-a7db-6c7739d373a1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033244 Sep 21 17:03:39.771877 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 805/1688] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 17:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 17:03:39.946991 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-85711d45-e20e-4f28-9137-6b41bc6bc7e0 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:03:39.947604 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-85711d45-e20e-4f28-9137-6b41bc6bc7e0 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: 4302c3a5-1a69-46ee-8771-c08fd50f4134] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:03:39.954580 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-85711d45-e20e-4f28-9137-6b41bc6bc7e0 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:03:39.955068 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-85711d45-e20e-4f28-9137-6b41bc6bc7e0 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:03:39.955499 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-85711d45-e20e-4f28-9137-6b41bc6bc7e0 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:03:39.956186 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-85711d45-e20e-4f28-9137-6b41bc6bc7e0 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:03:39.956641 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-85711d45-e20e-4f28-9137-6b41bc6bc7e0 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:03:39.957063 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-85711d45-e20e-4f28-9137-6b41bc6bc7e0 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:03:39.987892 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-85711d45-e20e-4f28-9137-6b41bc6bc7e0 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:03:39.988364 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-85711d45-e20e-4f28-9137-6b41bc6bc7e0 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:03:39.988792 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-85711d45-e20e-4f28-9137-6b41bc6bc7e0 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:03:39.989230 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.objects.instance [None req-85711d45-e20e-4f28-9137-6b41bc6bc7e0 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lazy-loading 'fault' on Instance uuid 4302c3a5-1a69-46ee-8771-c08fd50f4134 {{(pid=120532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 17:03:40.028964 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-85711d45-e20e-4f28-9137-6b41bc6bc7e0 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2730695454358bc1707dd0815d880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1e42761a74d7eb8509ac0f4d1c1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:03:40.036405 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-85711d45-e20e-4f28-9137-6b41bc6bc7e0 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134" status: 200 len: 1308 microversion: 2.1 time: 0.093328 Sep 21 17:03:40.036966 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 884/1689] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:03:39 2022] GET /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134 => generated 1308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:03:41.059939 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-e3317918-eeb3-459c-8957-8fd062da8d63 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:03:41.060643 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-e3317918-eeb3-459c-8957-8fd062da8d63 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] [instance: 4302c3a5-1a69-46ee-8771-c08fd50f4134] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:03:41.067270 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e3317918-eeb3-459c-8957-8fd062da8d63 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:03:41.067752 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e3317918-eeb3-459c-8957-8fd062da8d63 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:03:41.068187 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e3317918-eeb3-459c-8957-8fd062da8d63 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:03:41.068883 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e3317918-eeb3-459c-8957-8fd062da8d63 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:03:41.069369 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e3317918-eeb3-459c-8957-8fd062da8d63 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:03:41.069797 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-e3317918-eeb3-459c-8957-8fd062da8d63 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:03:41.082606 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.wsgi [None req-e3317918-eeb3-459c-8957-8fd062da8d63 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] HTTP exception thrown: Instance 4302c3a5-1a69-46ee-8771-c08fd50f4134 could not be found. Sep 21 17:03:41.084234 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-e3317918-eeb3-459c-8957-8fd062da8d63 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Request method failure captured: Sep 21 17:03:41.084234 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: request: GET /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134 HTTP/1.1 Sep 21 17:03:41.084234 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept: application/json Sep 21 17:03:41.084234 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Accept-Encoding: identity Sep 21 17:03:41.084234 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Connection: close Sep 21 17:03:41.084234 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Length: 0 Sep 21 17:03:41.084234 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Content-Type: application/json Sep 21 17:03:41.084234 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Host: 10.222.0.64 Sep 21 17:03:41.084234 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Openstack-System-Scope: None Sep 21 17:03:41.084234 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: User-Agent: python-urllib3/1.26.12 Sep 21 17:03:41.084234 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Auth-Token: gAAAAABjKzxlTYxypHjhRO9vUxbzXM5MD5QnFCYiyRv7hH0VVE9FBUwtJLUBOWzVu4KyCCqSy8pxPFjYo55_CNxtnqYp_-tMnXDtu2SQ4AiCj5hSejCtb8uuKdoIA3ryTRyjOscBdjXEn00rDVN7SnfYBEQ7E-4hjQpGYtXRJsi8GdxXQwxSiC8 Sep 21 17:03:41.084234 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Id: None Sep 21 17:03:41.084234 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Domain-Name: None Sep 21 17:03:41.084234 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Identity-Status: Confirmed Sep 21 17:03:41.084234 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Is-Admin-Project: True Sep 21 17:03:41.084234 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Id: default Sep 21 17:03:41.084234 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Domain-Name: Default Sep 21 17:03:41.084234 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Id: 5eb1e42761a74d7eb8509ac0f4d1c1db Sep 21 17:03:41.084234 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1767144931 Sep 21 17:03:41.084234 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Role: member,reader Sep 21 17:03:41.084234 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Roles: member,reader Sep 21 17:03:41.085679 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/5eb1e42761a74d7eb8509ac0f4d1c1db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5eb1e42761a74d7eb8509ac0f4d1c1db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_5eb1e42761a74d7eb8509ac0f4d1c1db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5eb1e42761a74d7eb8509ac0f4d1c1db"}]}] Sep 21 17:03:41.085679 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant: tempest-VolumesSnapshotTestJSON-1767144931 Sep 21 17:03:41.085679 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Id: 5eb1e42761a74d7eb8509ac0f4d1c1db Sep 21 17:03:41.085679 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1767144931 Sep 21 17:03:41.085679 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User: tempest-VolumesSnapshotTestJSON-1767144931-project Sep 21 17:03:41.085679 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Id: default Sep 21 17:03:41.085679 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Domain-Name: Default Sep 21 17:03:41.085679 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Id: 10f2730695454358bc1707dd0815d880 Sep 21 17:03:41.085679 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: X-User-Name: tempest-VolumesSnapshotTestJSON-1767144931-project Sep 21 17:03:41.085679 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: method: > Sep 21 17:03:41.085679 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: exception: Instance 4302c3a5-1a69-46ee-8771-c08fd50f4134 could not be found. Sep 21 17:03:41.085679 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: action_args: {'id': '4302c3a5-1a69-46ee-8771-c08fd50f4134'} Sep 21 17:03:41.086788 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 17:03:41.086788 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 17:03:41.086788 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 17:03:41.086788 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 17:03:41.086788 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 17:03:41.086788 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 17:03:41.086788 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 17:03:41.086788 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 17:03:41.086788 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 17:03:41.086788 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 17:03:41.086788 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4302c3a5-1a69-46ee-8771-c08fd50f4134 could not be found. Sep 21 17:03:41.086788 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 17:03:41.086788 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 17:03:41.086788 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 17:03:41.086788 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 17:03:41.086788 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 17:03:41.086788 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 17:03:41.086788 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 17:03:41.086788 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 17:03:41.086788 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 17:03:41.088114 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 17:03:41.088114 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 17:03:41.088114 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 17:03:41.088114 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 17:03:41.088114 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 17:03:41.088114 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 17:03:41.088114 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 17:03:41.088114 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4302c3a5-1a69-46ee-8771-c08fd50f4134 could not be found. Sep 21 17:03:41.088114 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 17:03:41.088114 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 17:03:41.088114 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 17:03:41.088114 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 17:03:41.088114 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 17:03:41.088114 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 17:03:41.088114 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 17:03:41.088114 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 17:03:41.088114 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4302c3a5-1a69-46ee-8771-c08fd50f4134 could not be found. Sep 21 17:03:41.088114 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR nova.api.openstack.wsgi Sep 21 17:03:41.089885 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-e3317918-eeb3-459c-8957-8fd062da8d63 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] Returning 404 to user: Instance 4302c3a5-1a69-46ee-8771-c08fd50f4134 could not be found. {{(pid=120531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 17:03:41.089885 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-e3317918-eeb3-459c-8957-8fd062da8d63 tempest-VolumesSnapshotTestJSON-1767144931 tempest-VolumesSnapshotTestJSON-1767144931-project] 10.222.0.64 "GET /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134" status: 404 len: 111 microversion: 2.1 time: 0.029933 Sep 21 17:03:41.089885 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 806/1690] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:03:41 2022] GET /compute/v2.1/servers/4302c3a5-1a69-46ee-8771-c08fd50f4134 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 21 17:04:15.275417 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 17:04:15.276166 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 17:04:15.465035 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ca6f1328-8cda-420c-97c3-e2253fc0469b tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Action: 'create', calling method: .version_select at 0x7fdb88d238b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1644709038", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOv/sFzjJPmYMMwfJCcAxNME9FKb5qa6T0bxZUJWb57mld8XiJGzU9QfWN5s43ZYcgm44rpDB4PGSx8kSp6Ag2Hz9N1I4nSPTgOEp01jZUW09sGg0e2OcGfT3dt60Rh/aw=="}} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 17:04:15.481452 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.quota [None req-ca6f1328-8cda-420c-97c3-e2253fc0469b tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Getting quotas for project 67d9fbc339f64ce8b323195b51b06390. Resources: {'key_pairs'} {{(pid=120532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 17:04:15.485719 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.quota [None req-ca6f1328-8cda-420c-97c3-e2253fc0469b tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Getting quotas for user 2a4d5e6077b642c4bc9bc3be27c15092 and project 67d9fbc339f64ce8b323195b51b06390. Resources: {'key_pairs'} {{(pid=120532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 17:04:15.517700 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ca6f1328-8cda-420c-97c3-e2253fc0469b tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.247665 Sep 21 17:04:15.519074 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 885/1691] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Sep 21 17:04:15 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 17:04:31.925318 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-8d37b300-879c-40ff-b67c-306ffc473c2b tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-720490126", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1644709038", "security_groups": [{"name": "tempest-secgroup-smoke-1134919168"}], "networks": [{"uuid": "29f3fbd3-6418-4be6-b9bc-179f795f61c1"}], "block_device_mapping_v2": [{"uuid": "f8161594-6f1e-4639-b012-d7a38b4363ef", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 17:04:31.935630 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_api:SELECT=8 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 17:04:31.936266 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 17:04:32.042255 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.network.neutron [None req-8d37b300-879c-40ff-b67c-306ffc473c2b tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] validate_networks() for [('29f3fbd3-6418-4be6-b9bc-179f795f61c1', None, None, None, None, None)] {{(pid=120531) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 21 17:04:32.527245 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-8d37b300-879c-40ff-b67c-306ffc473c2b tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Flavor limits 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 21 17:04:32.527663 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-8d37b300-879c-40ff-b67c-306ffc473c2b tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Image limits 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 21 17:04:32.528126 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-8d37b300-879c-40ff-b67c-306ffc473c2b tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Flavor pref 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 21 17:04:32.528525 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-8d37b300-879c-40ff-b67c-306ffc473c2b tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Image pref 0:0:0 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 21 17:04:32.528925 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.virt.hardware [None req-8d37b300-879c-40ff-b67c-306ffc473c2b tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 21 17:04:32.537565 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8d37b300-879c-40ff-b67c-306ffc473c2b tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:04:32.538034 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8d37b300-879c-40ff-b67c-306ffc473c2b tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:04:32.538479 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8d37b300-879c-40ff-b67c-306ffc473c2b tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:04:32.539193 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8d37b300-879c-40ff-b67c-306ffc473c2b tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:04:32.539638 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8d37b300-879c-40ff-b67c-306ffc473c2b tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:04:32.540050 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-8d37b300-879c-40ff-b67c-306ffc473c2b tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:04:32.556733 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.quota [None req-8d37b300-879c-40ff-b67c-306ffc473c2b tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Getting quotas for project 67d9fbc339f64ce8b323195b51b06390. Resources: {'cores', 'ram', 'instances'} {{(pid=120531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 21 17:04:32.561371 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.quota [None req-8d37b300-879c-40ff-b67c-306ffc473c2b tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Getting quotas for user 2a4d5e6077b642c4bc9bc3be27c15092 and project 67d9fbc339f64ce8b323195b51b06390. Resources: {'cores', 'ram', 'instances'} {{(pid=120531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 21 17:04:32.616453 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-8d37b300-879c-40ff-b67c-306ffc473c2b tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Going to run 1 instances... {{(pid=120531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 21 17:04:32.618600 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-8d37b300-879c-40ff-b67c-306ffc473c2b tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f8161594-6f1e-4639-b012-d7a38b4363ef',volume_size=None,volume_type=None)] {{(pid=120531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 21 17:04:32.747304 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-8d37b300-879c-40ff-b67c-306ffc473c2b tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.825806 Sep 21 17:04:32.747949 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 807/1692] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Sep 21 17:04:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 21 17:04:32.756438 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell0:SELECT=4 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 17:04:32.757253 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 17:04:32.761192 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-213f4a4c-f50e-485a-a90c-7d0efd3c7e4d tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:04:32.761805 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-213f4a4c-f50e-485a-a90c-7d0efd3c7e4d tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:04:32.817915 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-213f4a4c-f50e-485a-a90c-7d0efd3c7e4d tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4d5e6077b642c4bc9bc3be27c15092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d9fbc339f64ce8b323195b51b06390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:04:32.825608 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-213f4a4c-f50e-485a-a90c-7d0efd3c7e4d tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 200 len: 1088 microversion: 2.1 time: 0.070494 Sep 21 17:04:32.826203 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 886/1693] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:04:32 2022] GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 1088 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:04:33.849992 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-a4ebbab2-14aa-46a1-ab03-d7045809c08f tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:04:33.851216 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-a4ebbab2-14aa-46a1-ab03-d7045809c08f tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:04:33.857954 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a4ebbab2-14aa-46a1-ab03-d7045809c08f tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:04:33.858475 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a4ebbab2-14aa-46a1-ab03-d7045809c08f tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:04:33.858907 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a4ebbab2-14aa-46a1-ab03-d7045809c08f tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:04:33.859601 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a4ebbab2-14aa-46a1-ab03-d7045809c08f tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:04:33.860050 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a4ebbab2-14aa-46a1-ab03-d7045809c08f tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:04:33.860470 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-a4ebbab2-14aa-46a1-ab03-d7045809c08f tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:04:33.935451 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-a4ebbab2-14aa-46a1-ab03-d7045809c08f tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4d5e6077b642c4bc9bc3be27c15092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d9fbc339f64ce8b323195b51b06390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:04:33.943765 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-a4ebbab2-14aa-46a1-ab03-d7045809c08f tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 200 len: 1194 microversion: 2.1 time: 0.099511 Sep 21 17:04:33.944556 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 808/1694] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:04:33 2022] GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 1194 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:04:34.968615 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-dff65893-e10e-44dc-ba7c-ecd22fa63052 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:04:34.969320 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-dff65893-e10e-44dc-ba7c-ecd22fa63052 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:04:34.975329 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dff65893-e10e-44dc-ba7c-ecd22fa63052 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:04:34.976015 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dff65893-e10e-44dc-ba7c-ecd22fa63052 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:04:34.976619 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dff65893-e10e-44dc-ba7c-ecd22fa63052 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:04:34.977314 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dff65893-e10e-44dc-ba7c-ecd22fa63052 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:04:34.977765 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dff65893-e10e-44dc-ba7c-ecd22fa63052 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:04:34.978217 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-dff65893-e10e-44dc-ba7c-ecd22fa63052 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:04:35.106845 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-dff65893-e10e-44dc-ba7c-ecd22fa63052 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4d5e6077b642c4bc9bc3be27c15092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d9fbc339f64ce8b323195b51b06390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:04:35.114712 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-dff65893-e10e-44dc-ba7c-ecd22fa63052 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 200 len: 1260 microversion: 2.1 time: 0.150843 Sep 21 17:04:35.115284 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 887/1695] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:04:34 2022] GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:04:35.239604 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-4124664e-f54e-4079-86bc-b2611a89f0e4 req-27b63a7c-964e-4b2f-8e35-e7a2822031d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "529464ed-acbf-4d35-9220-6b24020f7759", "tag": "4cd60a85-15f3-4979-8308-721d8f2ba69d"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 17:04:35.254563 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-4124664e-f54e-4079-86bc-b2611a89f0e4 req-27b63a7c-964e-4b2f-8e35-e7a2822031d4 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:04:35.255045 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-4124664e-f54e-4079-86bc-b2611a89f0e4 req-27b63a7c-964e-4b2f-8e35-e7a2822031d4 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:04:35.255647 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-4124664e-f54e-4079-86bc-b2611a89f0e4 req-27b63a7c-964e-4b2f-8e35-e7a2822031d4 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:04:35.267785 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-4124664e-f54e-4079-86bc-b2611a89f0e4 req-27b63a7c-964e-4b2f-8e35-e7a2822031d4 service nova] Creating event network-changed:4cd60a85-15f3-4979-8308-721d8f2ba69d for instance 529464ed-acbf-4d35-9220-6b24020f7759 on hv-cinder-85862 Sep 21 17:04:35.273424 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-4124664e-f54e-4079-86bc-b2611a89f0e4 req-27b63a7c-964e-4b2f-8e35-e7a2822031d4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038066 Sep 21 17:04:35.274446 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 809/1696] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 17:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 17:04:36.139643 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-f8567482-80a3-4347-bb07-19b8a5b5dc88 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:04:36.140256 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-f8567482-80a3-4347-bb07-19b8a5b5dc88 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:04:36.146856 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f8567482-80a3-4347-bb07-19b8a5b5dc88 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:04:36.147349 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f8567482-80a3-4347-bb07-19b8a5b5dc88 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:04:36.147784 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f8567482-80a3-4347-bb07-19b8a5b5dc88 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:04:36.148488 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f8567482-80a3-4347-bb07-19b8a5b5dc88 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:04:36.148942 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f8567482-80a3-4347-bb07-19b8a5b5dc88 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:04:36.149367 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-f8567482-80a3-4347-bb07-19b8a5b5dc88 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:04:36.280033 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-f8567482-80a3-4347-bb07-19b8a5b5dc88 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4d5e6077b642c4bc9bc3be27c15092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d9fbc339f64ce8b323195b51b06390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:04:36.287694 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-f8567482-80a3-4347-bb07-19b8a5b5dc88 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 200 len: 1260 microversion: 2.1 time: 0.152392 Sep 21 17:04:36.288268 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 888/1697] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:04:36 2022] GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 17:04:37.312311 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-14009492-8f55-4dc7-9d18-4930957aaca8 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:04:37.313030 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-14009492-8f55-4dc7-9d18-4930957aaca8 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:04:37.319111 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-14009492-8f55-4dc7-9d18-4930957aaca8 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:04:37.319588 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-14009492-8f55-4dc7-9d18-4930957aaca8 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:04:37.320015 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-14009492-8f55-4dc7-9d18-4930957aaca8 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:04:37.320696 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-14009492-8f55-4dc7-9d18-4930957aaca8 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:04:37.321146 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-14009492-8f55-4dc7-9d18-4930957aaca8 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:04:37.321567 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-14009492-8f55-4dc7-9d18-4930957aaca8 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:04:37.449293 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-14009492-8f55-4dc7-9d18-4930957aaca8 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4d5e6077b642c4bc9bc3be27c15092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d9fbc339f64ce8b323195b51b06390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:04:37.457294 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-14009492-8f55-4dc7-9d18-4930957aaca8 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 200 len: 1260 microversion: 2.1 time: 0.150212 Sep 21 17:04:37.457856 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 810/1698] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:04:37 2022] GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:04:38.480494 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-a42fdea1-2779-4f9f-8699-fe85cc5e30f1 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:04:38.481106 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-a42fdea1-2779-4f9f-8699-fe85cc5e30f1 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:04:38.487742 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a42fdea1-2779-4f9f-8699-fe85cc5e30f1 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:04:38.488193 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a42fdea1-2779-4f9f-8699-fe85cc5e30f1 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:04:38.488628 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a42fdea1-2779-4f9f-8699-fe85cc5e30f1 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:04:38.489319 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a42fdea1-2779-4f9f-8699-fe85cc5e30f1 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:04:38.489780 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a42fdea1-2779-4f9f-8699-fe85cc5e30f1 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:04:38.490240 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-a42fdea1-2779-4f9f-8699-fe85cc5e30f1 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:04:38.619933 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-a42fdea1-2779-4f9f-8699-fe85cc5e30f1 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4d5e6077b642c4bc9bc3be27c15092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d9fbc339f64ce8b323195b51b06390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:04:38.627615 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-a42fdea1-2779-4f9f-8699-fe85cc5e30f1 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 200 len: 1260 microversion: 2.1 time: 0.151090 Sep 21 17:04:38.628189 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 889/1699] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:04:38 2022] GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:04:39.651424 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-7d6365b9-1188-4ac3-9b7e-4acc19afcd5f tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:04:39.652058 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-7d6365b9-1188-4ac3-9b7e-4acc19afcd5f tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:04:39.659027 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7d6365b9-1188-4ac3-9b7e-4acc19afcd5f tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:04:39.659510 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7d6365b9-1188-4ac3-9b7e-4acc19afcd5f tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:04:39.659940 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7d6365b9-1188-4ac3-9b7e-4acc19afcd5f tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:04:39.660618 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7d6365b9-1188-4ac3-9b7e-4acc19afcd5f tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:04:39.661069 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7d6365b9-1188-4ac3-9b7e-4acc19afcd5f tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:04:39.661482 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-7d6365b9-1188-4ac3-9b7e-4acc19afcd5f tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:04:39.790313 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-7d6365b9-1188-4ac3-9b7e-4acc19afcd5f tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4d5e6077b642c4bc9bc3be27c15092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d9fbc339f64ce8b323195b51b06390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:04:39.798409 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-7d6365b9-1188-4ac3-9b7e-4acc19afcd5f tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 200 len: 1260 microversion: 2.1 time: 0.151782 Sep 21 17:04:39.798965 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 811/1700] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:04:39 2022] GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:04:40.820838 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-2de291a1-37e5-44eb-90f8-f1e2fde219b8 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:04:40.821353 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-2de291a1-37e5-44eb-90f8-f1e2fde219b8 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:04:40.827773 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2de291a1-37e5-44eb-90f8-f1e2fde219b8 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:04:40.828251 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2de291a1-37e5-44eb-90f8-f1e2fde219b8 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:04:40.828690 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2de291a1-37e5-44eb-90f8-f1e2fde219b8 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:04:40.829375 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2de291a1-37e5-44eb-90f8-f1e2fde219b8 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:04:40.829829 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2de291a1-37e5-44eb-90f8-f1e2fde219b8 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:04:40.830348 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-2de291a1-37e5-44eb-90f8-f1e2fde219b8 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:04:40.959309 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-2de291a1-37e5-44eb-90f8-f1e2fde219b8 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4d5e6077b642c4bc9bc3be27c15092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d9fbc339f64ce8b323195b51b06390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:04:40.967793 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-2de291a1-37e5-44eb-90f8-f1e2fde219b8 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 200 len: 1260 microversion: 2.1 time: 0.150991 Sep 21 17:04:40.968360 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 890/1701] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:04:40 2022] GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:04:41.989660 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-51bfb5d6-d067-4f62-9498-8c0bece91237 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:04:41.990296 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-51bfb5d6-d067-4f62-9498-8c0bece91237 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:04:41.996687 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-51bfb5d6-d067-4f62-9498-8c0bece91237 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:04:41.997168 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-51bfb5d6-d067-4f62-9498-8c0bece91237 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:04:41.997621 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-51bfb5d6-d067-4f62-9498-8c0bece91237 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:04:41.998426 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-51bfb5d6-d067-4f62-9498-8c0bece91237 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:04:41.998875 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-51bfb5d6-d067-4f62-9498-8c0bece91237 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:04:41.999297 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-51bfb5d6-d067-4f62-9498-8c0bece91237 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:04:42.132873 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-51bfb5d6-d067-4f62-9498-8c0bece91237 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4d5e6077b642c4bc9bc3be27c15092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d9fbc339f64ce8b323195b51b06390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:04:42.140949 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-51bfb5d6-d067-4f62-9498-8c0bece91237 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 200 len: 1260 microversion: 2.1 time: 0.155114 Sep 21 17:04:42.141514 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 812/1702] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:04:41 2022] GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:04:43.163890 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-088a4a9e-6059-4c84-92af-7acf3ed47f2d tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:04:43.164510 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-088a4a9e-6059-4c84-92af-7acf3ed47f2d tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:04:43.166896 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell0:SELECT=2 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 17:04:43.173498 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-088a4a9e-6059-4c84-92af-7acf3ed47f2d tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:04:43.173984 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-088a4a9e-6059-4c84-92af-7acf3ed47f2d tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:04:43.174447 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-088a4a9e-6059-4c84-92af-7acf3ed47f2d tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:04:43.175143 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-088a4a9e-6059-4c84-92af-7acf3ed47f2d tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:04:43.175601 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-088a4a9e-6059-4c84-92af-7acf3ed47f2d tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:04:43.176030 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-088a4a9e-6059-4c84-92af-7acf3ed47f2d tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:04:43.307108 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-088a4a9e-6059-4c84-92af-7acf3ed47f2d tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4d5e6077b642c4bc9bc3be27c15092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d9fbc339f64ce8b323195b51b06390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:04:43.314794 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-088a4a9e-6059-4c84-92af-7acf3ed47f2d tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 200 len: 1260 microversion: 2.1 time: 0.154805 Sep 21 17:04:43.315368 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 891/1703] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:04:43 2022] GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:04:44.337309 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-53371093-a9bc-42be-8818-264e9f7c4599 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:04:44.337924 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-53371093-a9bc-42be-8818-264e9f7c4599 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:04:44.339927 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell0:SELECT=2 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 17:04:44.340706 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell0:SELECT=6 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 17:04:44.348735 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-53371093-a9bc-42be-8818-264e9f7c4599 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:04:44.349221 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-53371093-a9bc-42be-8818-264e9f7c4599 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:04:44.349660 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-53371093-a9bc-42be-8818-264e9f7c4599 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:04:44.350387 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-53371093-a9bc-42be-8818-264e9f7c4599 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:04:44.350844 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-53371093-a9bc-42be-8818-264e9f7c4599 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:04:44.351269 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-53371093-a9bc-42be-8818-264e9f7c4599 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:04:44.479676 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-53371093-a9bc-42be-8818-264e9f7c4599 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4d5e6077b642c4bc9bc3be27c15092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d9fbc339f64ce8b323195b51b06390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:04:44.487915 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-53371093-a9bc-42be-8818-264e9f7c4599 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 200 len: 1260 microversion: 2.1 time: 0.154684 Sep 21 17:04:44.488484 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 813/1704] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:04:44 2022] GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:04:45.510937 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-bdf07453-7aca-4467-8055-41c2b462a15a tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:04:45.511654 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-bdf07453-7aca-4467-8055-41c2b462a15a tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:04:45.518156 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bdf07453-7aca-4467-8055-41c2b462a15a tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:04:45.518669 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bdf07453-7aca-4467-8055-41c2b462a15a tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:04:45.519121 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bdf07453-7aca-4467-8055-41c2b462a15a tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:04:45.519809 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bdf07453-7aca-4467-8055-41c2b462a15a tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:04:45.520261 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bdf07453-7aca-4467-8055-41c2b462a15a tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:04:45.520691 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-bdf07453-7aca-4467-8055-41c2b462a15a tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:04:45.649551 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-bdf07453-7aca-4467-8055-41c2b462a15a tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4d5e6077b642c4bc9bc3be27c15092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d9fbc339f64ce8b323195b51b06390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:04:45.657442 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-bdf07453-7aca-4467-8055-41c2b462a15a tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 200 len: 1260 microversion: 2.1 time: 0.150328 Sep 21 17:04:45.658030 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 892/1705] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:04:45 2022] GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:04:45.790186 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-8a1f9c45-e66c-407a-b19d-b90ea430d38e req-62da76d7-58af-4392-a3ff-00573e450491 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "529464ed-acbf-4d35-9220-6b24020f7759", "name": "network-vif-plugged", "status": "completed", "tag": "4cd60a85-15f3-4979-8308-721d8f2ba69d"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 17:04:45.800997 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-8a1f9c45-e66c-407a-b19d-b90ea430d38e req-62da76d7-58af-4392-a3ff-00573e450491 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:04:45.801477 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-8a1f9c45-e66c-407a-b19d-b90ea430d38e req-62da76d7-58af-4392-a3ff-00573e450491 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:04:45.801910 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-8a1f9c45-e66c-407a-b19d-b90ea430d38e req-62da76d7-58af-4392-a3ff-00573e450491 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:04:45.814343 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-8a1f9c45-e66c-407a-b19d-b90ea430d38e req-62da76d7-58af-4392-a3ff-00573e450491 service nova] Creating event network-vif-plugged:4cd60a85-15f3-4979-8308-721d8f2ba69d for instance 529464ed-acbf-4d35-9220-6b24020f7759 on hv-cinder-85862 Sep 21 17:04:45.819350 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-8a1f9c45-e66c-407a-b19d-b90ea430d38e req-62da76d7-58af-4392-a3ff-00573e450491 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032930 Sep 21 17:04:45.820061 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 814/1706] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 17:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 17:04:46.679887 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c5680cd3-4874-4601-a63e-737b991fde69 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:04:46.680495 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-c5680cd3-4874-4601-a63e-737b991fde69 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:04:46.687120 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c5680cd3-4874-4601-a63e-737b991fde69 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:04:46.687600 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c5680cd3-4874-4601-a63e-737b991fde69 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:04:46.688030 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c5680cd3-4874-4601-a63e-737b991fde69 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:04:46.688717 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c5680cd3-4874-4601-a63e-737b991fde69 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:04:46.689165 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c5680cd3-4874-4601-a63e-737b991fde69 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:04:46.689581 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c5680cd3-4874-4601-a63e-737b991fde69 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:04:46.819875 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-c5680cd3-4874-4601-a63e-737b991fde69 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4d5e6077b642c4bc9bc3be27c15092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d9fbc339f64ce8b323195b51b06390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:04:46.828210 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-c5680cd3-4874-4601-a63e-737b991fde69 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 200 len: 1260 microversion: 2.1 time: 0.152270 Sep 21 17:04:46.828778 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 893/1707] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:04:46 2022] GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:04:47.852370 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-d01d0b92-7b05-4672-8ee1-612e5b32a4c4 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:04:47.853023 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-d01d0b92-7b05-4672-8ee1-612e5b32a4c4 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:04:47.859837 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d01d0b92-7b05-4672-8ee1-612e5b32a4c4 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:04:47.860313 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d01d0b92-7b05-4672-8ee1-612e5b32a4c4 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:04:47.860744 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d01d0b92-7b05-4672-8ee1-612e5b32a4c4 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:04:47.861433 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d01d0b92-7b05-4672-8ee1-612e5b32a4c4 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:04:47.861891 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d01d0b92-7b05-4672-8ee1-612e5b32a4c4 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:04:47.862338 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-d01d0b92-7b05-4672-8ee1-612e5b32a4c4 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:04:47.992420 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-d01d0b92-7b05-4672-8ee1-612e5b32a4c4 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4d5e6077b642c4bc9bc3be27c15092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d9fbc339f64ce8b323195b51b06390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:04:48.000074 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-d01d0b92-7b05-4672-8ee1-612e5b32a4c4 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 200 len: 1444 microversion: 2.1 time: 0.152451 Sep 21 17:04:48.000643 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 815/1708] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:04:47 2022] GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 1444 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:04:48.021647 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-81d19863-4229-4736-8a66-120cd5cae5d1 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:04:48.022287 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-81d19863-4229-4736-8a66-120cd5cae5d1 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:04:48.028614 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-81d19863-4229-4736-8a66-120cd5cae5d1 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:04:48.029098 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-81d19863-4229-4736-8a66-120cd5cae5d1 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:04:48.030065 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-81d19863-4229-4736-8a66-120cd5cae5d1 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:04:48.030793 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-81d19863-4229-4736-8a66-120cd5cae5d1 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:04:48.031246 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-81d19863-4229-4736-8a66-120cd5cae5d1 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:04:48.031666 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-81d19863-4229-4736-8a66-120cd5cae5d1 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:04:48.160610 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-81d19863-4229-4736-8a66-120cd5cae5d1 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4d5e6077b642c4bc9bc3be27c15092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d9fbc339f64ce8b323195b51b06390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:04:48.168251 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-81d19863-4229-4736-8a66-120cd5cae5d1 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 200 len: 1444 microversion: 2.1 time: 0.150425 Sep 21 17:04:48.168831 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 894/1709] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:04:48 2022] GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 1444 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:04:49.837872 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-1b377806-797c-47d1-af68-4e7447364d7d req-56a5270a-ae6d-43a8-97c2-4daffd95cf4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "529464ed-acbf-4d35-9220-6b24020f7759", "tag": "4cd60a85-15f3-4979-8308-721d8f2ba69d"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 17:04:49.847615 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-1b377806-797c-47d1-af68-4e7447364d7d req-56a5270a-ae6d-43a8-97c2-4daffd95cf4a service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:04:49.848173 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-1b377806-797c-47d1-af68-4e7447364d7d req-56a5270a-ae6d-43a8-97c2-4daffd95cf4a service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:04:49.848707 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-1b377806-797c-47d1-af68-4e7447364d7d req-56a5270a-ae6d-43a8-97c2-4daffd95cf4a service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:04:49.860262 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-1b377806-797c-47d1-af68-4e7447364d7d req-56a5270a-ae6d-43a8-97c2-4daffd95cf4a service nova] Creating event network-changed:4cd60a85-15f3-4979-8308-721d8f2ba69d for instance 529464ed-acbf-4d35-9220-6b24020f7759 on hv-cinder-85862 Sep 21 17:04:49.865154 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-1b377806-797c-47d1-af68-4e7447364d7d req-56a5270a-ae6d-43a8-97c2-4daffd95cf4a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092750 Sep 21 17:04:49.865653 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 816/1710] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 17:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 17:06:43.934956 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-d651653c-7376-4f36-a0f5-e57950ef6c8d tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 17:06:43.935487 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-d651653c-7376-4f36-a0f5-e57950ef6c8d tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:06:43.937734 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_api:SELECT=20 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 17:06:43.938601 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=48 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 17:06:43.939308 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 21 17:06:43.939518 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Wed Sep 21 17:06:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759/action (ip 10.222.0.64) !!! Sep 21 17:06:43.940799 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 21 17:06:43.940906 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Wed Sep 21 17:06:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759/action (ip 10.222.0.64) !!! Sep 21 17:06:43.942260 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 21 17:06:43.953208 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d651653c-7376-4f36-a0f5-e57950ef6c8d tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:06:43.953693 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d651653c-7376-4f36-a0f5-e57950ef6c8d tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:06:43.954156 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d651653c-7376-4f36-a0f5-e57950ef6c8d tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:06:43.955040 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d651653c-7376-4f36-a0f5-e57950ef6c8d tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:06:43.955497 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d651653c-7376-4f36-a0f5-e57950ef6c8d tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:06:43.955918 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-d651653c-7376-4f36-a0f5-e57950ef6c8d tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:06:43.979636 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.objects.instance [None req-d651653c-7376-4f36-a0f5-e57950ef6c8d tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lazy-loading 'flavor' on Instance uuid 529464ed-acbf-4d35-9220-6b24020f7759 {{(pid=120532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 17:06:44.054513 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-d651653c-7376-4f36-a0f5-e57950ef6c8d tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "POST /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759/action" status: 202 len: 0 microversion: 2.1 time: 0.123892 Sep 21 17:06:44.058186 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 895/1711] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Sep 21 17:06:43 2022] POST /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 17:06:44.062453 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: ERROR oslo.messaging._drivers.impl_rabbit [-] [553ea9c1-57dc-451e-b10a-7e2f64159847] AMQP server on 10.222.0.64:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 21 17:06:44.063213 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 17:06:44.064552 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=44 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 17:06:44.066021 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 21 17:06:44.066021 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: Wed Sep 21 17:06:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 (ip 10.222.0.64) !!! Sep 21 17:06:44.074800 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-9f364e3a-0909-4a42-a7f3-1dcfbd8b2541 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:06:44.075468 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-9f364e3a-0909-4a42-a7f3-1dcfbd8b2541 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:06:44.082806 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9f364e3a-0909-4a42-a7f3-1dcfbd8b2541 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:06:44.083355 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9f364e3a-0909-4a42-a7f3-1dcfbd8b2541 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:06:44.083892 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9f364e3a-0909-4a42-a7f3-1dcfbd8b2541 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:06:44.084592 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9f364e3a-0909-4a42-a7f3-1dcfbd8b2541 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:06:44.085041 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9f364e3a-0909-4a42-a7f3-1dcfbd8b2541 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:06:44.085450 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-9f364e3a-0909-4a42-a7f3-1dcfbd8b2541 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:06:44.222860 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-9f364e3a-0909-4a42-a7f3-1dcfbd8b2541 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4d5e6077b642c4bc9bc3be27c15092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d9fbc339f64ce8b323195b51b06390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:06:44.230814 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-9f364e3a-0909-4a42-a7f3-1dcfbd8b2541 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 200 len: 1569 microversion: 2.1 time: 0.171010 Sep 21 17:06:44.231392 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 817/1712] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:06:44 2022] GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:06:45.327875 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-9fbc30af-69ee-4487-9742-7a27afad5b97 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:06:45.328578 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-9fbc30af-69ee-4487-9742-7a27afad5b97 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:06:45.334687 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9fbc30af-69ee-4487-9742-7a27afad5b97 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:06:45.335169 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9fbc30af-69ee-4487-9742-7a27afad5b97 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:06:45.335606 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9fbc30af-69ee-4487-9742-7a27afad5b97 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:06:45.336294 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9fbc30af-69ee-4487-9742-7a27afad5b97 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:06:45.337020 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9fbc30af-69ee-4487-9742-7a27afad5b97 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:06:45.337442 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-9fbc30af-69ee-4487-9742-7a27afad5b97 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:06:45.468958 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-9fbc30af-69ee-4487-9742-7a27afad5b97 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4d5e6077b642c4bc9bc3be27c15092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d9fbc339f64ce8b323195b51b06390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:06:45.477239 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-9fbc30af-69ee-4487-9742-7a27afad5b97 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 200 len: 1569 microversion: 2.1 time: 0.154242 Sep 21 17:06:45.477803 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 896/1713] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:06:45 2022] GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:06:46.500678 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-34e3f86e-4e2b-455d-b56c-5a1b479e2c9c tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:06:46.501285 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-34e3f86e-4e2b-455d-b56c-5a1b479e2c9c tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:06:46.510435 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-34e3f86e-4e2b-455d-b56c-5a1b479e2c9c tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:06:46.510917 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-34e3f86e-4e2b-455d-b56c-5a1b479e2c9c tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:06:46.511346 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-34e3f86e-4e2b-455d-b56c-5a1b479e2c9c tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:06:46.512039 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-34e3f86e-4e2b-455d-b56c-5a1b479e2c9c tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:06:46.512491 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-34e3f86e-4e2b-455d-b56c-5a1b479e2c9c tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:06:46.512905 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-34e3f86e-4e2b-455d-b56c-5a1b479e2c9c tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:06:46.518495 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO oslo.messaging._drivers.impl_rabbit [-] [553ea9c1-57dc-451e-b10a-7e2f64159847] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 40184. Sep 21 17:06:46.641031 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-34e3f86e-4e2b-455d-b56c-5a1b479e2c9c tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4d5e6077b642c4bc9bc3be27c15092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d9fbc339f64ce8b323195b51b06390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:06:46.648644 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-34e3f86e-4e2b-455d-b56c-5a1b479e2c9c tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 200 len: 1569 microversion: 2.1 time: 0.151875 Sep 21 17:06:46.649209 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 818/1714] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:06:46 2022] GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:06:47.671459 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-c1bb2c71-f98b-4747-85fb-851dc2711ee9 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:06:47.672080 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-c1bb2c71-f98b-4747-85fb-851dc2711ee9 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:06:47.678514 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c1bb2c71-f98b-4747-85fb-851dc2711ee9 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:06:47.678996 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c1bb2c71-f98b-4747-85fb-851dc2711ee9 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:06:47.679431 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c1bb2c71-f98b-4747-85fb-851dc2711ee9 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:06:47.680116 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c1bb2c71-f98b-4747-85fb-851dc2711ee9 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:06:47.680570 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c1bb2c71-f98b-4747-85fb-851dc2711ee9 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:06:47.680994 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-c1bb2c71-f98b-4747-85fb-851dc2711ee9 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:06:47.811446 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-c1bb2c71-f98b-4747-85fb-851dc2711ee9 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4d5e6077b642c4bc9bc3be27c15092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d9fbc339f64ce8b323195b51b06390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:06:47.819745 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-c1bb2c71-f98b-4747-85fb-851dc2711ee9 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 200 len: 1569 microversion: 2.1 time: 0.152158 Sep 21 17:06:47.820319 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 897/1715] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:06:47 2022] GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:06:48.844492 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-2d969cd5-f544-45d7-b118-ab085c809c09 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:06:48.845014 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-2d969cd5-f544-45d7-b118-ab085c809c09 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:06:48.852424 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2d969cd5-f544-45d7-b118-ab085c809c09 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:06:48.852906 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2d969cd5-f544-45d7-b118-ab085c809c09 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:06:48.853345 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2d969cd5-f544-45d7-b118-ab085c809c09 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:06:48.854057 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2d969cd5-f544-45d7-b118-ab085c809c09 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:06:48.854520 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2d969cd5-f544-45d7-b118-ab085c809c09 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:06:48.854943 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-2d969cd5-f544-45d7-b118-ab085c809c09 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:06:48.987226 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-2d969cd5-f544-45d7-b118-ab085c809c09 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4d5e6077b642c4bc9bc3be27c15092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d9fbc339f64ce8b323195b51b06390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:06:48.994846 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-2d969cd5-f544-45d7-b118-ab085c809c09 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 200 len: 1569 microversion: 2.1 time: 0.154325 Sep 21 17:06:48.995410 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 819/1716] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:06:48 2022] GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:06:50.018609 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-b6a06827-0479-4a5a-a290-a43ac1f3bab6 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:06:50.019224 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-b6a06827-0479-4a5a-a290-a43ac1f3bab6 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:06:50.025587 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b6a06827-0479-4a5a-a290-a43ac1f3bab6 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:06:50.026087 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b6a06827-0479-4a5a-a290-a43ac1f3bab6 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:06:50.026526 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b6a06827-0479-4a5a-a290-a43ac1f3bab6 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:06:50.027212 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b6a06827-0479-4a5a-a290-a43ac1f3bab6 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:06:50.027666 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b6a06827-0479-4a5a-a290-a43ac1f3bab6 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:06:50.028089 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b6a06827-0479-4a5a-a290-a43ac1f3bab6 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:06:50.158279 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-b6a06827-0479-4a5a-a290-a43ac1f3bab6 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4d5e6077b642c4bc9bc3be27c15092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d9fbc339f64ce8b323195b51b06390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:06:50.166517 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-b6a06827-0479-4a5a-a290-a43ac1f3bab6 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 200 len: 1569 microversion: 2.1 time: 0.151943 Sep 21 17:06:50.167093 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 898/1717] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:06:50 2022] GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:06:51.189782 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-11b6d8a5-e6f1-426e-b64e-e7b405c0e6a0 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:06:51.191045 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-11b6d8a5-e6f1-426e-b64e-e7b405c0e6a0 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:06:51.197577 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-11b6d8a5-e6f1-426e-b64e-e7b405c0e6a0 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:06:51.198095 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-11b6d8a5-e6f1-426e-b64e-e7b405c0e6a0 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:06:51.198537 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-11b6d8a5-e6f1-426e-b64e-e7b405c0e6a0 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:06:51.199238 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-11b6d8a5-e6f1-426e-b64e-e7b405c0e6a0 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:06:51.199695 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-11b6d8a5-e6f1-426e-b64e-e7b405c0e6a0 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:06:51.200122 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-11b6d8a5-e6f1-426e-b64e-e7b405c0e6a0 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:06:51.327132 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-11b6d8a5-e6f1-426e-b64e-e7b405c0e6a0 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4d5e6077b642c4bc9bc3be27c15092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d9fbc339f64ce8b323195b51b06390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:06:51.334927 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-11b6d8a5-e6f1-426e-b64e-e7b405c0e6a0 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 200 len: 1569 microversion: 2.1 time: 0.148956 Sep 21 17:06:51.335493 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 820/1718] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:06:51 2022] GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:06:52.358552 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-78d846a6-5df1-4a65-8425-21cd58244aee tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:06:52.359168 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-78d846a6-5df1-4a65-8425-21cd58244aee tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:06:52.366109 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-78d846a6-5df1-4a65-8425-21cd58244aee tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:06:52.366596 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-78d846a6-5df1-4a65-8425-21cd58244aee tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:06:52.367032 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-78d846a6-5df1-4a65-8425-21cd58244aee tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:06:52.367727 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-78d846a6-5df1-4a65-8425-21cd58244aee tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:06:52.368185 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-78d846a6-5df1-4a65-8425-21cd58244aee tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:06:52.368608 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-78d846a6-5df1-4a65-8425-21cd58244aee tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:06:52.507765 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-78d846a6-5df1-4a65-8425-21cd58244aee tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4d5e6077b642c4bc9bc3be27c15092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d9fbc339f64ce8b323195b51b06390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:06:52.515638 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-78d846a6-5df1-4a65-8425-21cd58244aee tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 200 len: 1569 microversion: 2.1 time: 0.160926 Sep 21 17:06:52.516213 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 899/1719] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:06:52 2022] GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:06:53.538536 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-1ab9993e-c9b4-4409-be2b-c2fdc14c2809 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:06:53.539142 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-1ab9993e-c9b4-4409-be2b-c2fdc14c2809 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:06:53.545423 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1ab9993e-c9b4-4409-be2b-c2fdc14c2809 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:06:53.545915 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1ab9993e-c9b4-4409-be2b-c2fdc14c2809 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:06:53.546382 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1ab9993e-c9b4-4409-be2b-c2fdc14c2809 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:06:53.547065 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1ab9993e-c9b4-4409-be2b-c2fdc14c2809 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:06:53.547513 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1ab9993e-c9b4-4409-be2b-c2fdc14c2809 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:06:53.547928 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1ab9993e-c9b4-4409-be2b-c2fdc14c2809 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:06:53.677214 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-1ab9993e-c9b4-4409-be2b-c2fdc14c2809 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4d5e6077b642c4bc9bc3be27c15092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d9fbc339f64ce8b323195b51b06390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:06:53.685136 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-1ab9993e-c9b4-4409-be2b-c2fdc14c2809 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 200 len: 1569 microversion: 2.1 time: 0.150424 Sep 21 17:06:53.685692 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 821/1720] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:06:53 2022] GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:06:54.709470 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-00abf1c6-8efc-4986-b058-7119a195ed08 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:06:54.710162 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-00abf1c6-8efc-4986-b058-7119a195ed08 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:06:54.717141 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-00abf1c6-8efc-4986-b058-7119a195ed08 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:06:54.717625 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-00abf1c6-8efc-4986-b058-7119a195ed08 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:06:54.718067 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-00abf1c6-8efc-4986-b058-7119a195ed08 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:06:54.718848 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-00abf1c6-8efc-4986-b058-7119a195ed08 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:06:54.719298 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-00abf1c6-8efc-4986-b058-7119a195ed08 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:06:54.719713 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-00abf1c6-8efc-4986-b058-7119a195ed08 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:06:54.854631 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-00abf1c6-8efc-4986-b058-7119a195ed08 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4d5e6077b642c4bc9bc3be27c15092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d9fbc339f64ce8b323195b51b06390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:06:54.863028 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-00abf1c6-8efc-4986-b058-7119a195ed08 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 200 len: 1569 microversion: 2.1 time: 0.158010 Sep 21 17:06:54.863605 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 900/1721] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:06:54 2022] GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 21 17:06:55.888061 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-b17f2a28-9992-4747-bc72-d97a27db7750 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:06:55.888652 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-b17f2a28-9992-4747-bc72-d97a27db7750 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:06:55.895235 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b17f2a28-9992-4747-bc72-d97a27db7750 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:06:55.895715 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b17f2a28-9992-4747-bc72-d97a27db7750 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:06:55.896140 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b17f2a28-9992-4747-bc72-d97a27db7750 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:06:55.896816 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b17f2a28-9992-4747-bc72-d97a27db7750 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:06:55.897261 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b17f2a28-9992-4747-bc72-d97a27db7750 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:06:55.897717 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-b17f2a28-9992-4747-bc72-d97a27db7750 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:06:56.024964 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-b17f2a28-9992-4747-bc72-d97a27db7750 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4d5e6077b642c4bc9bc3be27c15092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d9fbc339f64ce8b323195b51b06390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:06:56.032615 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-b17f2a28-9992-4747-bc72-d97a27db7750 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 200 len: 1569 microversion: 2.1 time: 0.148416 Sep 21 17:06:56.033174 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 822/1722] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:06:55 2022] GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:06:57.056346 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-00da2890-3b07-4300-9efe-a8e1fe8c4a6f tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:06:57.056864 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-00da2890-3b07-4300-9efe-a8e1fe8c4a6f tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:06:57.063199 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-00da2890-3b07-4300-9efe-a8e1fe8c4a6f tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:06:57.063704 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-00da2890-3b07-4300-9efe-a8e1fe8c4a6f tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:06:57.064136 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-00da2890-3b07-4300-9efe-a8e1fe8c4a6f tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:06:57.064829 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-00da2890-3b07-4300-9efe-a8e1fe8c4a6f tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:06:57.065877 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-00da2890-3b07-4300-9efe-a8e1fe8c4a6f tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:06:57.066331 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-00da2890-3b07-4300-9efe-a8e1fe8c4a6f tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:06:57.198640 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-00da2890-3b07-4300-9efe-a8e1fe8c4a6f tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4d5e6077b642c4bc9bc3be27c15092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d9fbc339f64ce8b323195b51b06390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:06:57.206607 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-00da2890-3b07-4300-9efe-a8e1fe8c4a6f tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 200 len: 1570 microversion: 2.1 time: 0.154189 Sep 21 17:06:57.207178 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 901/1723] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:06:57 2022] GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:06:57.229729 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-0c63b7b2-1fb0-4ac7-a190-88feb16d7a77 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 17:06:57.230384 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-0c63b7b2-1fb0-4ac7-a190-88feb16d7a77 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:06:57.236777 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0c63b7b2-1fb0-4ac7-a190-88feb16d7a77 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:06:57.237776 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0c63b7b2-1fb0-4ac7-a190-88feb16d7a77 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:06:57.238233 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0c63b7b2-1fb0-4ac7-a190-88feb16d7a77 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:06:57.238924 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0c63b7b2-1fb0-4ac7-a190-88feb16d7a77 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:06:57.239368 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0c63b7b2-1fb0-4ac7-a190-88feb16d7a77 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:06:57.239788 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-0c63b7b2-1fb0-4ac7-a190-88feb16d7a77 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:06:57.280178 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-0c63b7b2-1fb0-4ac7-a190-88feb16d7a77 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120531) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 21 17:06:57.344733 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-0c63b7b2-1fb0-4ac7-a190-88feb16d7a77 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "POST /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759/action" status: 202 len: 0 microversion: 2.1 time: 0.118802 Sep 21 17:06:57.345273 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 823/1724] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Sep 21 17:06:57 2022] POST /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 21 17:06:57.353853 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-43aabd13-f059-4758-8642-826381488274 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:06:57.354493 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-43aabd13-f059-4758-8642-826381488274 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:06:57.360353 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-43aabd13-f059-4758-8642-826381488274 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:06:57.360834 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-43aabd13-f059-4758-8642-826381488274 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:06:57.361271 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-43aabd13-f059-4758-8642-826381488274 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:06:57.362644 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-43aabd13-f059-4758-8642-826381488274 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:06:57.363053 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-43aabd13-f059-4758-8642-826381488274 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:06:57.363513 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-43aabd13-f059-4758-8642-826381488274 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:06:57.498981 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-43aabd13-f059-4758-8642-826381488274 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4d5e6077b642c4bc9bc3be27c15092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d9fbc339f64ce8b323195b51b06390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:06:57.507274 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-43aabd13-f059-4758-8642-826381488274 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 200 len: 1518 microversion: 2.1 time: 0.157202 Sep 21 17:06:57.508038 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 902/1725] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:06:57 2022] GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:06:58.531488 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-31456360-1964-4f51-8f56-cc9f6249dad0 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:06:58.532104 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-31456360-1964-4f51-8f56-cc9f6249dad0 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:06:58.538599 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-31456360-1964-4f51-8f56-cc9f6249dad0 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:06:58.539080 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-31456360-1964-4f51-8f56-cc9f6249dad0 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:06:58.539529 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-31456360-1964-4f51-8f56-cc9f6249dad0 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:06:58.540209 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-31456360-1964-4f51-8f56-cc9f6249dad0 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:06:58.540661 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-31456360-1964-4f51-8f56-cc9f6249dad0 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:06:58.541078 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-31456360-1964-4f51-8f56-cc9f6249dad0 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:06:58.669551 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-31456360-1964-4f51-8f56-cc9f6249dad0 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4d5e6077b642c4bc9bc3be27c15092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d9fbc339f64ce8b323195b51b06390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:06:58.677255 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-31456360-1964-4f51-8f56-cc9f6249dad0 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 200 len: 1576 microversion: 2.1 time: 0.150213 Sep 21 17:06:58.677834 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 824/1726] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:06:58 2022] GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:06:59.700524 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ffe09a28-5904-4da1-9eff-a89aafbfe1ff tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:06:59.701157 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ffe09a28-5904-4da1-9eff-a89aafbfe1ff tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:06:59.708176 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ffe09a28-5904-4da1-9eff-a89aafbfe1ff tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:06:59.708650 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ffe09a28-5904-4da1-9eff-a89aafbfe1ff tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:06:59.709081 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ffe09a28-5904-4da1-9eff-a89aafbfe1ff tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:06:59.709765 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ffe09a28-5904-4da1-9eff-a89aafbfe1ff tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:06:59.710250 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ffe09a28-5904-4da1-9eff-a89aafbfe1ff tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:06:59.710669 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ffe09a28-5904-4da1-9eff-a89aafbfe1ff tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:06:59.838437 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-ffe09a28-5904-4da1-9eff-a89aafbfe1ff tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4d5e6077b642c4bc9bc3be27c15092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d9fbc339f64ce8b323195b51b06390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:06:59.846143 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ffe09a28-5904-4da1-9eff-a89aafbfe1ff tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 200 len: 1576 microversion: 2.1 time: 0.149441 Sep 21 17:06:59.846706 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 903/1727] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:06:59 2022] GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:07:00.321821 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [req-8b81a140-0158-460c-90fa-1b5a983074f0 req-649d56e1-4f9d-4e79-99d5-54484a4beaae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "529464ed-acbf-4d35-9220-6b24020f7759", "name": "network-vif-unplugged", "status": "completed", "tag": "4cd60a85-15f3-4979-8308-721d8f2ba69d"}]} {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 17:07:00.333233 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-8b81a140-0158-460c-90fa-1b5a983074f0 req-649d56e1-4f9d-4e79-99d5-54484a4beaae service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:07:00.333711 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-8b81a140-0158-460c-90fa-1b5a983074f0 req-649d56e1-4f9d-4e79-99d5-54484a4beaae service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:07:00.334167 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [req-8b81a140-0158-460c-90fa-1b5a983074f0 req-649d56e1-4f9d-4e79-99d5-54484a4beaae service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:07:00.347023 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.compute.server_external_events [req-8b81a140-0158-460c-90fa-1b5a983074f0 req-649d56e1-4f9d-4e79-99d5-54484a4beaae service nova] Creating event network-vif-unplugged:4cd60a85-15f3-4979-8308-721d8f2ba69d for instance 529464ed-acbf-4d35-9220-6b24020f7759 on hv-cinder-85862 Sep 21 17:07:00.352173 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [req-8b81a140-0158-460c-90fa-1b5a983074f0 req-649d56e1-4f9d-4e79-99d5-54484a4beaae service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034147 Sep 21 17:07:00.353040 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 825/1728] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 17:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 17:07:00.870186 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-7262134d-17ce-4469-a67e-fde37ea22fbe tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:07:00.870720 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-7262134d-17ce-4469-a67e-fde37ea22fbe tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:07:00.877128 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7262134d-17ce-4469-a67e-fde37ea22fbe tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:07:00.877816 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7262134d-17ce-4469-a67e-fde37ea22fbe tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:07:00.878279 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7262134d-17ce-4469-a67e-fde37ea22fbe tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:07:00.878984 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7262134d-17ce-4469-a67e-fde37ea22fbe tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:07:00.879464 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7262134d-17ce-4469-a67e-fde37ea22fbe tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:07:00.880108 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-7262134d-17ce-4469-a67e-fde37ea22fbe tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:07:01.013335 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-7262134d-17ce-4469-a67e-fde37ea22fbe tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4d5e6077b642c4bc9bc3be27c15092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d9fbc339f64ce8b323195b51b06390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:07:01.021655 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-7262134d-17ce-4469-a67e-fde37ea22fbe tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 200 len: 1576 microversion: 2.1 time: 0.155485 Sep 21 17:07:01.022236 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 904/1729] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:07:00 2022] GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:07:02.045127 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-ecb9b17a-efb9-45a2-99aa-cf97fb581244 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:07:02.045827 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-ecb9b17a-efb9-45a2-99aa-cf97fb581244 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:07:02.053037 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ecb9b17a-efb9-45a2-99aa-cf97fb581244 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:07:02.053514 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ecb9b17a-efb9-45a2-99aa-cf97fb581244 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:07:02.053943 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ecb9b17a-efb9-45a2-99aa-cf97fb581244 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:07:02.054653 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ecb9b17a-efb9-45a2-99aa-cf97fb581244 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:07:02.055107 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ecb9b17a-efb9-45a2-99aa-cf97fb581244 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:07:02.055535 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ecb9b17a-efb9-45a2-99aa-cf97fb581244 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:07:02.192944 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-ecb9b17a-efb9-45a2-99aa-cf97fb581244 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4d5e6077b642c4bc9bc3be27c15092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d9fbc339f64ce8b323195b51b06390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:07:02.200520 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-ecb9b17a-efb9-45a2-99aa-cf97fb581244 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 200 len: 1576 microversion: 2.1 time: 0.159544 Sep 21 17:07:02.201085 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 826/1730] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:07:02 2022] GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:07:03.224791 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-b7f612ce-23eb-4e7c-8852-213f98b538de tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:07:03.225399 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-b7f612ce-23eb-4e7c-8852-213f98b538de tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:07:03.232879 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b7f612ce-23eb-4e7c-8852-213f98b538de tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:07:03.233365 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b7f612ce-23eb-4e7c-8852-213f98b538de tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:07:03.233796 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b7f612ce-23eb-4e7c-8852-213f98b538de tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:07:03.234519 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b7f612ce-23eb-4e7c-8852-213f98b538de tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:07:03.234971 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b7f612ce-23eb-4e7c-8852-213f98b538de tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:07:03.235389 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-b7f612ce-23eb-4e7c-8852-213f98b538de tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:07:03.363311 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-b7f612ce-23eb-4e7c-8852-213f98b538de tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4d5e6077b642c4bc9bc3be27c15092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d9fbc339f64ce8b323195b51b06390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:07:03.371730 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-b7f612ce-23eb-4e7c-8852-213f98b538de tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 200 len: 1576 microversion: 2.1 time: 0.151361 Sep 21 17:07:03.372299 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 905/1731] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:07:03 2022] GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:07:04.394931 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-ae384e8f-9734-4a92-b07e-8bc33c29f349 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:07:04.395499 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-ae384e8f-9734-4a92-b07e-8bc33c29f349 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:07:04.401930 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ae384e8f-9734-4a92-b07e-8bc33c29f349 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:07:04.402442 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ae384e8f-9734-4a92-b07e-8bc33c29f349 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:07:04.402875 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ae384e8f-9734-4a92-b07e-8bc33c29f349 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:07:04.403565 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ae384e8f-9734-4a92-b07e-8bc33c29f349 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:07:04.404018 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ae384e8f-9734-4a92-b07e-8bc33c29f349 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:07:04.404436 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-ae384e8f-9734-4a92-b07e-8bc33c29f349 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:07:04.532539 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-ae384e8f-9734-4a92-b07e-8bc33c29f349 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4d5e6077b642c4bc9bc3be27c15092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d9fbc339f64ce8b323195b51b06390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:07:04.540252 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-ae384e8f-9734-4a92-b07e-8bc33c29f349 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 200 len: 1576 microversion: 2.1 time: 0.149357 Sep 21 17:07:04.540819 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 827/1732] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:07:04 2022] GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:07:05.563789 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-6cad8034-6dcc-4a73-bd80-e1062e24c60d tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:07:05.564430 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-6cad8034-6dcc-4a73-bd80-e1062e24c60d tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:07:05.571346 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6cad8034-6dcc-4a73-bd80-e1062e24c60d tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:07:05.571830 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6cad8034-6dcc-4a73-bd80-e1062e24c60d tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:07:05.572264 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6cad8034-6dcc-4a73-bd80-e1062e24c60d tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:07:05.572952 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6cad8034-6dcc-4a73-bd80-e1062e24c60d tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:07:05.573407 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6cad8034-6dcc-4a73-bd80-e1062e24c60d tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:07:05.573827 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-6cad8034-6dcc-4a73-bd80-e1062e24c60d tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:07:05.700145 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-6cad8034-6dcc-4a73-bd80-e1062e24c60d tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4d5e6077b642c4bc9bc3be27c15092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d9fbc339f64ce8b323195b51b06390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:07:05.709059 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-6cad8034-6dcc-4a73-bd80-e1062e24c60d tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 200 len: 1576 microversion: 2.1 time: 0.149125 Sep 21 17:07:05.709638 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 906/1733] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:07:05 2022] GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:07:06.732482 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-1b9a1ded-e203-41e0-b17e-d0f74b059f72 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:07:06.733089 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-1b9a1ded-e203-41e0-b17e-d0f74b059f72 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:07:06.739614 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1b9a1ded-e203-41e0-b17e-d0f74b059f72 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:07:06.740089 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1b9a1ded-e203-41e0-b17e-d0f74b059f72 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:07:06.740515 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1b9a1ded-e203-41e0-b17e-d0f74b059f72 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:07:06.741194 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1b9a1ded-e203-41e0-b17e-d0f74b059f72 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:07:06.741662 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1b9a1ded-e203-41e0-b17e-d0f74b059f72 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:07:06.742101 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-1b9a1ded-e203-41e0-b17e-d0f74b059f72 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:07:06.874443 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-1b9a1ded-e203-41e0-b17e-d0f74b059f72 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4d5e6077b642c4bc9bc3be27c15092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d9fbc339f64ce8b323195b51b06390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:07:06.882220 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-1b9a1ded-e203-41e0-b17e-d0f74b059f72 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 200 len: 1563 microversion: 2.1 time: 0.153611 Sep 21 17:07:06.882727 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 828/1734] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:07:06 2022] GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:07:08.372940 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-e12914bf-df7a-4f0a-8f3f-9b6076f5ee82 req-7228b505-803f-4a6c-a144-6a1294dd5945 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "529464ed-acbf-4d35-9220-6b24020f7759", "name": "network-vif-plugged", "status": "completed", "tag": "4cd60a85-15f3-4979-8308-721d8f2ba69d"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 17:07:08.383606 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-e12914bf-df7a-4f0a-8f3f-9b6076f5ee82 req-7228b505-803f-4a6c-a144-6a1294dd5945 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:07:08.384105 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-e12914bf-df7a-4f0a-8f3f-9b6076f5ee82 req-7228b505-803f-4a6c-a144-6a1294dd5945 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:07:08.384522 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-e12914bf-df7a-4f0a-8f3f-9b6076f5ee82 req-7228b505-803f-4a6c-a144-6a1294dd5945 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:07:08.396168 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-e12914bf-df7a-4f0a-8f3f-9b6076f5ee82 req-7228b505-803f-4a6c-a144-6a1294dd5945 service nova] Creating event network-vif-plugged:4cd60a85-15f3-4979-8308-721d8f2ba69d for instance 529464ed-acbf-4d35-9220-6b24020f7759 on hv-cinder-85862 Sep 21 17:07:08.401296 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-e12914bf-df7a-4f0a-8f3f-9b6076f5ee82 req-7228b505-803f-4a6c-a144-6a1294dd5945 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032021 Sep 21 17:07:08.401934 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 907/1735] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 17:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 17:08:23.544776 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 17:08:23.546680 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG dbcounter [-] [120531] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 17:08:23.547115 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_api:SELECT=26 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 17:08:23.548520 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG dbcounter [-] [120532] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 17:08:23.552260 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-f75dde79-81d6-4cd0-ac34-d10624a07cd9 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:08:23.552983 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-f75dde79-81d6-4cd0-ac34-d10624a07cd9 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:08:23.560959 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f75dde79-81d6-4cd0-ac34-d10624a07cd9 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:08:23.561762 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f75dde79-81d6-4cd0-ac34-d10624a07cd9 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:08:23.562446 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f75dde79-81d6-4cd0-ac34-d10624a07cd9 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:08:23.563379 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f75dde79-81d6-4cd0-ac34-d10624a07cd9 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:08:23.564116 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f75dde79-81d6-4cd0-ac34-d10624a07cd9 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:08:23.564883 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-f75dde79-81d6-4cd0-ac34-d10624a07cd9 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:08:23.595818 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-f75dde79-81d6-4cd0-ac34-d10624a07cd9 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Going to try to terminate instance {{(pid=120531) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 21 17:08:23.617242 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-45f7cba5-d5ab-452b-88a3-47c4e6210927 req-0e448669-53d0-44ec-8f0a-60b6fcce7993 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "529464ed-acbf-4d35-9220-6b24020f7759", "tag": "4cd60a85-15f3-4979-8308-721d8f2ba69d"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 17:08:23.627016 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-45f7cba5-d5ab-452b-88a3-47c4e6210927 req-0e448669-53d0-44ec-8f0a-60b6fcce7993 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:08:23.627501 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-45f7cba5-d5ab-452b-88a3-47c4e6210927 req-0e448669-53d0-44ec-8f0a-60b6fcce7993 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:08:23.627937 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-45f7cba5-d5ab-452b-88a3-47c4e6210927 req-0e448669-53d0-44ec-8f0a-60b6fcce7993 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:08:23.641764 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-45f7cba5-d5ab-452b-88a3-47c4e6210927 req-0e448669-53d0-44ec-8f0a-60b6fcce7993 service nova] Creating event network-changed:4cd60a85-15f3-4979-8308-721d8f2ba69d for instance 529464ed-acbf-4d35-9220-6b24020f7759 on hv-cinder-85862 Sep 21 17:08:23.647356 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-45f7cba5-d5ab-452b-88a3-47c4e6210927 req-0e448669-53d0-44ec-8f0a-60b6fcce7993 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102476 Sep 21 17:08:23.648857 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 908/1736] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 17:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 21 17:08:23.683681 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-f75dde79-81d6-4cd0-ac34-d10624a07cd9 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "DELETE /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 204 len: 0 microversion: 2.1 time: 0.141271 Sep 21 17:08:23.687579 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 829/1737] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Sep 21 17:08:23 2022] DELETE /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 21 17:08:23.693390 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-394b60cf-6161-4abb-8c1f-136f0e0738e0 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:08:23.694173 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-394b60cf-6161-4abb-8c1f-136f0e0738e0 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:08:23.701017 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-394b60cf-6161-4abb-8c1f-136f0e0738e0 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:08:23.701557 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-394b60cf-6161-4abb-8c1f-136f0e0738e0 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:08:23.701997 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-394b60cf-6161-4abb-8c1f-136f0e0738e0 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:08:23.702740 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-394b60cf-6161-4abb-8c1f-136f0e0738e0 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:08:23.703192 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-394b60cf-6161-4abb-8c1f-136f0e0738e0 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:08:23.703667 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-394b60cf-6161-4abb-8c1f-136f0e0738e0 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:08:23.897113 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.policy [None req-394b60cf-6161-4abb-8c1f-136f0e0738e0 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4d5e6077b642c4bc9bc3be27c15092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d9fbc339f64ce8b323195b51b06390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:08:23.905147 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-394b60cf-6161-4abb-8c1f-136f0e0738e0 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 200 len: 1569 microversion: 2.1 time: 0.215970 Sep 21 17:08:23.905744 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 909/1738] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:08:23 2022] GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 1569 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:08:24.930368 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-bbe0a70b-2d7f-417b-9982-bd0c04bf8742 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:08:24.931081 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-bbe0a70b-2d7f-417b-9982-bd0c04bf8742 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:08:24.938239 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bbe0a70b-2d7f-417b-9982-bd0c04bf8742 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:08:24.939355 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bbe0a70b-2d7f-417b-9982-bd0c04bf8742 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:08:24.939865 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bbe0a70b-2d7f-417b-9982-bd0c04bf8742 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:08:24.940567 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bbe0a70b-2d7f-417b-9982-bd0c04bf8742 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:08:24.941054 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bbe0a70b-2d7f-417b-9982-bd0c04bf8742 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:08:24.941479 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-bbe0a70b-2d7f-417b-9982-bd0c04bf8742 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:08:25.136601 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-bbe0a70b-2d7f-417b-9982-bd0c04bf8742 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4d5e6077b642c4bc9bc3be27c15092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d9fbc339f64ce8b323195b51b06390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:08:25.144983 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-bbe0a70b-2d7f-417b-9982-bd0c04bf8742 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 200 len: 1569 microversion: 2.1 time: 0.218863 Sep 21 17:08:25.145554 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 830/1739] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:08:24 2022] GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 1569 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:08:25.714761 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [req-6d03fe67-9baf-4b52-bb02-f6dba6eeb17c req-51170d28-268e-486b-bf7b-13c5f98a3664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "529464ed-acbf-4d35-9220-6b24020f7759", "name": "network-vif-deleted", "tag": "4cd60a85-15f3-4979-8308-721d8f2ba69d"}]} {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 21 17:08:25.725836 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-6d03fe67-9baf-4b52-bb02-f6dba6eeb17c req-51170d28-268e-486b-bf7b-13c5f98a3664 service nova] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:08:25.726339 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-6d03fe67-9baf-4b52-bb02-f6dba6eeb17c req-51170d28-268e-486b-bf7b-13c5f98a3664 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:08:25.726772 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [req-6d03fe67-9baf-4b52-bb02-f6dba6eeb17c req-51170d28-268e-486b-bf7b-13c5f98a3664 service nova] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:08:25.738875 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.compute.server_external_events [req-6d03fe67-9baf-4b52-bb02-f6dba6eeb17c req-51170d28-268e-486b-bf7b-13c5f98a3664 service nova] Creating event network-vif-deleted:4cd60a85-15f3-4979-8308-721d8f2ba69d for instance 529464ed-acbf-4d35-9220-6b24020f7759 on hv-cinder-85862 Sep 21 17:08:25.743864 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [req-6d03fe67-9baf-4b52-bb02-f6dba6eeb17c req-51170d28-268e-486b-bf7b-13c5f98a3664 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033223 Sep 21 17:08:25.746430 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 910/1740] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Sep 21 17:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 21 17:08:26.167732 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-6031313d-7574-45c2-a144-f3c501f4723b tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:08:26.168339 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.compute.api [None req-6031313d-7574-45c2-a144-f3c501f4723b tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:08:26.175207 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6031313d-7574-45c2-a144-f3c501f4723b tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:08:26.175686 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6031313d-7574-45c2-a144-f3c501f4723b tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:08:26.176110 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6031313d-7574-45c2-a144-f3c501f4723b tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:08:26.176794 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6031313d-7574-45c2-a144-f3c501f4723b tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:08:26.177240 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6031313d-7574-45c2-a144-f3c501f4723b tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:08:26.177653 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6031313d-7574-45c2-a144-f3c501f4723b tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:08:26.209246 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6031313d-7574-45c2-a144-f3c501f4723b tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:08:26.209727 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6031313d-7574-45c2-a144-f3c501f4723b tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:08:26.210303 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG oslo_concurrency.lockutils [None req-6031313d-7574-45c2-a144-f3c501f4723b tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:08:26.210686 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.objects.instance [None req-6031313d-7574-45c2-a144-f3c501f4723b tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lazy-loading 'fault' on Instance uuid 529464ed-acbf-4d35-9220-6b24020f7759 {{(pid=120531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 21 17:08:26.253854 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.policy [None req-6031313d-7574-45c2-a144-f3c501f4723b tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4d5e6077b642c4bc9bc3be27c15092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d9fbc339f64ce8b323195b51b06390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 21 17:08:26.261997 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-6031313d-7574-45c2-a144-f3c501f4723b tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 200 len: 1224 microversion: 2.1 time: 0.097447 Sep 21 17:08:26.261997 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 831/1741] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:08:26 2022] GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 21 17:08:27.287866 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ad452e11-1858-4877-9e52-8aeaf3a7d622 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '>' {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:08:27.288564 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.compute.api [None req-ad452e11-1858-4877-9e52-8aeaf3a7d622 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] [instance: 529464ed-acbf-4d35-9220-6b24020f7759] Fetching instance by UUID {{(pid=120532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 21 17:08:27.294685 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ad452e11-1858-4877-9e52-8aeaf3a7d622 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:08:27.295170 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ad452e11-1858-4877-9e52-8aeaf3a7d622 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:08:27.295604 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ad452e11-1858-4877-9e52-8aeaf3a7d622 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:08:27.296292 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ad452e11-1858-4877-9e52-8aeaf3a7d622 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Acquiring lock "02bd0416-446f-49db-ab6e-c32e12984242" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 21 17:08:27.296746 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ad452e11-1858-4877-9e52-8aeaf3a7d622 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 21 17:08:27.297170 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG oslo_concurrency.lockutils [None req-ad452e11-1858-4877-9e52-8aeaf3a7d622 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Lock "02bd0416-446f-49db-ab6e-c32e12984242" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 21 17:08:27.310074 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.wsgi [None req-ad452e11-1858-4877-9e52-8aeaf3a7d622 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] HTTP exception thrown: Instance 529464ed-acbf-4d35-9220-6b24020f7759 could not be found. Sep 21 17:08:27.311662 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ad452e11-1858-4877-9e52-8aeaf3a7d622 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Request method failure captured: Sep 21 17:08:27.311662 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: request: GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 HTTP/1.1 Sep 21 17:08:27.311662 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept: application/json Sep 21 17:08:27.311662 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Accept-Encoding: identity Sep 21 17:08:27.311662 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Connection: close Sep 21 17:08:27.311662 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Length: 0 Sep 21 17:08:27.311662 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Content-Type: application/json Sep 21 17:08:27.311662 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Host: 10.222.0.64 Sep 21 17:08:27.311662 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: Openstack-System-Scope: None Sep 21 17:08:27.311662 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: User-Agent: python-urllib3/1.26.12 Sep 21 17:08:27.311662 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Auth-Token: gAAAAABjK0QKE94J3fV3by1VXovzdfZgBTDS2VySyisGYKWjN9r-cQS5NIPtrwV4N5VbI0_qEjYgJwkjtFL_sXo7YbN0bYbPewTJTVJ-VP6OdTiiFvyjuzSJZolnwbqptpMljpIpowvt02_njXUVJSqSjVbwnzlZJblRpiYbmRT-rn3TgezWyvI Sep 21 17:08:27.311662 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Id: None Sep 21 17:08:27.311662 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Domain-Name: None Sep 21 17:08:27.311662 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Identity-Status: Confirmed Sep 21 17:08:27.311662 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Is-Admin-Project: True Sep 21 17:08:27.311662 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Id: default Sep 21 17:08:27.311662 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Domain-Name: Default Sep 21 17:08:27.311662 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Id: 67d9fbc339f64ce8b323195b51b06390 Sep 21 17:08:27.311662 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Project-Name: tempest-TestShelveInstance-2067530476 Sep 21 17:08:27.311662 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Role: member,reader Sep 21 17:08:27.311662 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Roles: member,reader Sep 21 17:08:27.313669 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/67d9fbc339f64ce8b323195b51b06390"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/67d9fbc339f64ce8b323195b51b06390"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_67d9fbc339f64ce8b323195b51b06390"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/67d9fbc339f64ce8b323195b51b06390"}]}] Sep 21 17:08:27.313669 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant: tempest-TestShelveInstance-2067530476 Sep 21 17:08:27.313669 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Id: 67d9fbc339f64ce8b323195b51b06390 Sep 21 17:08:27.313669 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-Tenant-Name: tempest-TestShelveInstance-2067530476 Sep 21 17:08:27.313669 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User: tempest-TestShelveInstance-2067530476-project Sep 21 17:08:27.313669 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Id: default Sep 21 17:08:27.313669 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Domain-Name: Default Sep 21 17:08:27.313669 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Id: 2a4d5e6077b642c4bc9bc3be27c15092 Sep 21 17:08:27.313669 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: X-User-Name: tempest-TestShelveInstance-2067530476-project Sep 21 17:08:27.313669 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: method: > Sep 21 17:08:27.313669 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: exception: Instance 529464ed-acbf-4d35-9220-6b24020f7759 could not be found. Sep 21 17:08:27.313669 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: action_args: {'id': '529464ed-acbf-4d35-9220-6b24020f7759'} Sep 21 17:08:27.314585 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: {{(pid=120532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 21 17:08:27.314585 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 17:08:27.314585 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 21 17:08:27.314585 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 21 17:08:27.314585 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 21 17:08:27.314585 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 21 17:08:27.314585 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 21 17:08:27.314585 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 21 17:08:27.314585 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 21 17:08:27.314585 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 21 17:08:27.314585 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 529464ed-acbf-4d35-9220-6b24020f7759 could not be found. Sep 21 17:08:27.314585 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 17:08:27.314585 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 17:08:27.314585 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 17:08:27.314585 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 17:08:27.314585 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 17:08:27.314585 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 17:08:27.314585 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 21 17:08:27.314585 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 21 17:08:27.314585 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 21 17:08:27.315914 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 21 17:08:27.315914 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 21 17:08:27.315914 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 21 17:08:27.315914 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 21 17:08:27.315914 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 21 17:08:27.315914 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 21 17:08:27.315914 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 21 17:08:27.315914 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 529464ed-acbf-4d35-9220-6b24020f7759 could not be found. Sep 21 17:08:27.315914 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 17:08:27.315914 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 21 17:08:27.315914 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 17:08:27.315914 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 21 17:08:27.315914 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 21 17:08:27.315914 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 21 17:08:27.315914 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 21 17:08:27.315914 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 21 17:08:27.315914 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 529464ed-acbf-4d35-9220-6b24020f7759 could not be found. Sep 21 17:08:27.315914 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: ERROR nova.api.openstack.wsgi Sep 21 17:08:27.317062 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: DEBUG nova.api.openstack.wsgi [None req-ad452e11-1858-4877-9e52-8aeaf3a7d622 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Returning 404 to user: Instance 529464ed-acbf-4d35-9220-6b24020f7759 could not be found. {{(pid=120532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 21 17:08:27.317062 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: INFO nova.api.openstack.requestlog [None req-ad452e11-1858-4877-9e52-8aeaf3a7d622 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759" status: 404 len: 111 microversion: 2.1 time: 0.029987 Sep 21 17:08:27.317062 dv-cinder-858621-1-iscsi devstack@n-api.service[120532]: [pid: 120532|app: 0|req: 911/1742] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Sep 21 17:08:27 2022] GET /compute/v2.1/servers/529464ed-acbf-4d35-9220-6b24020f7759 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 21 17:08:27.472596 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: DEBUG nova.api.openstack.wsgi [None req-f47e044e-3acd-4635-9a8c-c58109deed89 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] Calling method '.version_select at 0x7fdb88c54790>' {{(pid=120531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 21 17:08:27.500471 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: INFO nova.api.openstack.requestlog [None req-f47e044e-3acd-4635-9a8c-c58109deed89 tempest-TestShelveInstance-2067530476 tempest-TestShelveInstance-2067530476-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1644709038" status: 202 len: 0 microversion: 2.1 time: 0.031713 Sep 21 17:08:27.501997 dv-cinder-858621-1-iscsi devstack@n-api.service[120531]: [pid: 120531|app: 0|req: 832/1743] 10.222.0.64 () {58 vars in 1254 bytes} [Wed Sep 21 17:08:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1644709038 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)